I'm both interested in practical and theoretical aspects of the problem. How do you store linguistic data. Suppose you have stemmed, parsed, tagged and, perhaps even did some preliminary analysis, such as clustering by topics, how then do you store this information for reuse?
I've been looking at knowledge representation formats, but, and maybe because I was doing it on my own, without guidance, two aspects strike me as odd:
- The technology is very immature (and most things I could find relevant to the subject seem to be abandoned in the last century).
- Even then, there weren't real storage engines. The closest I could get was a triplestore. While, maybe at the basis level this is an interesting idea, there seem to be no tools or techniques which build on top of it.
To make this question more concrete, consider this chain: there are relations out there in the real world, certain aspects of them are captured by relational algebra; SQL language builds on top of relational algebra, adding new concepts such as tables, triggers etc.
Similarly, out there in the world there are phrases people say or write to each other, there are several theories which try to capture the underlying principles of the structure of those phrases (for example, dependency parsing or constituency parsing). If the later is in some sense equivalent to relational algebra, what would be the equivalent of SQL-enabled databases for linguistic data?