All Questions
Tagged with data-mining information-retrieval
6 questions
2
votes
1
answer
191
views
How does an inverted index reduce storage requirements?
In p. 7 of the book "Introduction to Information Retrieval" (by Manning et al), the authors explain how, given a collection of text documents, an inverted index is built by tokenizing, then ...
- 21
1
vote
1
answer
59
views
How to figure out whether two texts refer to the same object or event
Let's assume there is something happen in the world - Football world cup final. And team-1 beat team-2 with the score 3:2. So there is whole bunch of articles on every website about it, each contains ...
- 141
6
votes
1
answer
757
views
Measuring the information of a document?
I'd like to measure how much information a document $D$ contains.
Clearly, the New York Times published yesterday contains more information than my diary wrote on the same day. But, I do not know ...
- 259
2
votes
2
answers
446
views
Can you get O(n) with a word frequency algorithm?
By a word frequency algorithm:
An algorithm gets a document as an input, and returns each unique word along with the number of times it has appeared in the document.
For example:
in:"Hello my name ...
- 21
2
votes
2
answers
3k
views
Application of cosine similarity to detect plagiarism
Can anyone tell me how using cosine similarity to see the correlation between two documents actually shows you if someone is plagiarising the other? I understand how cosine similarity works but don't ...
- 21
2
votes
1
answer
969
views
Document definition in information retrieval
Is there common formal definition of Document in information retrieval field? In many researches authors don't define the term Document(maybe because it is evident for them). Wikipedia says "text file,...
- 131