4
$\begingroup$

I was looking into how a next-word prediction engine like swift key or XT9 can be implemented.

Here's what I did.

  • I read about n-grams here - en.wikipedia.org/wiki/N-gram and aicat.inf.ed.ac.uk/entry.php?id=663
  • I read about Language Models/Markov Model/n-grams/training/Smoothing/Back-Offs - en.wikipedia.org/wiki/Language_model & www.stanford.edu/class/cs124/lec/languagemodeling.pptx‎ & www.statmt.org/book/slides/07-language-models.pdf.
  • I read about the T9 engine design for next-word prediction based on Tries - courses.cs.washington.edu/courses/cse303/09wi/homework/T9files/T9_Tries.pdf
  • I came across SRILM, a popular toolkit for building & applying Language Models here - www.speech.sri.com/projects/srilm/ (the toolkit) & www.speech.sri.com/cgi-bin/run-distill?papers/icslp2002-srilm.ps.gz (the documentation)
  • I came across the blog where Google's Peter Norvig made an announcement to share it's huge training corpus of one trillion words to the entire world - googleresearch.blogspot.in/2006/08/all-our-n-gram-are-belong-to-you
  • I came across an n-gram viewer based on google books' corpus - books.google.com/ngrams/
  • I came across Microsoft's N-gram services - web-ngram.research.microsoft.com/
  • I came across an algorithm for N-Gram Language Models which is as fast as but smaller (in memory footprint) than SRILM's model (not based on tries, uses encoding) - nlp.cs.berkeley.edu/pubs/Pauls-Klein_2011_LM_paper.pdf (I need to do more work here.)
  • I had a look at some open-source engines available like AnySoftKeyboard - github.com/AnySoftKeyboard. That's is a huge amount of code with no documentation!

Some discussions on stackoverflow:

  • Implementing T9 prediction engine - Implementing T9 text prediction
  • A discussion on implementation of autocomplete using tries vs. ternary search trees vs. succint trees - stackoverflow.com/questions/10970416/tries-versus-ternary-search-trees-for-autocomplete

The major players in this area:

  • Swift Key - en.wikipedia.org/wiki/SwiftKey & www.swiftkey.net/en/
  • XT9 by Nuance - en.wikipedia.org/wiki/XT9 & www.nuance.com/for-business/by-product/xt9/index.htm

Can anybody guide me how to proceed further.

I am relatively new to this site. So please guide me if my question is inappropriate for this site.

$\endgroup$
  • $\begingroup$ unfortunately your question is a little too broad. what are you trying to accomplish? also try chat $\endgroup$ – vzn Nov 26 '13 at 19:44

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.