Parakeet is a system for efficient mobile text entry using speech and a touch-screen interface. Users enter text into their mobile Linux device (such as the Nokia N800) by speaking into a Bluetooth microphone. The user then reviews and corrects the recognizer's output using an interface based on a word confusion network. We used PocketSphinx for the speech recognition.

Details about an initial stylus-based prototype of Parakeet can be found here. This research was funded in part by Nokia.

Parakeet: A Continuous Speech Recognition System for Mobile Touch-Screen Devices

Keith Vertanen, Per Ola Kristensson

IUI '09: Proceedings of the ACM International Conference on Intelligent User Interfaces, 2009. Featured in The Economist.

[Abstract+videos  PDF  BibTeX]

Parakeet: A Demonstration of Speech Recognition on a Mobile Touch-Screen Device

Keith Vertanen, Per Ola Kristensson

IUI '09: Proceedings of the ACM International Conference on Intelligent User Interfaces, 2009.

[Abstract+videos  PDF  BibTeX]

There are more details about this research in chapter 5 of my thesis.

Crossing multiple words at once.

Copying a word between clusters.

Typing using the predictive software keyboard.

Predictions based on morphological variants.