Parakeet: A mobile speech recognition interface

Home > Software > Parakeet

Parakeet is a system for efficient mobile text entry using speech and a touch-screen interface. Users enter text into their mobile Linux device (such as the Nokia N800) by speaking into a Bluetooth microphone. The user then reviews and corrects the recognizer's output using an interface based on a word confusion network. We used PocketSphinx for the speech recognition.

Details about an initial stylus-based prototype of Parakeet can be found here. This research was funded in part by Nokia.

Publications

Parakeet: A Continuous Speech Recognition System for Mobile Touch-Screen Devices

Keith Vertanen and Per Ola Kristensson

IUI '09: Proceedings of the ACM International Conference on Intelligent User Interfaces, 2009. Featured in The Economist.

Parakeet: A Demonstration of Speech Recognition on a Mobile Touch-Screen Device

Keith Vertanen and Per Ola Kristensson

IUI '09: Proceedings of the ACM International Conference on Intelligent User Interfaces, 2009.


There are more details about this research in chapter 5 of my thesis.


Videos
Correcting using Parakeet, normal 640x480 WMV   MPEG   YouTube
Correcting using Parakeet, high res 960x720 WMV   MPEG
Correcting using Parakeet, low res 320x240 WMV   MPEG
Handheld example using Parakeet MOV

Screenshots

Crossing multiple words at once.

Copying a word between clusters.

Typing using the predictive software keyboard.

Predictions based on morphological variants.