For doing the core speech recognition, I used the excellent PocketSphinx decoder from David Huggins-Daines at CMU. It is designed to run on mobile platforms like the Nokia. In my tests, is faster and just as accurate as the other flavours of Sphinx decoders.

I obtained the latest SVN trees for SphinxBase and PocketSphinx from here. I then compiled both under the maemo chinook SDK. For improved performance on the N800, I sent the "--enable-fixed" to autogen.sh.

While Debian packages would build for SphinxBase and PocketSphinx, they wouldn't install on the N800. So I just copied the libraries directly to /usr/lib on the N800. Here are zips of the SphinxBase and PocketSphinx libraries and the command line utilities:

SphinxBase/PocketSphinx ARMEL libraries
SphinxBase/PocketSphinx ARMEL utilities