~geb/numen

Voice control for handsfree computing
a day ago

#10 Support more VOSK models

~breatheoutbreathein commented on numen todo

a day ago

#Numen

Numen is voice control for handsfree computing, letting you type efficiently by saying syllables and literal words. It works system-wide on Linux and the speech recognition runs locally.

There's a short demonstration on: numenvoice.org

#Install From Packages

Packages of Numen are available on:

and potentially other platforms.

#Install From Source

go (aka golang) and scdoc are required.

A binary of the speech recognition library and an English model (about 40MB) can be installed with:

sudo ./install-vosk.sh && sudo ./install-model.sh

The dotool command which simulates the input, can be installed with:

sudo ./install-dotool.sh

Finally, Numen itself can be installed with:

sudo ./install-numen.sh

#Permission and Keyboard Layouts

dotool requires permission to /dev/uinput to create the virtual input devices, and a udev rule grants this to users in group input.

You can try:

echo type hello | dotool

and if need be, you could add your user to group input with:

sudo groupadd -f input
sudo usermod -a -G input $USER

and re-login and trigger the udev rule or just reboot.

If it types something other than hello, see about keyboard layouts in the manpage.

#Getting Started

Once you've got a microphone, you can run it with:

numen

There shouldn't be any output, but you can try typing hey by saying "hoof each yank", and try transcribing a sentence after saying "scribe". Terminate it by pressing Ctrl+c (aka "troy cap").

If nothing happened, check it's using the right audio device with:

timeout 5 numen --verbose --audiolog=me.wav
aplay me.wav

and specify a --mic from --list-mics if not.

Now you're ready to have a go in your text editor! The default phrases are in the /etc/numen/phrases directory.

#Going Further

I use Numen and the default phrases for all my computing, with keyboard-based programs like Neovim and qutebrowser. I also use a minimal desktop environment I made, called Tiles, that doesn't require a pointer device for window management, file picking, etc.

The manpage covers configuring Numen.

#Mailing List and Matrix Chat

You can send questions or patches by composing an email to ~geb/numen@lists.sr.ht.

You're also welcome to join the Matrix chat at #numen:matrix.org.

#See Also

  • Tiles - a minimal desktop environment suited to voice control.
  • Noggin - face tracking I use for playing/developing games.

#Support My Work 👀

Thank you!

#License

AGPLv3 only, see LICENSE.

Copyright (c) 2022-2023 John Gebbie