Aleph Neuro Achieves Silent Speech with Ultrasound and Whisper

Silent speech with ultrasound

We trained a model to predict speech from ultrasound recordings of the tongue while speakers remain silent. Using just 50 hours of data and Whisper, our system achieves a 15.6% word error rate on open-vocabulary tasks, generalizing across new users with American accents. This approach offers a private alternative to voice commands, allowing invisible silent speech without the need for noisy indirect measurements like EMG or radar.

"Just as earphones made listening private, silent speech could make speaking private."