New throat patch can turn muscle movements into speech


Credit: Jun Chen

A new adhesive patch could one day help people with voice disorders speak again by using artificial intelligence to read the movements of their throat muscles and turn them into speech, researchers said Tuesday.

The small, stretchy patch is powered solely by muscle movements, the US-based researchers revealed in a study in Nature Communications,

Attached to the skin, the patch converts the movements of the larynx muscles into electrical signals, which are in turn translated into speech by a machine learning algorithm, a form of AI.

Then a speaker plays the sentences the person intended to say aloud—though the prototype can currently only relay certain pre-recorded phrases.

Crucially, the patch works without needing to pick up on the vibrations of a person’s vocal cords, meaning it would help restore the speech of people with damaged vocal cords, lead study author Ziyuan Che of the University of California, Los Angeles told AFP.

Nearly a third of people suffer at least one voice disorder in their lifetime, according to the study.

Existing treatments for serious voice problems, such as handheld devices like an electrolarynx, can be “inconvenient, uncomfortable, or invasive,” the researchers said.

95% accuracy

The waterproof patch is roughly the size of a large coin and weighs just seven grams.

Che compared its texture to that of a rubber glove.

To test the device, eight volunteers without voice disorders were asked to both speak and whisper five sentences including “Merry Christmas”, “I love you” or “I don’t trust you”.

They read out the phrases while standing, walking and running, to show the patch worked while on the move.

The device accurately predicted what the volunteers were saying roughly 95 percent of the time, according to the study.

Some words that move throat muscles in a similar manner—such as the word “make” and the name “Mark”—could be difficult for the patch to tell apart, Che said.

“But those two words usually appear in a long sentence like ‘I am going to make dinner,’ or ‘How you doing Mark?’,” Che added.

This allows the device—which translates sentences, not just words—to pick up the context.

Che cautioned that the prototype was still years away from potentially being available to patients.

And all the sentences that can currently be played by the device have to be pre-recorded, which “would limit the application of our device,” Che acknowledged.

But he believed that more advanced algorithms would allow the patch to translate larynx muscle movements “without the need of pre-recording the voice signals”.

More information:
Ziyuan Che et al, Speaking without vocal folds using a machine-learning-assisted wearable sensing-actuation system, Nature Communications (2024). DOI: 10.1038/s41467-024-45915-7

© 2024 AFP

Citation: New throat patch can turn muscle movements into speech (2024, March 12) retrieved 12 March 2024 from

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Leave a Comment

Your email address will not be published. Required fields are marked *