mlsanityData to 14 Oct 2026

Wearable intelligent throat enables natural speech in stroke patients with dysarthria

arXiv 2411.18266 ↗First posted 27 Nov 2024eess.AS cs.AI cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

Wearable silent speech systems hold significant potential for restoring communication in patients with speech impairments. However, seamless, coherent speech remains elusive, and clinical efficacy is still unproven. Here, we present an AI-driven intelligent throat (IT) system that integrates throat muscle vibrations and carotid pulse signal sensors with large language model (LLM) processing to enable fluent, emotionally expressive communication. The system utilizes ultrasensitive textile strain sensors to capture high-quality signals from the neck area and supports token-level processing for real-time, continuous speech decoding, enabling seamless, delay-free communication. In tests with five stroke patients with dysarthria, IT's LLM agents intelligently corrected token errors and enriched sentence-level emotional and logical coherence, achieving low error rates (4.2% word error rate, 2.9% sentence error rate) and a 55% increase in user satisfaction. This work establishes a portable, intuitive communication platform for patients with dysarthria with the potential to be applied broadly across different neurological conditions and in multi-language support systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 51 references that are in the map. First posted on arXiv 27 Nov 2024.

Builds on

10 of 51 references.

References · 10

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  5. 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 420
  6. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
  7. 20191D Convolutional Neural Networks and Applications: A Surveycited by 153
  8. 2023Human Body Digital Twin: A Master Plancited by 5
  9. 2023Ultrasensitive Textile Strain Sensors Redefine Wearable Silent Speech Interfaces with High Machine Learning Efficiencycited by 3
  10. 2024A deep learning-enabled smart garment for accurate and versatile sleep conditions monitoring in daily lifecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DARS: Dysarthria-Aware Rhythm-Style Synthesis for ASR Enhancement
  2. 2025Improved Intelligibility of Dysarthric Speech using Conditional Flow Matching
  3. 2025When neural implant meets multimodal LLM: A dual-loop system for neuromodulation and naturalistic neuralbehavioral research
  4. 2025Context-Adaptive Hearing Aid Fitting Advisor through Multi-turn Multimodal LLM Conversation ↗
  5. 2024Towards an End-to-End Framework for Invasive Brain Signal Decoding with Large Language Models
  6. 2026Choosing a PEFT Variant for Per-Patient Dysarthric ASR: A Single-Speaker Case Study on Two ASR Bases
  7. 2024Training Data Augmentation for Dysarthric Automatic Speech Recognition by Text-to-Dysarthric-Speech Synthesis
  8. 2025Objective and Subjective Evaluation of Diffusion-Based Speech Enhancement for Dysarthric Speech