Spoken Language Models that Think Aloud
On the map: LLM reasoning → Prompting and chain-of-thought reasoning also fits: Audio-language model reasoning
Abstract (arXiv)
While Chain-of-Thought (CoT) reasoning has improved the capability of language models, directly applying it to Spoken Language Models (SLMs) may introduce long silent intervals under the serial "think-then-speak" paradigm, disrupting real-time spoken interaction. To address this issue, we propose an asynchronous think-aloud framework for reasoning-based SLMs within the Thinker-Talker architecture. The framework maintains a primary reasoning stream for logical deduction and a lightweight think-aloud stream that generates short, task-grounded progress utterances conditioned on the user input and the evolving reasoning state. A dynamic balance strategy coordinates the two streams at runtime, triggering additional think-aloud speech to avoid silent gaps and canceling pending utterances when the final response becomes ready. Experiments on spoken reasoning and question-answering benchmarks show that our approach substantially reduces user-audible silence during reasoning while maintaining answer accuracy comparable to that of a serial "think-then-speak" baseline, demonstrating the potential of asynchronous think-aloud for responsive interaction in SLMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 37 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
26 of 37 references.
References · 26
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2024OpenAI o1 System Cardcited by 1,244
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2025Qwen2.5-Omni Technical Reportcited by 736
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
- 2024Qwen2-Audio Technical Reportcited by 560
- 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
- 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 224
- 2025Kimi-Audio Technical Reportcited by 222
14 more
- 2024Mini-Omni: Language Models Can Hear, Talk While Thinking in Streamingcited by 210
- 2024LLaMA-Omni: Seamless Speech Interaction with Large Language Modelscited by 173
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 141
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 95
- 2025MinMo: A Multimodal Large Language Model for Seamless Voice Interactioncited by 79
- 2025LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesiscited by 76
- 2025Baichuan-Audio: A Unified Framework for End-to-End Speech Interactioncited by 68
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answeringcited by 65
- 2025SARI: Structured Audio Reasoning via Curriculum-Guided Reinforcement Learningcited by 34
- 2025VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Modelcited by 31
- 2025STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Modelscited by 26
- 2025Mini-Omni-Reasoner: Token-Level Thinking-in-Speaking in Large Speech Modelscited by 21
- 2025LUCY: Linguistic Understanding and Control Yielding Early Stage of Hercited by 17
- 2025Towards Spoken Mathematical Reasoning: Benchmarking Speech-based Models over Multi-faceted Math Problemscited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Can Speech LLMs Think while Listening?
- 2025SHANKS: Simultaneous Hearing and Thinking for Spoken Language Models
- 2025Mind-Paced Speaking: A Dual-Brain Approach to Real-Time Reasoning in Spoken Language Models
- 2025Chronological Thinking in Full-Duplex Spoken Dialogue Language Models
- 2026Learning When to Think While Listening in Large Audio-Language Models
- 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model
- 2025Early Stopping Chain-of-thoughts in Large Language Models
- 2025Asynchronous Reasoning: Training-Free Interactive Thinking LLMs