Mind-Paced Speaking: A Dual-Brain Approach to Real-Time Reasoning in Spoken Language Models
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
Real-time Spoken Language Models (SLMs) struggle to leverage Chain-of-Thought (CoT) reasoning due to the prohibitive latency of generating the entire thought process sequentially. Enabling SLMs to think while speaking, similar to humans, is attracting increasing attention. We present, for the first time, Mind-Paced Speaking (MPS), a brain-inspired framework that enables high-fidelity, real-time reasoning. Similar to how humans utilize distinct brain regions for thinking and responding, we propose a novel dual-brain approach, employing a "Formulation Brain" for high-level reasoning to pace and guide a separate "Articulation Brain" for fluent speech generation. This division of labor eliminates mode-switching, preserving the integrity of the reasoning process. Experiments show that MPS significantly outperforms existing think-while-speaking methods and achieves reasoning performance comparable to models that pre-compute the full CoT before speaking, while drastically reducing latency. Under a zero-latency configuration, the proposed method achieves an accuracy of 92.8% on the mathematical reasoning task Spoken-MQA and attains a score of 82.5 on the speech conversation task URO-Bench. MPS is the methodology underlying our released Step-Audio R1.1 system, effectively bridging the gap between high-quality reasoning and real-time interaction.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 32 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
21 of 32 references.
Closest ancestors · 6
Same direction, newest first
- 2025Mini-Omni-Reasoner: Token-Level Thinking-in-Speaking in Large Speech Models18 Aug
- 2025STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models21 Jul
- 2025SARI: Structured Audio Reasoning via Curriculum-Guided Reinforcement Learning22 Apr
- 2025Qwen2.5-Omni Technical Report26 Mar
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answering14 Mar
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models4 Mar
Other references · 15
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2 Technical Reportcited by 2,076
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
- 2023Think before you speak: Training Language Models With Pause Tokenscited by 254
- 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 218
- 2024Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelscited by 186
- 2025Step-Audio 2 Technical Reportcited by 101
- 2024Recent Advances in Speech Language Models: A Surveycited by 85
- 2025LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesiscited by 75
- 2024SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generationcited by 33
3 more
- 2025SALM-Duplex: Efficient and Direct Duplex Modeling for Speech-to-Speech Language Modelcited by 32
- 2025URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Modelscited by 29
- 2025Towards Spoken Mathematical Reasoning: Benchmarking Speech-based Models over Multi-faceted Math Problemscited by 12
Built on by
Citing papers per year: 2025: 2; 2026: 7.
9 papers.
- 2025Step-Audio-R1 Technical Reportcited by 35
- 2025Asynchronous Reasoning: Training-Free Interactive Thinking LLMscited by 6
- 2026Multimodal Duplex Interaction Agentcited by 3
- 2026Liberating LLM Capabilities in Full-Duplex Speech Modelscited by 1
- 2026Improving Code-Switching ASR with Code-Mixing Guided Synthetic Speechcited by 1
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interactioncited by 1
- 2026Never Stop Thinking: Continuous-Time Language Agentscited by 1
- 2026Thinking-while-speaking: A Controlled, Interleaved Reasoning Method for Real-Time Speech Generationcited by 0
- 2026Efficient Chain-of-Modality Reasoning via Progressive Compression for Spoken Language Modelscited by 0
- 2026Multimodal Duplex Interaction Agent8 Sep 2026
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction26 Aug 2026
- 2026Efficient Chain-of-Modality Reasoning via Progressive Compression for Spoken Language Models22 Jul 2026
- 2026Never Stop Thinking: Continuous-Time Language Agents11 Jul 2026
- 2026Improving Code-Switching ASR with Code-Mixing Guided Synthetic Speech14 Jun 2026
- 2026Thinking-while-speaking: A Controlled, Interleaved Reasoning Method for Real-Time Speech Generation20 May 2026
- 2026Liberating LLM Capabilities in Full-Duplex Speech Models4 May 2026
- 2025Asynchronous Reasoning: Training-Free Interactive Thinking LLMs11 Dec 2025
- 2025Step-Audio-R1 Technical Report19 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025SHANKS: Simultaneous Hearing and Thinking for Spoken Language Models
- 2025Can Speech LLMs Think while Listening?
- 2026Spoken Language Models that Think Aloud
- 2025Chronological Thinking in Full-Duplex Spoken Dialogue Language Models
- 2025DynamicMind: A Tri-Mode Thinking System for Large Language Models
- 2026Thinking in Depth, Speaking Directly: Recurrent Latent Reasoning for Paralinguistically Grounded Spoken Dialogue
- 2025Thinking Before You Speak: A Proactive Test-time Scaling Approach
- 2025Think, Verbalize, then Speak: Bridging Complex Thoughts and Comprehensible Speech