mlsanityData to 14 Oct 2026

Chronological Thinking in Full-Duplex Spoken Dialogue Language Models

arXiv 2510.05150 ↗First posted 2 Oct 2025cs.CL cs.AIcited by 14

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

Recent advances in spoken dialogue language models (SDLMs) reflect growing interest in shifting from turn-based to full-duplex systems, where the models continuously perceive user speech streams while generating responses. This simultaneous listening and speaking design enables real-time interaction and the agent can handle dynamic conversational behaviors like user barge-in. However, during the listening phase, existing systems keep the agent idle by repeatedly predicting the silence token, which departs from human behavior: we usually engage in lightweight thinking during conversation rather than remaining absent-minded. Inspired by this, we propose Chronological Thinking, an on-the-fly conversational thinking mechanism that aims to improve response quality in full-duplex SDLMs. Specifically, chronological thinking presents a paradigm shift from conventional LLM thinking approaches, such as Chain-of-Thought, purpose-built for streaming acoustic input. (1) Strictly causal: the agent reasons incrementally while listening, updating internal hypotheses only from past audio with no lookahead. (2) No additional latency: reasoning is amortized during the listening window; once the user stops speaking, the agent halts thinking and begins speaking without further delay. Experiments demonstrate the effectiveness of chronological thinking through both objective metrics and human evaluations show consistent improvements in response quality. Furthermore, chronological thinking robustly handles conversational dynamics and attains competitive performance on full-duplex interaction metrics.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 56 references that are in the map. First posted on arXiv 2 Oct 2025.

Builds on

40 of 56 references.

References · 40

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  6. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  8. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  9. 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 843
  10. 2022PAL: Program-aided Language Modelscited by 652
  11. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  12. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 235
28 more
  1. 2018Streaming End-to-end Speech Recognition For Mobile Devicescited by 234
  2. 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 224
  3. 2025Kimi-Audio Technical Reportcited by 222
  4. 2018Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotroncited by 173
  5. 2022Generative Spoken Dialogue Language Modelingcited by 126
  6. 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 104
  7. 2022Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generationcited by 94
  8. 2023Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLMcited by 94
  9. 2019Monotonic Multihead Attentioncited by 93
  10. 2024Recent Advances in Speech Language Models: A Surveycited by 87
  11. 2025Step-Audio: Unified Understanding and Generation in Intelligent Speech Interactioncited by 83
  12. 2025MinMo: A Multimodal Large Language Model for Seamless Voice Interactioncited by 79
  13. 2020Streaming automatic speech recognition with the transformer modelcited by 73
  14. 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 72
  15. 2023SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agentscited by 71
  16. 2024Language Model Can Listen While Speakingcited by 63
  17. 2018Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translationcited by 52
  18. 2024A Full-duplex Speech Dialogue Scheme Based On Large Language Modelscited by 40
  19. 2025SALM-Duplex: Efficient and Direct Duplex Modeling for Speech-to-Speech Language Modelcited by 34
  20. 2024SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generationcited by 33
  21. 2022Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systemscited by 28
  22. 2025FireRedChat: A Pluggable, Full-Duplex Voice Interaction System with Cascaded and Semi-Cascaded Implementationscited by 18
  23. 2025FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systemscited by 15
  24. 2025NanoCodec: Towards High-Quality Ultra Fast Speech LLM Inferencecited by 15
  25. 2023Penalty Decoding: Well Suppress the Self-Reinforcement Effect in Open-Ended Text Generationcited by 13
  26. 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inferencecited by 11
  27. 2025LLM-Enhanced Dialogue Management for Full-Duplex Spoken Dialogue Systemscited by 9
  28. 2023Mitigating the Learning Bias towards Repetition by Self-Contrastive Training for Open-Ended Generationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 12.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026LTS-VoiceAgent: A Listen-Think-Speak Framework for Efficient Streaming Voice Interaction via Semantic Triggering and Incremental Reasoning
  2. 2025Can Speech LLMs Think while Listening?
  3. 2025Enabling Conversational Behavior Reasoning Capabilities in Full-Duplex Speech
  4. 2026Learning When to Think While Listening in Large Audio-Language Models
  5. 2026Spoken Language Models that Think Aloud
  6. 2025Mind-Paced Speaking: A Dual-Brain Approach to Real-Time Reasoning in Spoken Language Models
  7. 2025Chain-of-Thought Reasoning in Streaming Full-Duplex End-to-End Spoken Dialogue Systems
  8. 2026Don't Wait to Reply: Towards Responsive yet Thoughtful Dialogue through Proactive Thinking