Chronological Thinking in Full-Duplex Spoken Dialogue Language Models
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
Recent advances in spoken dialogue language models (SDLMs) reflect growing interest in shifting from turn-based to full-duplex systems, where the models continuously perceive user speech streams while generating responses. This simultaneous listening and speaking design enables real-time interaction and the agent can handle dynamic conversational behaviors like user barge-in. However, during the listening phase, existing systems keep the agent idle by repeatedly predicting the silence token, which departs from human behavior: we usually engage in lightweight thinking during conversation rather than remaining absent-minded. Inspired by this, we propose Chronological Thinking, an on-the-fly conversational thinking mechanism that aims to improve response quality in full-duplex SDLMs. Specifically, chronological thinking presents a paradigm shift from conventional LLM thinking approaches, such as Chain-of-Thought, purpose-built for streaming acoustic input. (1) Strictly causal: the agent reasons incrementally while listening, updating internal hypotheses only from past audio with no lookahead. (2) No additional latency: reasoning is amortized during the listening window; once the user stops speaking, the agent halts thinking and begins speaking without further delay. Experiments demonstrate the effectiveness of chronological thinking through both objective metrics and human evaluations show consistent improvements in response quality. Furthermore, chronological thinking robustly handles conversational dynamics and attains competitive performance on full-duplex interaction metrics.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 56 references that are in the map. First posted on arXiv 2 Oct 2025.
Builds on
40 of 56 references.
References · 40
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 843
- 2022PAL: Program-aided Language Modelscited by 652
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
- 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 235
28 more
- 2018Streaming End-to-end Speech Recognition For Mobile Devicescited by 234
- 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 224
- 2025Kimi-Audio Technical Reportcited by 222
- 2018Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotroncited by 173
- 2022Generative Spoken Dialogue Language Modelingcited by 126
- 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 104
- 2022Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generationcited by 94
- 2023Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLMcited by 94
- 2019Monotonic Multihead Attentioncited by 93
- 2024Recent Advances in Speech Language Models: A Surveycited by 87
- 2025Step-Audio: Unified Understanding and Generation in Intelligent Speech Interactioncited by 83
- 2025MinMo: A Multimodal Large Language Model for Seamless Voice Interactioncited by 79
- 2020Streaming automatic speech recognition with the transformer modelcited by 73
- 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 72
- 2023SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agentscited by 71
- 2024Language Model Can Listen While Speakingcited by 63
- 2018Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translationcited by 52
- 2024A Full-duplex Speech Dialogue Scheme Based On Large Language Modelscited by 40
- 2025SALM-Duplex: Efficient and Direct Duplex Modeling for Speech-to-Speech Language Modelcited by 34
- 2024SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generationcited by 33
- 2022Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systemscited by 28
- 2025FireRedChat: A Pluggable, Full-Duplex Voice Interaction System with Cascaded and Semi-Cascaded Implementationscited by 18
- 2025FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systemscited by 15
- 2025NanoCodec: Towards High-Quality Ultra Fast Speech LLM Inferencecited by 15
- 2023Penalty Decoding: Well Suppress the Self-Reinforcement Effect in Open-Ended Text Generationcited by 13
- 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inferencecited by 11
- 2025LLM-Enhanced Dialogue Management for Full-Duplex Spoken Dialogue Systemscited by 9
- 2023Mitigating the Learning Bias towards Repetition by Self-Contrastive Training for Open-Ended Generationcited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 12.
14 papers.
Sort:
By area:
- 2025Step-Audio-R1 Technical Reportcited by 36
- 2025SHANKS: Simultaneous Hearing and Thinking for Spoken Language Modelscited by 19
- 2026Covo-Audio Technical Reportcited by 7
- 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoningcited by 6
- 2026Audio Interaction Modelcited by 4
- 2026Liberating LLM Capabilities in Full-Duplex Speech Modelscited by 2
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interactioncited by 2
- 2026Unit-Based Agent for Semi-Cascaded Full-Duplex Dialogue Systemscited by 1
- 2026Privacy-Preserving End-to-End Full-Duplex Speech Dialogue Modelscited by 1
- 2026Never Stop Thinking: Continuous-Time Language Agentscited by 1
- 2026IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systemscited by 0
- 2026Acoustic-to-Text KV Compression for Full-Duplex Speech Modelscited by 0
2 more
- 2026RUBATO: Decoupled Clocks Allow Full-Duplex Models to Think as Fast as They Can9 Oct 2026
- 2026LLMs are General Asynchronous Agents28 Sep 2026
- 2026Acoustic-to-Text KV Compression for Full-Duplex Speech Models25 Sep 2026
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction26 Aug 2026
- 2026Never Stop Thinking: Continuous-Time Language Agents11 Jul 2026
- 2026IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systems4 Jun 2026
- 2026Audio Interaction Model3 Jun 2026
- 2026Liberating LLM Capabilities in Full-Duplex Speech Models4 May 2026
- 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoning18 Mar 2026
- 2026Privacy-Preserving End-to-End Full-Duplex Speech Dialogue Models9 Mar 2026
- 2026Covo-Audio Technical Report10 Feb 2026
- 2026Unit-Based Agent for Semi-Cascaded Full-Duplex Dialogue Systems28 Jan 2026
2 more
- 2025Step-Audio-R1 Technical Report19 Nov 2025
- 2025SHANKS: Simultaneous Hearing and Thinking for Spoken Language Models8 Oct 2025
- 2025Step-Audio-R1 Technical Reportcited by 36
- 2025SHANKS: Simultaneous Hearing and Thinking for Spoken Language Modelscited by 19
- 2026Never Stop Thinking: Continuous-Time Language Agentscited by 1
- 2026Never Stop Thinking: Continuous-Time Language Agents11 Jul 2026
- 2025Step-Audio-R1 Technical Report19 Nov 2025
- 2025SHANKS: Simultaneous Hearing and Thinking for Spoken Language Models8 Oct 2025
- 2026Unit-Based Agent for Semi-Cascaded Full-Duplex Dialogue Systemscited by 1
- 2026LLMs are General Asynchronous Agentscited by 0
- 2026LLMs are General Asynchronous Agents28 Sep 2026
- 2026Unit-Based Agent for Semi-Cascaded Full-Duplex Dialogue Systems28 Jan 2026
- 2026Covo-Audio Technical Reportcited by 7
- 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoningcited by 6
- 2026Audio Interaction Modelcited by 4
- 2026Liberating LLM Capabilities in Full-Duplex Speech Modelscited by 2
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interactioncited by 2
- 2026Privacy-Preserving End-to-End Full-Duplex Speech Dialogue Modelscited by 1
- 2026IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systemscited by 0
- 2026Acoustic-to-Text KV Compression for Full-Duplex Speech Modelscited by 0
- 2026RUBATO: Decoupled Clocks Allow Full-Duplex Models to Think as Fast as They Cancited by 0
- 2026RUBATO: Decoupled Clocks Allow Full-Duplex Models to Think as Fast as They Can9 Oct 2026
- 2026Acoustic-to-Text KV Compression for Full-Duplex Speech Models25 Sep 2026
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction26 Aug 2026
- 2026IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systems4 Jun 2026
- 2026Audio Interaction Model3 Jun 2026
- 2026Liberating LLM Capabilities in Full-Duplex Speech Models4 May 2026
- 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoning18 Mar 2026
- 2026Privacy-Preserving End-to-End Full-Duplex Speech Dialogue Models9 Mar 2026
- 2026Covo-Audio Technical Report10 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026LTS-VoiceAgent: A Listen-Think-Speak Framework for Efficient Streaming Voice Interaction via Semantic Triggering and Incremental Reasoning
- 2025Can Speech LLMs Think while Listening?
- 2025Enabling Conversational Behavior Reasoning Capabilities in Full-Duplex Speech
- 2026Learning When to Think While Listening in Large Audio-Language Models
- 2026Spoken Language Models that Think Aloud
- 2025Mind-Paced Speaking: A Dual-Brain Approach to Real-Time Reasoning in Spoken Language Models
- 2025Chain-of-Thought Reasoning in Streaming Full-Duplex End-to-End Spoken Dialogue Systems
- 2026Don't Wait to Reply: Towards Responsive yet Thoughtful Dialogue through Proactive Thinking