mlsanityData to 14 Oct 2026

AURAL: Adaptive Latent Reasoning with Joint Chunk for Speech Language Models

arXiv 2610.01560 ↗First posted 1 Oct 2026cs.CL cs.LG cs.SDcited by 1

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

Model intelligence and fast response jointly shape the quality of interaction with speech language models, yet remain difficult to achieve together. Explicit chain-of-thought (CoT) improves reasoning and audio understanding, but generating intermediate reasoning tokens delays responses. Describing fine-grained acoustic cues further lengthens CoT and increases latency. Latent reasoning can reduce this overhead, yet existing methods often trail CoT and remain limited by single-path supervision and reasoning budgets that do not adapt to problem difficulty. We introduce AURAL, which models a distribution over multiple plausible reasoning continuations in latent space and jointly predicts chunks of future states to reduce sequential forward passes and reasoning latency. To provide initial supervision for latent reasoning, we construct AuralReason-683K: 683K bilingual speech utterances (about 1,000 hours) with concise CoT for emotion recognition, empathetic dialogue, and general reasoning. AURAL-RL then explores beyond these traces, rewarding concise reasoning that yields high-quality answers and adapting reasoning effort to each problem. Across two backbones, AURAL-RL achieves performance comparable to CoT-RL, with larger gains over the respective supervised checkpoints on most metrics. Analysis further shows that harder questions elicit more latent reasoning steps. On Qwen2.5-Omni, it reduces time to the first answer token by 11.8x, from 1.22 to 0.10 s, versus 0.05 s for direct answering.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 51 of its 53 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

51 of 53 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Continuous Audio Thinking for Large Audio Language Models5 Jun
  2. 2026LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoning21 May
  3. 2025Step-Audio-R1 Technical Report19 Nov
  4. 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark5 Jun
  5. 2025Qwen2.5-Omni Technical Report26 Mar

Other references · 46

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  5. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
  6. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  7. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  8. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
  9. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
  10. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
  11. 2025Qwen3-Omni Technical Reportcited by 497
  12. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
34 more
  1. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
  2. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 225
  3. 2025Kimi-Audio Technical Reportcited by 222
  4. 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 205
  5. 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representationscited by 201
  6. 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 200
  7. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
  8. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 183
  9. 2026Qwen3-TTS Technical Reportcited by 118
  10. 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
  11. 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 115
  12. 2023EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesiscited by 98
  13. 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chainscited by 85
  14. 2025Don't Overthink it. Preferring Shorter Thinking Chains for Improved LLM Reasoningcited by 85
  15. 2024EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberationcited by 64
  16. 2025MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligencecited by 61
  17. 2019Scheduled Sampling for Transformerscited by 48
  18. 2025LLM Latent Reasoning as Chain of Superpositioncited by 39
  19. 2025Parallel Continuous Chain-of-Thought with Jacobi Iterationcited by 25
  20. 2025The MSP-Podcast Corpuscited by 16
  21. 2026EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoningcited by 15
  22. 2020Playing a Part: Speaker Verification at the Moviescited by 11
  23. 2025EchoMind: An Interrelated Multi-level Benchmark for Evaluating Empathetic Speech Language Modelscited by 11
  24. 2026Latent-GRPO: Group Relative Policy Optimization for Latent Reasoningcited by 10
  25. 2025EmotionTalk: An Interactive Chinese Multimodal Emotion Dataset With Rich Annotationscited by 8
  26. 2026VoxSafeBench: Not Just What Is Said, but Who, How, and Wherecited by 8
  27. 2024RealMAN: A Real-Recorded and Annotated Microphone Array Dataset for Dynamic Speech Enhancement and Localizationcited by 6
  28. 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoningcited by 6
  29. 2026ParaBridge: Bridging Paralinguistic Perception and Dialogue Behavior in Speech Language Modelscited by 6
  30. 2025Marco-Voice Technical Reportcited by 3
  31. 2026Beyond Semantic Dominance: Cognitive Affective Reasoning and Empathetic Response Alignment in Audio Language Modelscited by 3
  32. 2026Latent Thought Flow: Efficient Latent Reasoning in Large Language Modelscited by 3
  33. 2026Listen, Pause, and Reason: Toward Perception-Grounded Hybrid Reasoning for Audio Understandingcited by 2
  34. 2026Training Continuous Chain of Thought Models: A Tale of Two Regimescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thinking in Depth, Speaking Directly: Recurrent Latent Reasoning for Paralinguistically Grounded Spoken Dialogue
  2. 2025SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models
  3. 2025SpeechR: A Benchmark for Speech Reasoning in Large Audio-Language Models
  4. 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model
  5. 2025Can Speech LLMs Think while Listening?
  6. 2025Thinking with Sound: Audio Chain-of-Thought Enables Multimodal Reasoning in Large Audio-Language Models
  7. 2025Audio Flamingo Sound-CoT Technical Report: Improving Chain-of-Thought Reasoning in Sound Understanding
  8. 2026Afrispeech Semantics: Evaluating Audio Semantic Reasoning in Spoken Language Models Across Domains and Accents