mlsanityData to 7 Oct 2026

The Interspeech 2026 Audio Reasoning Challenge: Evaluating Reasoning Process Quality for Audio Reasoning Models and Agents

arXiv 2602.14224 ↗First posted 15 Feb 2026cs.SD cs.CL cs.MMcited by 6

On the map: LLM reasoning → Audio-language model reasoning

also in 1 more
Abstract (arXiv)

Recent Large Audio Language Models (LALMs) excel in understanding but often lack transparent reasoning. To address this "black-box" limitation, we organized the Audio Reasoning Challenge at Interspeech 2026, the first shared task dedicated to evaluating Chain-of-Thought (CoT) quality in the audio domain. The challenge introduced MMAR-Rubrics, a novel instance-level protocol assessing the factuality and logic of reasoning chains. Featured Single Model and Agent tracks, the competition attracting 156 teams from 18 countries and regions. Results show agent systems currently lead in reasoning quality, utilizing iterative tool orchestration and cross-modal analysis. Besides, single models are rapidly advancing via reinforcement learning and sophisticated data pipeline. We details the challenge design, methodology, and a comprehensive analysis of state-of-the-art systems, providing new insights for explainable audio intelligence.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 38 references that are in the map. First posted on arXiv 15 Feb 2026.

Builds on

37 of 38 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025Step-Audio-R1 Technical Report19 Nov
  2. 2025STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence28 Oct
  3. 2025Mini-Omni-Reasoner: Token-Level Thinking-in-Speaking in Large Speech Models18 Aug
  4. 2025Audio-Thinker: Guiding Audio Language Model When and How to Think via Reinforcement Learning11 Aug
  5. 2025SpeechR: A Benchmark for Speech Reasoning in Large Audio-Language Models4 Aug
  6. 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models10 Jul
  7. 2025SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Information19 May
  8. 2025Benchmarking and Confidence Evaluation of LALMs For Temporal Reasoning19 May
  9. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix19 May
  10. 2025Qwen2.5-Omni Technical Report26 Mar
  11. 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answering14 Mar
  12. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities6 Mar
4 more
  1. 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models4 Mar
  2. 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model13 Jan
  3. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark24 Oct
  4. 2024GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities17 Jun

Other references · 21

  1. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
  2. 2024Qwen2-Audio Technical Reportcited by 543
  3. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
  4. 2025Qwen3-Omni Technical Reportcited by 451
  5. 2024Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilitiescited by 183
  6. 2024OmniBench: Towards The Future of Universal Omni-Language Modelscited by 100
  7. 2023Joint Audio and Speech Understandingcited by 99
  8. 2023Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Promptingcited by 71
  9. 2025MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligencecited by 59
  10. 2025Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?cited by 42
  11. 2025Omni-Captioner: Data Pipeline, Models, and Benchmark for Omni Detailed Perceptioncited by 25
  12. 2025CMI-Bench: A Comprehensive Benchmark for Evaluating Music Instruction Followingcited by 15
9 more
  1. 2025Towards Spoken Mathematical Reasoning: Benchmarking Speech-based Models over Multi-faceted Math Problemscited by 12
  2. 2025AudSemThinker: Enhancing Audio-Language Models through Reasoning over Semantics of Soundcited by 11
  3. 2025AudioGenie-Reasoner: A Training-Free Multi-Agent Framework for Coarse-to-Fine Audio Deep Reasoningcited by 6
  4. 2025AudioToolAgent: An Agentic Framework for Audio-Language Modelscited by 6
  5. 2026Now You Hear Me: Audio Narrative Attacks Against Large Audio-Language Modelscited by 5
  6. 2025Spoken Conversational Agents with Large Language Modelscited by 4
  7. 2025SAR-LM: Symbolic Audio Reasoning with Large Language Modelscited by 3
  8. 2025SpeechIQ: Speech-Agentic Intelligence Quotient Across Cognitive Levels in Voice Understanding by Large Language Modelscited by 2
  9. 2026Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perceptioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Incentivizing Consistent, Effective and Scalable Reasoning Capability in Audio LLMs via Reasoning Process Rewards
  2. 2025Audio Flamingo Sound-CoT Technical Report: Improving Chain-of-Thought Reasoning in Sound Understanding
  3. 2025SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models
  4. 2025CMDAR: A Chinese Multi-scene Dynamic Audio Reasoning Benchmark with Diverse Challenges
  5. 2025Thinking with Sound: Audio Chain-of-Thought Enables Multimodal Reasoning in Large Audio-Language Models
  6. 2026Echo: Towards Advanced Audio Comprehension via Audio-Interleaved Reasoning
  7. 2026AudioRAG: A Challenging Benchmark for Audio Reasoning and Information Retrieval
  8. 2026Reinforcement Learning with Evolving Rubrics as Rewards for Audio Reasoning