mlsanityData to 7 Oct 2026

Audio-Zero: Label-Free Self-Evolution for Fine-Grained Audio Reasoning

arXiv 2607.20166 ↗First posted 22 Jul 2026cs.SD cs.AIcited by 1

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

Large Audio Language models (LALMs) have made rapid progress on acoustic understanding, yet they still struggle with fine-grained audio reasoning (e.g., recognizing event order, repetitions and duration). Existing post-training methods heavily rely on expensive external labels or provide only coarse semantic signals. To bridge this gap, we introduce Audio-Zero, the first label-free self-evolution framework in the field of LALMs that improves fine-grained auditory perception and reasoning. Audio-Zero constructs an auditory self-play game from unlabeled audio contrast pairs: most players hear a reference audio, while one odd listener hears a subtle variant. The model first generates clues describing what it hears and then identifies the odd listener by reasoning over inconsistencies among clues. Since the odd listener is known by construction, the game provides verifiable rewards without any annotated answers. Experiments with Qwen2-Audio-7B-Instruct and Qwen2.5-Omni-7B on TREA, MMAU Test-mini and MMAR show that Audio-Zero improves fine-grained audio reasoning while preserving broad audio understanding. Evolutionary and diagnostic analyses further reveal that increasingly fine-grained auditory descriptions emerge naturally from game pressure.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 37 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

36 of 37 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Incentivizing Consistent, Effective and Scalable Reasoning Capability in Audio LLMs via Reasoning Process Rewards23 Oct
  2. 2025Can Speech LLMs Think while Listening?8 Oct
  3. 2025Teaching Audio Models to Reason: A Unified Framework for Source- and Layer-wise Distillation23 Sep
  4. 2025SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Information19 May
  5. 2025Benchmarking and Confidence Evaluation of LALMs For Temporal Reasoning19 May
  6. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix19 May
  7. 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answering14 Mar
  8. 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model13 Jan
  9. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark24 Oct

Other references · 27

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  3. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
  4. 2024Qwen2-Audio Technical Reportcited by 543
  5. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
  6. 2025Qwen3-Omni Technical Reportcited by 451
  7. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
  8. 2023WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Researchcited by 266
  9. 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 218
  10. 2023Pengi: An Audio Language Model for Audio Taskscited by 217
  11. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
  12. 2026Qwen3.5-Omni Technical Reportcited by 146
15 more
  1. 2024Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimizationcited by 97
  2. 2025SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learningcited by 89
  3. 2025SPICE: Self-Play In Corpus Environments Improves Reasoningcited by 78
  4. 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
  5. 2025MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligencecited by 59
  6. 2025VisPlay: Self-Evolving Vision-Language Models from Imagescited by 42
  7. 2025Vision-Zero: Scalable VLM Self-Improvement via Strategic Gamified Self-Playcited by 37
  8. 2025Game-RL: Synthesizing Multimodal Verifiable Game Data to Boost VLMs' General Reasoningcited by 30
  9. 2025SPELL: Self-Play Reinforcement Learning for Evolving Long-Context Language Modelscited by 27
  10. 2025Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoningcited by 24
  11. 2025Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolutioncited by 24
  12. 2026EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoningcited by 13
  13. 2025Self-Improvement for Audio Large Language Model using Unlabeled Speechcited by 8
  14. 2025From Alignment to Advancement: Bootstrapping Audio-Language Alignment with Synthetic Datacited by 7
  15. 2025AQA-TTRL: Self-Adaptation in Audio Question Answering with Test-Time Reinforcement Learningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026AudioRouter: Data Efficient Audio Understanding via RL based Dual Reasoning
  2. 2025SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models
  3. 2026AuTAgent: A Reinforcement Learning Framework for Tool-Augmented Audio Reasoning
  4. 2026Listen Then Reason: Perception-Grounded Test-Time Reinforcement Learning for Large Audio-Language Models
  5. 2026Echo: Towards Advanced Audio Comprehension via Audio-Interleaved Reasoning
  6. 2026Audio-DeepThinker: Progressive Reasoning-Aware Reinforcement Learning for High-Quality Chain-of-Thought Emergence in Audio Language Models
  7. 2026X3-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment
  8. 2026Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs