mlsanityData to 7 Oct 2026

AuTAgent: A Reinforcement Learning Framework for Tool-Augmented Audio Reasoning

arXiv 2602.13685 ↗First posted 14 Feb 2026cs.SD cs.AIcited by 6

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

Large Audio Language Models (LALMs) excel at perception but struggle with complex reasoning requiring precise acoustic measurements. While external tools can extract fine-grained features like exact tempo or pitch, effective integration remains challenging: naively using all tools causes information overload, while prompt-based selection fails to assess context-dependent utility. To address this, we propose AuTAgent (Audio Tool Agent), a reinforcement learning framework that learns when and which tools to invoke. By employing a sparse-feedback training strategy with a novel Differential Reward mechanism, the agent learns to filter out irrelevant tools and invokes external assistance only when it yields a net performance gain over the base model. Experimental results confirm that AuTAgent complements the representation bottleneck of LALMs by providing verifiable acoustic evidence. It improves accuracy by 4.20% / 6.20% and 9.80% / 8.00% for open-source and closed-source backbones on the MMAU Test-mini and the MMAR benchmarks, respectively. In addition, further experiments demonstrate exceptional transferability. We highlight the complementary role of external tools in augmenting audio model reasoning.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 31 references that are in the map. First posted on arXiv 14 Feb 2026.

Builds on

26 of 31 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Audio-Thinker: Guiding Audio Language Model When and How to Think via Reinforcement Learning11 Aug
  2. 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models10 Jul
  3. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix19 May
  4. 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answering14 Mar
  5. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark24 Oct
  6. 2024GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities17 Jun

Other references · 20

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  5. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  6. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  7. 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
  8. 2021AST: Audio Spectrogram Transformercited by 634
  9. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
  10. 2024Qwen2-Audio Technical Reportcited by 543
  11. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
  12. 2023Making Retrieval-Augmented Language Models Robust to Irrelevant Contextcited by 364
8 more
  1. 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 264
  2. 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 196
  3. 2024Visual Hallucinations of Multi-modal Large Language Modelscited by 68
  4. 2024ChatMusician: Understanding and Generating Music Intrinsically with LLMcited by 67
  5. 2016madmom: a new Python Audio and Music Signal Processing Librarycited by 63
  6. 2025MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligencecited by 59
  7. 2025VisualToolAgent (VisTA): A Reinforcement Learning Framework for Visual Tool Selectioncited by 34
  8. 2025ChartAgent: A Chart Understanding Framework with Tool Integrated Reasoningcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AudioRouter: Data Efficient Audio Understanding via RL based Dual Reasoning
  2. 2025Incentivizing Consistent, Effective and Scalable Reasoning Capability in Audio LLMs via Reasoning Process Rewards
  3. 2026Listen Then Reason: Perception-Grounded Test-Time Reinforcement Learning for Large Audio-Language Models
  4. 2025SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models
  5. 2026Audio-DeepThinker: Progressive Reasoning-Aware Reinforcement Learning for High-Quality Chain-of-Thought Emergence in Audio Language Models
  6. 2025Audio-Maestro: Enhancing Large Audio-Language Models with Tool-Augmented Reasoning
  7. 2025SARI: Structured Audio Reasoning via Curriculum-Guided Reinforcement Learning
  8. 2026Echo: Towards Advanced Audio Comprehension via Audio-Interleaved Reasoning