AuTAgent: A Reinforcement Learning Framework for Tool-Augmented Audio Reasoning
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
Large Audio Language Models (LALMs) excel at perception but struggle with complex reasoning requiring precise acoustic measurements. While external tools can extract fine-grained features like exact tempo or pitch, effective integration remains challenging: naively using all tools causes information overload, while prompt-based selection fails to assess context-dependent utility. To address this, we propose AuTAgent (Audio Tool Agent), a reinforcement learning framework that learns when and which tools to invoke. By employing a sparse-feedback training strategy with a novel Differential Reward mechanism, the agent learns to filter out irrelevant tools and invokes external assistance only when it yields a net performance gain over the base model. Experimental results confirm that AuTAgent complements the representation bottleneck of LALMs by providing verifiable acoustic evidence. It improves accuracy by 4.20% / 6.20% and 9.80% / 8.00% for open-source and closed-source backbones on the MMAU Test-mini and the MMAR benchmarks, respectively. In addition, further experiments demonstrate exceptional transferability. We highlight the complementary role of external tools in augmenting audio model reasoning.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 31 references that are in the map. First posted on arXiv 14 Feb 2026.
Builds on
26 of 31 references.
Closest ancestors · 6
Same direction, newest first
- 2025Audio-Thinker: Guiding Audio Language Model When and How to Think via Reinforcement Learning11 Aug
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models10 Jul
- 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix19 May
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answering14 Mar
- 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark24 Oct
- 2024GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities17 Jun
Other references · 20
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2021AST: Audio Spectrogram Transformercited by 634
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
- 2024Qwen2-Audio Technical Reportcited by 543
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
- 2023Making Retrieval-Augmented Language Models Robust to Irrelevant Contextcited by 364
8 more
- 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 264
- 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 196
- 2024Visual Hallucinations of Multi-modal Large Language Modelscited by 68
- 2024ChatMusician: Understanding and Generating Music Intrinsically with LLMcited by 67
- 2016madmom: a new Python Audio and Music Signal Processing Librarycited by 63
- 2025MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligencecited by 59
- 2025VisualToolAgent (VisTA): A Reinforcement Learning Framework for Visual Tool Selectioncited by 34
- 2025ChartAgent: A Chart Understanding Framework with Tool Integrated Reasoningcited by 4
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026MRMAD: A Multi-Round Multi-Audio Benchmark for Evaluating Acoustic Degradation Perception in Large Audio-Language Modelscited by 2
- 2026Reinforcement Learning with Evolving Rubrics as Rewards for Audio Reasoningcited by 1
- 2026Hear, Invoke, and Understand: A Skill-Calling Multimodal Agent for Large Audio Language Modelscited by 0
- 2026Why Sample What You Can Enumerate? Exact Policy Optimization for Genomic Tool Selectioncited by 0
- 2026OmniSmartHome: A Multimodal Reasoning Benchmark for Smart-Home Agentscited by 0
- 2026SEAR: Spoofing Evidence-Grounded Audio Reasoning Benchmark for Audio Language Modelscited by 0
- 2026SEAR: Spoofing Evidence-Grounded Audio Reasoning Benchmark for Audio Language Models30 Sep 2026
- 2026OmniSmartHome: A Multimodal Reasoning Benchmark for Smart-Home Agents26 Sep 2026
- 2026Why Sample What You Can Enumerate? Exact Policy Optimization for Genomic Tool Selection9 Sep 2026
- 2026MRMAD: A Multi-Round Multi-Audio Benchmark for Evaluating Acoustic Degradation Perception in Large Audio-Language Models23 Aug 2026
- 2026Reinforcement Learning with Evolving Rubrics as Rewards for Audio Reasoning3 Aug 2026
- 2026Hear, Invoke, and Understand: A Skill-Calling Multimodal Agent for Large Audio Language Models3 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026AudioRouter: Data Efficient Audio Understanding via RL based Dual Reasoning
- 2025Incentivizing Consistent, Effective and Scalable Reasoning Capability in Audio LLMs via Reasoning Process Rewards
- 2026Listen Then Reason: Perception-Grounded Test-Time Reinforcement Learning for Large Audio-Language Models
- 2025SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models
- 2026Audio-DeepThinker: Progressive Reasoning-Aware Reinforcement Learning for High-Quality Chain-of-Thought Emergence in Audio Language Models
- 2025Audio-Maestro: Enhancing Large Audio-Language Models with Tool-Augmented Reasoning
- 2025SARI: Structured Audio Reasoning via Curriculum-Guided Reinforcement Learning
- 2026Echo: Towards Advanced Audio Comprehension via Audio-Interleaved Reasoning