mlsanityData to 7 Oct 2026

When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning

arXiv 2603.02266 ↗First posted 28 Feb 2026cs.SD cs.AI eess.AScited by 0

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

Test-Time Scaling has shown notable efficacy in addressing complex problems through scaling inference compute. However, within Large Audio-Language Models (LALMs), an unintuitive phenomenon exists: post-training models for structured reasoning trajectories results in marginal or even negative gains compared to post-training for direct answering. To investigate it, we introduce CAFE, an evaluation framework designed to precisely quantify audio reasoning errors. Evaluation results reveal LALMs struggle with perception during reasoning and encounter a critical bottleneck: reasoning performance suffers from audio perception decay as reasoning length extends. To address it, we propose MPAR2, a paradigm that encourages dynamic perceptual reasoning and decomposes complex questions into perception-rich sub-problems. Leveraging reinforcement learning, MPAR2 improves perception performance on CAFE from 31.74% to 63.51% and effectively mitigates perception decay, concurrently enhancing reasoning capabilities to achieve a significant 74.59% accuracy on the MMAU benchmark. Further analysis demonstrates that MPAR2 reinforces LALMs to attend to audio input and dynamically adapts reasoning budget to match task complexity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 35 references that are in the map. First posted on arXiv 28 Feb 2026.

Builds on

29 of 35 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Step-Audio-R1 Technical Report19 Nov
  2. 2025Incentivizing Consistent, Effective and Scalable Reasoning Capability in Audio LLMs via Reasoning Process Rewards23 Oct
  3. 2025Audio-Thinker: Guiding Audio Language Model When and How to Think via Reinforcement Learning11 Aug
  4. 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models10 Jul
  5. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix19 May
  6. 2025SARI: Structured Audio Reasoning via Curriculum-Guided Reinforcement Learning22 Apr
  7. 2025Qwen2.5-Omni Technical Report26 Mar
  8. 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answering14 Mar
  9. 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models4 Mar
  10. 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model13 Jan
  11. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark24 Oct

Other references · 18

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  7. 2024OpenAI o1 System Cardcited by 1,220
  8. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
  9. 2024Qwen2-Audio Technical Reportcited by 543
  10. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  11. 2025DeepSeek-R1 Thoughtology: Let's think about LLM Reasoningcited by 91
  12. 2025S-GRPO: Early Exit via Reinforcement Learning in Reasoning Modelscited by 87
6 more
  1. 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 62
  2. 2025MiMo-Audio: Audio Language Models are Few-Shot Learnerscited by 58
  3. 2024Efficient Prompting Methods for Large Language Models: A Surveycited by 46
  4. 2025Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?cited by 42
  5. 2025Probing the Difficulty Perception Mechanism of Large Language Modelscited by 8
  6. 2025Less is More Tokens: Efficient Math Reasoning via Difficulty-Aware Chain-of-Thought Distillationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Listen Then Reason: Perception-Grounded Test-Time Reinforcement Learning for Large Audio-Language Models
  2. 2026AudioRouter: Data Efficient Audio Understanding via RL based Dual Reasoning
  3. 2026Echo: Towards Advanced Audio Comprehension via Audio-Interleaved Reasoning
  4. 2026Audio-DeepThinker: Progressive Reasoning-Aware Reinforcement Learning for High-Quality Chain-of-Thought Emergence in Audio Language Models
  5. 2026A Closer Look at Failure Modes in Temporal Understanding of Large Audio-Language Models
  6. 2025SightSound-R1: Cross-Modal Reasoning Distillation from Vision to Audio Language Models
  7. 2025SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models
  8. 2025Audio Flamingo Sound-CoT Technical Report: Improving Chain-of-Thought Reasoning in Sound Understanding