Omni-CLST: Error-aware Curriculum Learning with guided Selective chain-of-Thought for audio question answering
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
With the rapid progress of large audio-language models (LALMs), audio question answering (AQA) has emerged as a challenging task requiring both fine-grained audio understanding and complex reasoning. While current methods mainly rely on constructing new datasets via captioning or reasoning traces, existing high-quality AQA data remains underutilized. To address this, we propose Omni-CLST, an error-aware Curriculum Learning framework with guided Selective Chain-of-Thought. The framework efficiently leverages existing high-quality dataset through two key strategies: an error-aware curriculum that organizes samples by difficulty, and a guided thought dropout mechanism that focuses reasoning on challenging cases. Experiments show that Omni-CLST achieves 73.80% on MMAU-mini and a new state of the art of 64.30% on MMAR, demonstrating robust generalization in multimodal audio-language understanding.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 14 of its 23 references that are in the map. First posted on arXiv 14 Sep 2025.
Builds on
14 of 23 references.
Closest ancestors · 7
Same direction, newest first
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models10 Jul
- 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix19 May
- 2025SARI: Structured Audio Reasoning via Curriculum-Guided Reinforcement Learning22 Apr
- 2025Qwen2.5-Omni Technical Report26 Mar
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answering14 Mar
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models4 Mar
- 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model13 Jan
Other references · 7
- 2023GPT-4 Technical Reportcited by 18,396
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2-Audio Technical Reportcited by 560
- 2025Kimi-Audio Technical Reportcited by 222
- 2025Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?cited by 46
- 2025AudSemThinker: Enhancing Audio-Language Models through Reasoning over Semantics of Soundcited by 11
- 2025Data-Balanced Curriculum Learning for Audio Question Answeringcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Enhancing Temporal Understanding in Audio Question Answering for Large Audio Language Models
- 2025FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal Reasoning
- 2025Audio Question Answering with GRPO-Based Fine-Tuning and Calibrated Segment-Level Predictions
- 2026Multi-Source Evidence Fusion for Audio Question Answering
- 2026X3-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment
- 2025Audio Flamingo Sound-CoT Technical Report: Improving Chain-of-Thought Reasoning in Sound Understanding
- 2026AudioDER: A Deduplication-Enhanced Reasoning Dataset for Post-Training Large Audio-Language Models
- 2026Echo: Towards Advanced Audio Comprehension via Audio-Interleaved Reasoning