Music Flamingo: Scaling Music Understanding in Audio Language Models
Not on the map. Why?
Abstract (arXiv)
We introduce Music Flamingo, a novel large audio-language model designed to advance music (including song) understanding in foundational audio models. While audio-language research has progressed rapidly, music remains challenging due to its dynamic, layered, and information-dense nature. Progress has been further limited by the difficulty of scaling open audio understanding models, primarily because of the scarcity of high-quality music data and annotations. As a result, prior models are restricted to producing short, high-level captions, answering only surface-level questions, and showing limited generalization across diverse musical cultures. To address these challenges, we curate MF-Skills, a large-scale dataset labeled through a multi-stage pipeline that yields rich captions and question-answer pairs covering harmony, structure, timbre, lyrics, and cultural context. We fine-tune an enhanced Audio Flamingo 3 backbone on MF-Skills and further strengthen multiple skills relevant to music understanding. To improve the model's reasoning abilities, we introduce a post-training recipe: we first cold-start with MF-Think, a novel chain-of-thought dataset grounded in music theory, followed by GRPO-based reinforcement learning with custom rewards. Music Flamingo achieves state-of-the-art results across 10+ benchmarks for music understanding and reasoning, establishing itself as a generalist and musically intelligent audio-language model. Beyond strong empirical results, Music Flamingo sets a new standard for advanced music understanding by demonstrating how models can move from surface-level recognition toward layered, human-like perception of songs. We believe this work provides both a benchmark and a foundation for the community to build the next generation of models that engage with music as meaningfully as humans do.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Nov 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 21.
21 papers.
Sort:
By area:
- 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Musiccited by 19
- 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videoscited by 14
- 2026AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinkingcited by 5
- 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captionscited by 4
- 2026AutoCut: End-to-end advertisement video editing based on multimodal discretization and controllable generationcited by 4
- 2026Membership Inference Attacks against Large Audio Language Modelscited by 2
- 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generationcited by 2
- 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videoscited by 2
- 2026HumMusQA: A Human-written Music Understanding QA Benchmark Datasetcited by 1
- 2026USAD 2.0: Scaling Representation Distillation for Universal Audio Understandingcited by 1
- 2026BASS: Benchmarking Audio LMs for Musical Structure and Semantic Reasoningcited by 0
- 2026Speech-Worthy Alignment for Japanese SpeechLLMs via Direct Preference Optimizationcited by 0
9 more
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Modelscited by 0
- 2026Auditing Training Data in Generative Music Models via Black-Box Membership Inferencecited by 0
- 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generationcited by 0
- 2026Beyond Binary Instrument QA: Probing Instrument Grounding in Music Audio-Language Modelscited by 0
- 2026Noisy-Channel Minimum Bayes Risk Decodingcited by 0
- 2026Uncovering shortcut learning in audio classifiers by discovering recurring concepts in temporal explanationscited by 0
- 2026Extending Music Annotation Schemas: Zero-Shot Prediction or Few-Shot Adaptation?cited by 0
- 2026MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intentcited by 0
- 2026Understanding Machine Taste: Aesthetic Agreement Across Foundation Models in K-popcited by 0
- 2026Understanding Machine Taste: Aesthetic Agreement Across Foundation Models in K-pop13 Oct 2026
- 2026MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intent7 Oct 2026
- 2026Extending Music Annotation Schemas: Zero-Shot Prediction or Few-Shot Adaptation?2 Oct 2026
- 2026Uncovering shortcut learning in audio classifiers by discovering recurring concepts in temporal explanations27 Sep 2026
- 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos17 Jul 2026
- 2026Noisy-Channel Minimum Bayes Risk Decoding6 Jul 2026
- 2026Beyond Binary Instrument QA: Probing Instrument Grounding in Music Audio-Language Models30 Jun 2026
- 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generation5 Jun 2026
- 2026USAD 2.0: Scaling Representation Distillation for Universal Audio Understanding4 Jun 2026
- 2026Auditing Training Data in Generative Music Models via Black-Box Membership Inference28 May 2026
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models6 May 2026
- 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generation19 Apr 2026
9 more
- 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Music13 Apr 2026
- 2026Membership Inference Attacks against Large Audio Language Models30 Mar 2026
- 2026AutoCut: End-to-end advertisement video editing based on multimodal discretization and controllable generation30 Mar 2026
- 2026HumMusQA: A Human-written Music Understanding QA Benchmark Dataset29 Mar 2026
- 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videos14 Mar 2026
- 2026Speech-Worthy Alignment for Japanese SpeechLLMs via Direct Preference Optimization13 Mar 2026
- 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captions5 Feb 2026
- 2026BASS: Benchmarking Audio LMs for Musical Structure and Semantic Reasoning3 Feb 2026
- 2026AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking25 Jan 2026
- 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videoscited by 14
- 2026AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinkingcited by 5
- 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videoscited by 2
- 2026BASS: Benchmarking Audio LMs for Musical Structure and Semantic Reasoningcited by 0
- 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos17 Jul 2026
- 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videos14 Mar 2026
- 2026BASS: Benchmarking Audio LMs for Musical Structure and Semantic Reasoning3 Feb 2026
- 2026AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking25 Jan 2026
- 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Musiccited by 19
- 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captionscited by 4
- 2026AutoCut: End-to-end advertisement video editing based on multimodal discretization and controllable generationcited by 4
- 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generationcited by 2
- 2026HumMusQA: A Human-written Music Understanding QA Benchmark Datasetcited by 1
- 2026USAD 2.0: Scaling Representation Distillation for Universal Audio Understandingcited by 1
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Modelscited by 0
- 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generationcited by 0
- 2026Beyond Binary Instrument QA: Probing Instrument Grounding in Music Audio-Language Modelscited by 0
- 2026Noisy-Channel Minimum Bayes Risk Decodingcited by 0
- 2026Uncovering shortcut learning in audio classifiers by discovering recurring concepts in temporal explanationscited by 0
- 2026Extending Music Annotation Schemas: Zero-Shot Prediction or Few-Shot Adaptation?cited by 0
12 most cited of 14 All 14 (JSON)
- 2026Understanding Machine Taste: Aesthetic Agreement Across Foundation Models in K-pop13 Oct 2026
- 2026MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intent7 Oct 2026
- 2026Extending Music Annotation Schemas: Zero-Shot Prediction or Few-Shot Adaptation?2 Oct 2026
- 2026Uncovering shortcut learning in audio classifiers by discovering recurring concepts in temporal explanations27 Sep 2026
- 2026Noisy-Channel Minimum Bayes Risk Decoding6 Jul 2026
- 2026Beyond Binary Instrument QA: Probing Instrument Grounding in Music Audio-Language Models30 Jun 2026
- 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generation5 Jun 2026
- 2026USAD 2.0: Scaling Representation Distillation for Universal Audio Understanding4 Jun 2026
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models6 May 2026
- 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generation19 Apr 2026
- 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Music13 Apr 2026
- 2026AutoCut: End-to-end advertisement video editing based on multimodal discretization and controllable generation30 Mar 2026
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024MuChoMusic: Evaluating Music Understanding in Multimodal Audio-Language Models
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models
- 2025Music Audio-Visual Question Answering Requires Specialized Multimodal Designs
- 2025Musical Score Understanding Benchmark: Evaluating Large Language Models' Comprehension of Complete Musical Scores
- 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
- 2024OpenMU: Your Swiss Army Knife for Music Understanding
- 2025WildScore: Benchmarking MLLMs in-the-Wild Symbolic Music Reasoning
- 2026MuSP-Bench: Advanced Multimodal Benchmarking of Music Understanding across Score and Performance ↗