mlsanityData to 14 Oct 2026

Music Flamingo: Scaling Music Understanding in Audio Language Models

arXiv 2511.10289 ↗First posted 13 Nov 2025eess.AS cs.CLcited by 21

Not on the map. Why?

Abstract (arXiv)

We introduce Music Flamingo, a novel large audio-language model designed to advance music (including song) understanding in foundational audio models. While audio-language research has progressed rapidly, music remains challenging due to its dynamic, layered, and information-dense nature. Progress has been further limited by the difficulty of scaling open audio understanding models, primarily because of the scarcity of high-quality music data and annotations. As a result, prior models are restricted to producing short, high-level captions, answering only surface-level questions, and showing limited generalization across diverse musical cultures. To address these challenges, we curate MF-Skills, a large-scale dataset labeled through a multi-stage pipeline that yields rich captions and question-answer pairs covering harmony, structure, timbre, lyrics, and cultural context. We fine-tune an enhanced Audio Flamingo 3 backbone on MF-Skills and further strengthen multiple skills relevant to music understanding. To improve the model's reasoning abilities, we introduce a post-training recipe: we first cold-start with MF-Think, a novel chain-of-thought dataset grounded in music theory, followed by GRPO-based reinforcement learning with custom rewards. Music Flamingo achieves state-of-the-art results across 10+ benchmarks for music understanding and reasoning, establishing itself as a generalist and musically intelligent audio-language model. Beyond strong empirical results, Music Flamingo sets a new standard for advanced music understanding by demonstrating how models can move from surface-level recognition toward layered, human-like perception of songs. We believe this work provides both a benchmark and a foundation for the community to build the next generation of models that engage with music as meaningfully as humans do.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Nov 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 21.

21 papers.

Sort:

By area:

  1. 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Musiccited by 19
  2. 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videoscited by 14
  3. 2026AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinkingcited by 5
  4. 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captionscited by 4
  5. 2026AutoCut: End-to-end advertisement video editing based on multimodal discretization and controllable generationcited by 4
  6. 2026Membership Inference Attacks against Large Audio Language Modelscited by 2
  7. 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generationcited by 2
  8. 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videoscited by 2
  9. 2026HumMusQA: A Human-written Music Understanding QA Benchmark Datasetcited by 1
  10. 2026USAD 2.0: Scaling Representation Distillation for Universal Audio Understandingcited by 1
  11. 2026BASS: Benchmarking Audio LMs for Musical Structure and Semantic Reasoningcited by 0
  12. 2026Speech-Worthy Alignment for Japanese SpeechLLMs via Direct Preference Optimizationcited by 0
9 more
  1. 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Modelscited by 0
  2. 2026Auditing Training Data in Generative Music Models via Black-Box Membership Inferencecited by 0
  3. 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generationcited by 0
  4. 2026Beyond Binary Instrument QA: Probing Instrument Grounding in Music Audio-Language Modelscited by 0
  5. 2026Noisy-Channel Minimum Bayes Risk Decodingcited by 0
  6. 2026Uncovering shortcut learning in audio classifiers by discovering recurring concepts in temporal explanationscited by 0
  7. 2026Extending Music Annotation Schemas: Zero-Shot Prediction or Few-Shot Adaptation?cited by 0
  8. 2026MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intentcited by 0
  9. 2026Understanding Machine Taste: Aesthetic Agreement Across Foundation Models in K-popcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024MuChoMusic: Evaluating Music Understanding in Multimodal Audio-Language Models
  2. 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models
  3. 2025Music Audio-Visual Question Answering Requires Specialized Multimodal Designs
  4. 2025Musical Score Understanding Benchmark: Evaluating Large Language Models' Comprehension of Complete Musical Scores
  5. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
  6. 2024OpenMU: Your Swiss Army Knife for Music Understanding
  7. 2025WildScore: Benchmarking MLLMs in-the-Wild Symbolic Music Reasoning
  8. 2026MuSP-Bench: Advanced Multimodal Benchmarking of Music Understanding across Score and Performance ↗