mlsanityData to 14 Oct 2026

Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models

arXiv 2507.08128 ↗First posted 10 Jul 2025cs.SD cs.AI cs.CLcited by 219

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

We present Audio Flamingo 3 (AF3), a fully open state-of-the-art (SOTA) large audio-language model that advances reasoning and understanding across speech, sound, and music. AF3 introduces: (i) AF-Whisper, a unified audio encoder trained using a novel strategy for joint representation learning across all 3 modalities of speech, sound, and music; (ii) flexible, on-demand thinking, allowing the model to do chain-of-thought-type reasoning before answering; (iii) multi-turn, multi-audio chat; (iv) long audio understanding and reasoning (including speech) up to 10 minutes; and (v) voice-to-voice interaction. To enable these capabilities, we propose several large-scale training datasets curated using novel strategies, including AudioSkills-XL, LongAudio-XL, AF-Think, and AF-Chat, and train AF3 with a novel five-stage curriculum-based training strategy. Trained on only open-source audio data, AF3 achieves new SOTA results on over 20+ (long) audio understanding and reasoning benchmarks, surpassing both open-weight and closed-source models trained on much larger datasets.

Key facts. Cited by 219 papers in the map (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. First posted on arXiv 10 Jul 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 47; 2026: 172.

219 papers.

Sort:

By area:

  1. 2025Qwen3-Omni Technical Reportcited by 497
  2. 2025Step-Audio 2 Technical Reportcited by 105
  3. 2025MiMo-Audio: Audio Language Models are Few-Shot Learnerscited by 65
  4. 2025OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLMcited by 59
  5. 2025AudioMarathon: A Comprehensive Benchmark for Long-Context Audio Understanding and Efficiency in Audio LLMscited by 22
  6. 2025Audio-Thinker: Guiding Audio Language Model When and How to Think via Reinforcement Learningcited by 19
  7. 2025VoiceAgentBench: Are Voice Assistants ready for agentic tasks?cited by 19
  8. 2025Fun-Audio-Chat Technical Reportcited by 19
  9. 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Musiccited by 19
  10. 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videoscited by 14
  11. 2025Incentivizing Consistent, Effective and Scalable Reasoning Capability in Audio LLMs via Reasoning Process Rewardscited by 12
  12. 2025STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligencecited by 11
38 more
  1. 2025OWL: Geometry-Aware Spatial Reasoning for Audio Large Language Modelscited by 10
  2. 2025UALM: Unified Audio Language Model for Understanding, Generation and Reasoningcited by 10
  3. 2026Audio2Tool: Speak, Call, Act -- A Dataset for Benchmarking Speech Tool Usecited by 9
  4. 2025VocalBench-DF: A Benchmark for Evaluating Speech LLM Robustness to Disfluencycited by 8
  5. 2025SPUR: A Plug-and-Play Framework for Integrating Spatial Audio Understanding and Reasoning into Large Audio-Language Modelscited by 8
  6. 2026Text-only adaptation in LLM-based ASR through text denoisingcited by 8
  7. 2026All That Glitters Is Not Audio: Rethinking Text Priors and Audio Reliance in Audio-Language Evaluationcited by 8
  8. 2025SageLM: A Multi-aspect and Explainable Large Language Model for Speech Judgementcited by 7
  9. 2026Covo-Audio Technical Reportcited by 7
  10. 2026Geometric Alignment without Functional Equivalence: A Layer-wise Analysis of the Speech-Text Modality Gapcited by 7
  11. 2026Raon-Speech Technical Reportcited by 7
  12. 2026Do Audio LLMs Listen or Read? Analyzing and Mitigating Paralinguistic Failures with VoxParadoxcited by 7
  13. 2025MECAT: A Multi-Experts Constructed Benchmark for Fine-Grained Audio Understanding Taskscited by 6
  14. 2025Silence is Golden: Mitigating Hallucinations in Large Audio-Language Models via Layer-Weighted Vector Steeringcited by 6
  15. 2025Towards Audio Token Compression in Large Audio Language Modelscited by 6
  16. 2026AQUA-Bench: Beyond Finding Answers to Knowing When There Are None in Audio Question Answeringcited by 6
  17. 2026LTS-VoiceAgent: A Listen-Think-Speak Framework for Efficient Streaming Voice Interaction via Semantic Triggering and Incremental Reasoningcited by 6
  18. 2026PhaseCoder: Microphone Geometry-Agnostic Spatial Audio Understanding for Multimodal LLMscited by 6
  19. 2026AuTAgent: A Reinforcement Learning Framework for Tool-Augmented Audio Reasoningcited by 6
  20. 2026The Interspeech 2026 Audio Reasoning Challenge: Evaluating Reasoning Process Quality for Audio Reasoning Models and Agentscited by 6
  21. 2026MoD-DPO: Towards Mitigating Cross-modal Hallucinations in Omni LLMs using Modality Decoupled Preference Optimizationcited by 6
  22. 2026How Contrastive Decoding Enhances Large Audio Language Modelscited by 6
  23. 2025Audio Flamingo Sound-CoT Technical Report: Improving Chain-of-Thought Reasoning in Sound Understandingcited by 5
  24. 2025Robustness assessment of large audio language models in multiple-choice evaluationcited by 5
  25. 2025SAKE: Towards Editing Auditory Attribute Knowledge of Large Audio-Language Modelscited by 5
  26. 2025Evaluating Emotion Recognition in Spoken Language Models on Emotionally Incongruent Speechcited by 5
  27. 2025A Benchmark for Omni-Modal Reasoning in Long Videoscited by 5
  28. 2026MoE Adapter for Large Audio Language Models: Sparsity, Disentanglement, and Gradient-Conflict-Freecited by 5
  29. 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognitioncited by 4
  30. 2025When Silence Matters: The Impact of Irrelevant Audio on Text Reasoning in Large Audio-Language Modelscited by 4
  31. 2025The MUSE Benchmark: Probing Music Perception and Auditory Relational Reasoning in Audio LLMScited by 4
  32. 2025M3-SLU: Evaluating Speaker-Attributed Reasoning in Multimodal Large Language Modelscited by 4
  33. 2025Omni-AVSR: Towards Unified Multimodal Speech Recognition with Large Language Modelscited by 4
  34. 2025Revisiting Audio-language Pretraining for Learning General-purpose Audio Representationcited by 4
  35. 2026HyperCLOVA X 8B Omnicited by 4
  36. 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captionscited by 4
  37. 2026AVERE: Improving Audiovisual Emotion Reasoning with Preference Optimizationcited by 4
  38. 2026Towards Robust Speech Deepfake Detection via Human-Inspired Reasoningcited by 4

50 most cited of 219 All 219 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
  2. 2025Music Flamingo: Scaling Music Understanding in Audio Language Models
  3. 2026X3-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment
  4. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
  5. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
  6. 2025Thinking with Sound: Audio Chain-of-Thought Enables Multimodal Reasoning in Large Audio-Language Models
  7. 2024GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
  8. 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Models