mlsanityData to 7 Oct 2026

Stable Audio Open

arXiv 2407.14358 ↗First posted 19 Jul 2024cs.SD cs.AI eess.AScited by 192

Not on the map. Why?

Cited by 68 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Open generative models are vitally important for the community, allowing for fine-tunes and serving as baselines when presenting new models. However, most current text-to-audio models are private and not accessible for artists and researchers to build upon. Here we describe the architecture and training process of a new open-weights text-to-audio model trained with Creative Commons data. Our evaluation shows that the model's performance is competitive with the state-of-the-art across various metrics. Notably, the reported FDopenl3 results (measuring the realism of the generations) showcase its potential for high-quality stereo sound synthesis at 44.1kHz.

Key facts. Cited by 192 papers in the map (data through 7 Oct 2026). Builds on 27 of its 34 references that are in the map. First posted on arXiv 19 Jul 2024.

Builds on

27 of 34 references.

References · 27

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  7. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  8. 2016Training Deep Nets with Sublinear Memory Costcited by 825
  9. 2023Extracting Training Data from Diffusion Modelscited by 723
  10. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
  11. 2022High Fidelity Neural Audio Compressioncited by 673
  12. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
15 more
  1. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
  2. 2020Jukebox: A Generative Model for Musiccited by 535
  3. 2023Simple and Controllable Music Generationcited by 480
  4. 2023MusicLM: Generating Music From Textcited by 442
  5. 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
  6. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
  7. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
  8. 2022AudioGen: Textually Guided Audio Generationcited by 292
  9. 2021Efficient Training of Audio Transformers with Patchoutcited by 222
  10. 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 221
  11. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
  12. 2020Neural Networks Fail to Learn Periodic Functions and How to Fix Itcited by 97
  13. 2024Long-form music generation with latent diffusioncited by 88
  14. 2023The Song Describer Dataset: a Corpus of Audio Captions for Music-and-Language Evaluationcited by 68
  15. 2023Controllable Music Production with Diffusion Models and Guidance Gradientscited by 29

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 23; 2025: 79; 2026: 90.

192 papers.

Sort:

By area:

  1. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
  2. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 281
  3. 2025UniVerse-1: Unified Audio-Video Generation via Stitching of Expertscited by 58
  4. 2024Video-Guided Foley Sound Generation with Multimodal Controlscited by 49
  5. 2025Motion Anything: Any to Motion Generationcited by 40
  6. 2026MOVA: Towards Scalable and Synchronized Video-Audio Generationcited by 39
  7. 2024Align Anything: Training All-Modality Models to Follow Instructions with Language Feedbackcited by 38
  8. 2024Diff-Instruct++: Training One-step Text-to-image Generator Model to Align with Human Preferencescited by 30
  9. 2025SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song Generationcited by 29
  10. 2024Flow Generator Matchingcited by 26
  11. 2024Both Ears Wide Open: Towards Language-Driven Spatial Audio Generationcited by 25
  12. 2025AudioX: A Unified Framework for Anything-to-Audio Generationcited by 25
38 more
  1. 2026Self-Supervised Flow Matching for Scalable Multi-Modal Synthesiscited by 25
  2. 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generationcited by 24
  3. 2025SongBloom: Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinementcited by 21
  4. 2025FreeAudio: Training-Free Timing Planning for Controllable Long-Form Text-to-Audio Generationcited by 21
  5. 2024SmoothCache: A Universal Inference Acceleration Technique for Diffusion Transformerscited by 19
  6. 2024FLUX that Plays Musiccited by 18
  7. 2024ETTA: Elucidating the Design Space of Text-to-Audio Modelscited by 17
  8. 2025Fast Text-to-Audio Generation with Adversarial Post-Trainingcited by 14
  9. 2025DiffRhythm 2: Efficient and High Fidelity Song Generation via Block Flow Matchingcited by 14
  10. 2024LoVA: Long-form Video-to-Audio Generationcited by 13
  11. 2024Editing Music with Melody and Text: Using ControlNet for Diffusion Transformercited by 13
  12. 2025Audio Super-Resolution with Latent Bridge Modelscited by 13
  13. 2025Object-AVEdit: An Object-level Audio-Visual Editing Modelcited by 12
  14. 2024Improving Musical Accompaniment Co-creation via Diffusion Transformerscited by 11
  15. 2024Video Diffusion Transformers are In-Context Learnerscited by 11
  16. 2025Guiding Audio Editing with Audio Language Modelcited by 11
  17. 2025Survey on the Evaluation of Generative Models in Musiccited by 10
  18. 2025UALM: Unified Audio Language Model for Understanding, Generation and Reasoningcited by 10
  19. 2025SoloSpeech: Enhancing Intelligibility and Quality in Target Speech Extraction through a Cascaded Generative Pipelinecited by 9
  20. 2025MuseControlLite: Multifunctional Music Generation with Lightweight Conditionerscited by 9
  21. 2025Live Music Modelscited by 9
  22. 2025Taming Text-to-Sounding Video Generation via Advanced Modality Condition and Interactioncited by 9
  23. 2025Music Arena: Live Evaluation for Text-to-Musiccited by 8
  24. 2026Omni2Sound: Towards Unified Video-Text-to-Audio Generationcited by 8
  25. 2026Apollo: Unified Multi-Task Audio-Video Joint Generationcited by 8
  26. 2024Synthio: Augmenting Small-Scale Audio Classification Datasets with Synthetic Datacited by 7
  27. 2024Tri-Ergon: Fine-grained Video-to-Audio Generation with Multi-modal Conditions and LUFS Controlcited by 7
  28. 2025MusGO: A Community-Driven Framework For Assessing Openness in Music-Generative AIcited by 7
  29. 2025LayerSync: Self-aligning Intermediate Layerscited by 7
  30. 2025AutoMV: An Automatic Multi-Agent System for Music Video Generationcited by 7
  31. 2024MixEval-X: Any-to-Any Evaluations from Real-World Data Mixturescited by 6
  32. 2024Challenge on Sound Scene Synthesis: Evaluating Text-to-Audio Generationcited by 6
  33. 2024Multimodal Music Generation with Explicit Bridges and Retrieval Augmentationcited by 6
  34. 2025RFLAV: Rolling Flow matching for infinite Audio Video generationcited by 6
  35. 2025DiTSE: High-Fidelity Generative Speech Enhancement via Latent Diffusion Transformerscited by 6
  36. 2025FoleyBench: A Benchmark For Video-to-Audio Modelscited by 6
  37. 2026MuQ-Eval: An Open-Source Per-Sample Quality Metric for AI Music Generation Evaluationcited by 6
  38. 2024FolAI: Synchronized Foley Sound Generation with Semantic and Temporal Alignmentcited by 5

50 most cited of 192 All 192 (JSON)