mlsanityData to 14 Oct 2026

AudioTurbo: Fast Text-to-Audio Generation with Rectified Diffusion

arXiv 2505.22106 ↗First posted 28 May 2025cs.SD cs.AI eess.AScited by 2

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Diffusion models have significantly improved the quality and diversity of audio generation but are hindered by slow inference speed. Rectified flow enhances inference speed by learning straight-line ordinary differential equation (ODE) paths. However, this approach requires training a flow-matching model from scratch and tends to perform suboptimally, or even poorly, at low step counts. To address the limitations of rectified flow while leveraging the advantages of advanced pre-trained diffusion models, this study integrates pre-trained models with the rectified diffusion method to improve the efficiency of text-to-audio (TTA) generation. Specifically, we propose AudioTurbo, which learns first-order ODE paths from deterministic noise sample pairs generated by a pre-trained TTA model. Experiments on the AudioCaps dataset demonstrate that our model, with only 10 sampling steps, outperforms prior models and reduces inference to 3 steps compared to a flow-matching-based acceleration model.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 32 of its 36 references that are in the map. First posted on arXiv 28 May 2025.

Builds on

32 of 36 references.

Closest ancestors · 11

Same direction, newest first

  1. 2024SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer12 Sep
  2. 2024LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation12 Jun
  3. 2024FlashSpeech: Efficient Zero-Shot Speech Synthesis23 Apr
  4. 2024Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generation2 Jan
  5. 2023Matcha-TTS: A fast TTS architecture with conditional flow matching6 Sep
  6. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining10 Aug
  7. 2023Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation29 May
  8. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models30 Jan
  9. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Models29 Jan
  10. 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generation20 Jul
  11. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech13 Jul

Other references · 21

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2022Classifier-Free Diffusion Guidancecited by 5,847
  8. 2022Flow Matching for Generative Modelingcited by 5,702
  9. 2017Neural Discrete Representation Learningcited by 4,712
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  12. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
9 more
  1. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
  2. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
  3. 2023MusicLM: Generating Music From Textcited by 448
  4. 2022AudioGen: Textually Guided Audio Generationcited by 295
  5. 2023UniAudio: An Audio Foundation Model Toward Universal Audio Generationcited by 127
  6. 2024Rectified Diffusion: Straightness Is Not Your Need in Rectified Flowcited by 61
  7. 2024A Survey of Deep Learning Audio Generation Methodscited by 5
  8. 2024Leveraging AI to Generate Audio for User-generated Content in Video Gamescited by 1
  9. 2024Universal Sound Separation with Self-Supervised Audio Masked Autoencodercited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generation
  2. 2026Fast Text-to-Audio Generation with One-Step Sampling via Energy-Scoring and Auxiliary Contextual Representation Distillation ↗
  3. 2025ControlAudio: Tackling Text-Guided, Timing-Indicated and Intelligible Audio Generation via Progressive Diffusion Modeling
  4. 2026SwiftAudio: Data-Efficient Caption-Only Distillation for One-Step Text-to-Audio Diffusion-based Generation
  5. 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation
  6. 2023ReFlow-TTS: A Rectified Flow Model for High-fidelity Text-to-Speech
  7. 2023ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation
  8. 2024LiteFocus: Accelerated Diffusion Inference for Long Audio Synthesis