mlsanityData to 14 Oct 2026

Diffused Responsibility: Analyzing the Energy Consumption of Generative Text-to-Audio Diffusion Models

arXiv 2505.07615 ↗First posted 12 May 2025eess.AS cs.AI cs.LGcited by 2

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Text-to-audio models have recently emerged as a powerful technology for generating sound from textual descriptions. However, their high computational demands raise concerns about energy consumption and environmental impact. In this paper, we conduct an analysis of the energy usage of 7 state-of-the-art text-to-audio diffusion-based generative models, evaluating to what extent variations in generation parameters affect energy consumption at inference time. We also aim to identify an optimal balance between audio quality and energy consumption by considering Pareto-optimal solutions across all selected models. Our findings provide insights into the trade-offs between performance and environmental impact, contributing to the development of more efficient generative audio models.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 21 of its 40 references that are in the map. First posted on arXiv 12 May 2025.

Builds on

21 of 40 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Foundation Models for Music: A Survey26 Aug
  2. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining10 Aug
  3. 2023Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation29 May
  4. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models30 Jan
  5. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Models29 Jan

Other references · 16

  1. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  2. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
  3. 2019Green AIcited by 627
  4. 2019Clotho: An Audio Captioning Datasetcited by 358
  5. 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 225
  6. 2024Stable Audio Opencited by 197
  7. 2020The Computational Limits of Deep Learningcited by 193
  8. 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 191
  9. 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 169
  10. 2019Deep Learning for Audio Signal Processingcited by 92
  11. 2023Adapting Frechet Audio Distance for Generative Music Evaluationcited by 92
  12. 2021Energy Consumption of Deep Generative Audio Modelscited by 12
4 more
  1. 2023Performance and energy balance: a comprehensive study of state-of-the-art sound event detection systemscited by 4
  2. 2024PAGURI: a user experience study of creative interaction with text-to-music modelscited by 4
  3. 2024From Computation to Consumption: Exploring the Compute-Energy Link for Training and Testing Neural Networks for SED Systemscited by 4
  4. 2024Energy Consumption Trends in Sound Event Detection Systemscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimization
  2. 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation
  3. 2026Fast Text-to-Audio Generation with One-Step Sampling via Energy-Scoring and Auxiliary Contextual Representation Distillation ↗
  4. 2026SoundWeaver: Semantic Warm-Starting for Text-to-Audio Diffusion Serving
  5. 2025ControlAudio: Tackling Text-Guided, Timing-Indicated and Intelligible Audio Generation via Progressive Diffusion Modeling
  6. 2026UAT: Unified Audio-Text Diffusion for Audio Generation, Editing, and Captioning
  7. 2023ArchiSound: Audio Generation with Diffusion
  8. 2023ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation