mlsanityData to 14 Oct 2026

Energy Scaling Laws for Diffusion Models: Quantifying Compute in Image Generation

arXiv 2511.17031 ↗First posted 21 Nov 2025cs.LG cs.CV cs.CYcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

The rapidly growing computational demands of diffusion models for image generation have raised significant concerns about energy consumption and environmental impact. While existing approaches to energy optimization focus on architectural improvements or hardware acceleration, there is a lack of principled methods to predict energy consumption across different model configurations and hardware setups. We propose an adaptation of Kaplan scaling laws to predict GPU energy consumption for diffusion models based on computational complexity (FLOPs). Our approach decomposes diffusion model inference into text encoding, iterative denoising, and decoding components, with the hypothesis that denoising operations dominate energy consumption due to their repeated execution across multiple inference steps. We conduct comprehensive experiments across four state-of-the-art diffusion models (Stable Diffusion 2, Stable Diffusion 3.5, Flux, and Qwen) on three GPU architectures (NVIDIA A100, A4000, A6000), spanning various inference configurations including resolution (2562--10242), precision (fp16/fp32), step counts (10--50), and classifier-free guidance settings. Our energy scaling law achieves high predictive accuracy within individual architectures (R2 > 0.9) and exhibits strong cross-architecture generalization, maintaining high rank correlations across models and enabling reliable energy estimation for unseen model--hardware combinations. These results validate the compute-bound nature of diffusion inference and establish energy consumption estimation as a necessary foundation for sustainable AI deployment planning and subsequent carbon footprint assessment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 37 of its 53 references that are in the map. First posted on arXiv 21 Nov 2025.

Builds on

37 of 53 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024Self-Refining Diffusion Samplers: Enabling Parallelization via Parareal Iterations11 Dec
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
  3. 2023One-step Diffusion with Distribution Matching Distillation30 Nov
  4. 2023Parallel Sampling of Diffusion Models25 May
  5. 2022On Distillation of Guided Diffusion Models6 Oct
  6. 2022Classifier-Free Diffusion Guidance26 Jul
  7. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  9. 2020Denoising Diffusion Implicit Models6 Oct
  10. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2020Scaling Laws for Neural Language Modelscited by 6,586
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  8. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  9. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  10. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  11. 2017Mixed Precision Trainingcited by 1,156
  12. 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 265
15 more
  1. 2020Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learningcited by 249
  2. 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 191
  3. 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 169
  4. 2020Data Movement Is All You Need: A Case Study on Optimizing Transformerscited by 108
  5. 2021The Efficiency Misnomercited by 98
  6. 2018NVIDIA Tensor Core Programmability, Performance & Precisioncited by 79
  7. 2025How Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inferencecited by 76
  8. 2018Dissecting the NVIDIA Volta GPU Architecture via Microbenchmarkingcited by 35
  9. 2024Hype, Sustainability, and the Price of the Bigger-is-Better Paradigm in AIcited by 35
  10. 2025Measuring the environmental impact of delivering AI at Google Scalecited by 32
  11. 2025From Efficiency Gains to Rebound Effects: The Problem of Jevons' Paradox in AI's Polarized Environmental Debatecited by 23
  12. 2025Ground-Truthing AI Energy Consumption: Validating CodeCarbon Against External Measurementscited by 8
  13. 2025Video Killed the Energy Budget: Characterizing the Latency and Power Regimes of Open Text-to-Video Modelscited by 3
  14. 2024Latent Pollution Model: The Hidden Carbon Footprint in 3D Image Synthesiscited by 2
  15. 2025The Hidden Cost of an Image: Quantifying the Energy Consumption of AI Image Generationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Performance Plateaus in Inference-Time Scaling for Text-to-Image Diffusion Without External Models
  2. 2026Accelerating Diffusion via Hybrid Data-Pipeline Parallelism Based on Conditional Guidance Scheduling
  3. 2026Performance Analysis and Optimization of 3D Generative Diffusion Models across GPU Architectures
  4. 2024AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising
  5. 2023Speed Is All You Need: On-Device Acceleration of Large Diffusion Models via GPU-Aware Optimizations
  6. 2026FlashDiff: Efficient Regional Execution and Scheduling for Diffusion Model Serving
  7. 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
  8. 2025DiffPro: Joint Timestep and Layer-Wise Precision Optimization for Efficient Diffusion Inference