mlsanityData to 14 Oct 2026

A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generation

arXiv 2510.19755 ↗First posted 22 Oct 2025cs.LG cs.AI cs.CVcited by 16

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent textitmulti-step iterations and textitcomplex backbone networks lead to prohibitive computational overhead and generation latency, forming a major bottleneck for real-time applications. Although existing acceleration techniques have made progress, they still face challenges such as limited applicability, high training costs, or quality degradation. Against this backdrop, Diffusion Caching offers a promising training-free, architecture-agnostic, and efficient inference paradigm. Its core mechanism identifies and reuses intrinsic computational redundancies in the diffusion process. By enabling feature-level cross-step reuse and inter-layer scheduling, it reduces computation without modifying model parameters. This paper systematically reviews the theoretical foundations and evolution of Diffusion Caching and proposes a unified framework for its classification and analysis. Through comparative analysis of representative methods, we show that Diffusion Caching evolves from textitstatic reuse to textitdynamic prediction. This trend enhances caching flexibility across diverse tasks and enables integration with other acceleration techniques such as sampling optimization and model distillation, paving the way for a unified, efficient inference framework for future multimodal and interactive applications. We argue that this paradigm will become a key enabler of real-time and efficient generative AI, injecting new vitality into both theory and practice of textitEfficient Generative Intelligence.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 118 of its 124 references that are in the map. First posted on arXiv 22 Oct 2025.

Builds on

118 of 124 references.

Closest ancestors · 52

Same direction, newest first

  1. 2025FreqCa: Accelerating Diffusion Models via Frequency-Aware Caching9 Oct
  2. 2025Let Features Decide Their Own Solvers: Hybrid Feature Caching for Diffusion Transformers5 Oct
  3. 2025DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space29 Sep
  4. 2025RAPID^3: Tri-Level Reinforced Acceleration Policies for Diffusion Transformer26 Sep
  5. 2025SpeCa: Accelerating Diffusion Transformers with Speculative Feature Caching15 Sep
  6. 2025ToMA: Token Merge with Attention for Diffusion Models13 Sep
  7. 2025Compute Only 16 Tokens in One Timestep: Accelerating Diffusion Transformers with Cluster-Driven Feature Caching12 Sep
  8. 2025Spatio-Temporal Parallelism for Diffusion Model Inference on Heterogeneous Multi-GPU Systems5 Sep
  9. 2025ERTACache: Error Rectification and Timesteps Adjustment for Efficient Diffusion27 Aug
  10. 2025DiCache: Let Diffusion Model Determine Its Own Cache24 Aug
  11. 2025HiCache: A Plug-in Scaled-Hermite Upgrade for Taylor-Style Cache-then-Forecast Diffusion Acceleration23 Aug
  12. 2025OmniCache: A Trajectory-Oriented Global Perspective on Training-Free Cache Reuse for Diffusion Transformer Models22 Aug
38 more
  1. 2025Forecast then Calibrate: Feature Caching as ODE for Efficient Diffusion Transformers22 Aug
  2. 2025Chipmunk: Training-Free Acceleration of Diffusion Transformers with Dynamic Column-Sparse Deltas3 Jun
  3. 2025FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation26 May
  4. 2025AB-Cache: Training-Free Acceleration of Diffusion Models via Adams-Bashforth Cached Feature Reuse13 Apr
  5. 2025BlockDance: Reuse Structurally Similar Spatio-Temporal Features to Accelerate Diffusion Transformers20 Mar
  6. 2025FEB-Cache: Frequency-Guided Exposure Bias Reduction for Enhancing Diffusion Transformer Caching10 Mar
  7. 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers10 Mar
  8. 2025QuantCache: Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video Generation9 Mar
  9. 2025S4S: Solving for a Diffusion Model Solver24 Feb
  10. 2024Token Pruning for Caching Better: 9 Times Acceleration on Stable Diffusion for Free31 Dec
  11. 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers17 Dec
  12. 2024Importance-Based Token Merging for Efficient Image and Video Generation23 Nov
  13. 2024Accelerating Diffusion Transformers with Token-wise Feature Caching5 Oct
  14. 2024HarmoniCa: Harmonizing Training and Inference for Better Feature Caching in Diffusion Transformer Acceleration2 Oct
  15. 2024Token Caching for Diffusion Transformer Acceleration27 Sep
  16. 2024FORA: Fast-Forward Caching in Diffusion Transformer Acceleration1 Jul
  17. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
  18. 2024PipeFusion: Patch-level Pipeline Parallelism for Diffusion Transformers Inference23 May
  19. 2024Reward Guided Latent Consistency Distillation16 Mar
  20. 2024Multistep Consistency Models11 Mar
  21. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
  22. 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models29 Feb
  23. 2023Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference15 Dec
  24. 2023Cache Me if You Can: Accelerating Diffusion Models through Block Caching6 Dec
  25. 2023DeepCache: Accelerating Diffusion Models for Free1 Dec
  26. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
  27. 2023Structural Pruning for Diffusion Models18 May
  28. 2023Token Merging for Fast Stable Diffusion30 Mar
  29. 2023Consistency Models2 Mar
  30. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
  31. 2022Scalable Diffusion Models with Transformers19 Dec
  32. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
  33. 2022On Distillation of Guided Diffusion Models6 Oct
  34. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  35. 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
  36. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  37. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  38. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov

50 newest of 52 All 52 (JSON)

Other references · 66

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2022Generative Adversarial Networkscited by 5,627
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2018Neural Ordinary Differential Equationscited by 3,779
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  9. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  10. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  12. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
38 more
  1. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  2. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  3. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
  6. 2025Qwen-Image Technical Reportcited by 1,044
  7. 2025Large Language Diffusion Modelscited by 912
  8. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  9. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  10. 2019Rigging the Lottery: Making All Tickets Winnerscited by 495
  11. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 269
  12. 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 243
  13. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
  14. 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 169
  15. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
  16. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 149
  17. 2025HunyuanImage 3.0 Technical Reportcited by 149
  18. 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 125
  19. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 122
  20. 2024DiTFastAttn: Attention Compression for Diffusion Transformer Modelscited by 115
  21. 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
  22. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 108
  23. 2025VSA: Faster Video Diffusion with Trainable Sparse Attentioncited by 104
  24. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
  25. 2025Controllable Video Generation: A Surveycited by 98
  26. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 88
  27. 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 82
  28. 2024Speculative Diffusion Decoding: Accelerating Language Generation through Diffusioncited by 57
  29. 2024Faster Diffusion via Temporal Attention Decompositioncited by 54
  30. 2024AnimateDiff-Lightning: Cross-Model Diffusion Distillationcited by 47
  31. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  32. 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Cachingcited by 45
  33. 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
  34. 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesiscited by 41
  35. 2025MagCache: Fast Video Generation with Magnitude-Aware Cachecited by 41
  36. 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 39
  37. 2025Training-Free Efficient Video Generation via Dynamic Token Carvingcited by 34
  38. 2025Sparse-vDiT: Unleashing the Power of Sparse Attention to Accelerate Video Diffusion Transformerscited by 34

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 15.

16 papers.

Sort:

By area:

  1. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
  2. 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
  3. 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Accelerationcited by 10
  4. 2026LESA: Learnable Stage-Aware Predictors for Diffusion Model Accelerationcited by 5
  5. 2026Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformerscited by 2
  6. 2026Beyond Fixed Formulas: Data-Driven Linear Predictor for Efficient Diffusion Modelscited by 2
  7. 2026MSEditor: Toward Consistent Multi-Shot Video Editingcited by 1
  8. 2026LinCa: Accelerating Diffusion Models via Learnable Decomposed Feature Cachingcited by 1
  9. 2025On Approaches to Building Surrogate ODE Models for Diffusion Bridgescited by 0
  10. 2026Accelerating Masked Image Generation by Learning Controlled Latent Dynamicscited by 0
  11. 2026Whispers in the Noise: Surrogate-Guided Concept Awakening via a Multi-Agent Frameworkcited by 0
  12. 2026Token-Operations-Oriented Inference Optimization Techniques for Large Modelscited by 0
4 more
  1. 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generationcited by 0
  2. 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transportcited by 0
  3. 2026AViTS: Adaptive Spatiotemporal Token Selection for Efficient Dynamic-Resolution Generationcited by 0
  4. 2026Two Halves are More than One: Phase-wise Velocity Distillation for Fast and High-Quality Image Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference
  2. 2025Evolutionary Caching to Accelerate Your Off-the-Shelf Diffusion Model
  3. 2025No Cache Left Idle: Accelerating diffusion model via Extreme-slimming Caching
  4. 2025CacheQuant: Comprehensively Accelerated Diffusion Models
  5. 2025H2-Cache: A Novel Hierarchical Dual-Stage Cache for High-Performance Acceleration of Generative Diffusion Models
  6. 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching
  7. 2026Budget-Constrained Step-Level Diffusion Caching
  8. 2026OTCache: Optimal Transport for Geometry-Aware Caching in Diffusion Models