A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generation
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent textitmulti-step iterations and textitcomplex backbone networks lead to prohibitive computational overhead and generation latency, forming a major bottleneck for real-time applications. Although existing acceleration techniques have made progress, they still face challenges such as limited applicability, high training costs, or quality degradation. Against this backdrop, Diffusion Caching offers a promising training-free, architecture-agnostic, and efficient inference paradigm. Its core mechanism identifies and reuses intrinsic computational redundancies in the diffusion process. By enabling feature-level cross-step reuse and inter-layer scheduling, it reduces computation without modifying model parameters. This paper systematically reviews the theoretical foundations and evolution of Diffusion Caching and proposes a unified framework for its classification and analysis. Through comparative analysis of representative methods, we show that Diffusion Caching evolves from textitstatic reuse to textitdynamic prediction. This trend enhances caching flexibility across diverse tasks and enables integration with other acceleration techniques such as sampling optimization and model distillation, paving the way for a unified, efficient inference framework for future multimodal and interactive applications. We argue that this paradigm will become a key enabler of real-time and efficient generative AI, injecting new vitality into both theory and practice of textitEfficient Generative Intelligence.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 118 of its 124 references that are in the map. First posted on arXiv 22 Oct 2025.
Builds on
118 of 124 references.
Closest ancestors · 52
Same direction, newest first
- 2025FreqCa: Accelerating Diffusion Models via Frequency-Aware Caching9 Oct
- 2025Let Features Decide Their Own Solvers: Hybrid Feature Caching for Diffusion Transformers5 Oct
- 2025DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space29 Sep
- 2025RAPID^3: Tri-Level Reinforced Acceleration Policies for Diffusion Transformer26 Sep
- 2025SpeCa: Accelerating Diffusion Transformers with Speculative Feature Caching15 Sep
- 2025ToMA: Token Merge with Attention for Diffusion Models13 Sep
- 2025Compute Only 16 Tokens in One Timestep: Accelerating Diffusion Transformers with Cluster-Driven Feature Caching12 Sep
- 2025Spatio-Temporal Parallelism for Diffusion Model Inference on Heterogeneous Multi-GPU Systems5 Sep
- 2025ERTACache: Error Rectification and Timesteps Adjustment for Efficient Diffusion27 Aug
- 2025DiCache: Let Diffusion Model Determine Its Own Cache24 Aug
- 2025HiCache: A Plug-in Scaled-Hermite Upgrade for Taylor-Style Cache-then-Forecast Diffusion Acceleration23 Aug
- 2025OmniCache: A Trajectory-Oriented Global Perspective on Training-Free Cache Reuse for Diffusion Transformer Models22 Aug
38 more
- 2025Forecast then Calibrate: Feature Caching as ODE for Efficient Diffusion Transformers22 Aug
- 2025Chipmunk: Training-Free Acceleration of Diffusion Transformers with Dynamic Column-Sparse Deltas3 Jun
- 2025FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation26 May
- 2025AB-Cache: Training-Free Acceleration of Diffusion Models via Adams-Bashforth Cached Feature Reuse13 Apr
- 2025BlockDance: Reuse Structurally Similar Spatio-Temporal Features to Accelerate Diffusion Transformers20 Mar
- 2025FEB-Cache: Frequency-Guided Exposure Bias Reduction for Enhancing Diffusion Transformer Caching10 Mar
- 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers10 Mar
- 2025QuantCache: Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video Generation9 Mar
- 2025S4S: Solving for a Diffusion Model Solver24 Feb
- 2024Token Pruning for Caching Better: 9 Times Acceleration on Stable Diffusion for Free31 Dec
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers17 Dec
- 2024Importance-Based Token Merging for Efficient Image and Video Generation23 Nov
- 2024Accelerating Diffusion Transformers with Token-wise Feature Caching5 Oct
- 2024HarmoniCa: Harmonizing Training and Inference for Better Feature Caching in Diffusion Transformer Acceleration2 Oct
- 2024Token Caching for Diffusion Transformer Acceleration27 Sep
- 2024FORA: Fast-Forward Caching in Diffusion Transformer Acceleration1 Jul
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
- 2024PipeFusion: Patch-level Pipeline Parallelism for Diffusion Transformers Inference23 May
- 2024Reward Guided Latent Consistency Distillation16 Mar
- 2024Multistep Consistency Models11 Mar
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models29 Feb
- 2023Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference15 Dec
- 2023Cache Me if You Can: Accelerating Diffusion Models through Block Caching6 Dec
- 2023DeepCache: Accelerating Diffusion Models for Free1 Dec
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
- 2023Structural Pruning for Diffusion Models18 May
- 2023Token Merging for Fast Stable Diffusion30 Mar
- 2023Consistency Models2 Mar
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
- 2022On Distillation of Guided Diffusion Models6 Oct
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
50 newest of 52 All 52 (JSON)
Other references · 66
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
38 more
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025Large Language Diffusion Modelscited by 912
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2019Rigging the Lottery: Making All Tickets Winnerscited by 495
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 269
- 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 243
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 169
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 149
- 2025HunyuanImage 3.0 Technical Reportcited by 149
- 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 125
- 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 122
- 2024DiTFastAttn: Attention Compression for Diffusion Transformer Modelscited by 115
- 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
- 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 108
- 2025VSA: Faster Video Diffusion with Trainable Sparse Attentioncited by 104
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
- 2025Controllable Video Generation: A Surveycited by 98
- 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 88
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 82
- 2024Speculative Diffusion Decoding: Accelerating Language Generation through Diffusioncited by 57
- 2024Faster Diffusion via Temporal Attention Decompositioncited by 54
- 2024AnimateDiff-Lightning: Cross-Model Diffusion Distillationcited by 47
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Cachingcited by 45
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
- 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesiscited by 41
- 2025MagCache: Fast Video Generation with Magnitude-Aware Cachecited by 41
- 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 39
- 2025Training-Free Efficient Video Generation via Dynamic Token Carvingcited by 34
- 2025Sparse-vDiT: Unleashing the Power of Sparse Attention to Accelerate Video Diffusion Transformerscited by 34
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 15.
16 papers.
Sort:
By area:
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Accelerationcited by 10
- 2026LESA: Learnable Stage-Aware Predictors for Diffusion Model Accelerationcited by 5
- 2026Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformerscited by 2
- 2026Beyond Fixed Formulas: Data-Driven Linear Predictor for Efficient Diffusion Modelscited by 2
- 2026MSEditor: Toward Consistent Multi-Shot Video Editingcited by 1
- 2026LinCa: Accelerating Diffusion Models via Learnable Decomposed Feature Cachingcited by 1
- 2025On Approaches to Building Surrogate ODE Models for Diffusion Bridgescited by 0
- 2026Accelerating Masked Image Generation by Learning Controlled Latent Dynamicscited by 0
- 2026Whispers in the Noise: Surrogate-Guided Concept Awakening via a Multi-Agent Frameworkcited by 0
- 2026Token-Operations-Oriented Inference Optimization Techniques for Large Modelscited by 0
4 more
- 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generationcited by 0
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transportcited by 0
- 2026AViTS: Adaptive Spatiotemporal Token Selection for Efficient Dynamic-Resolution Generationcited by 0
- 2026Two Halves are More than One: Phase-wise Velocity Distillation for Fast and High-Quality Image Generationcited by 0
- 2026Two Halves are More than One: Phase-wise Velocity Distillation for Fast and High-Quality Image Generation6 Oct 2026
- 2026AViTS: Adaptive Spatiotemporal Token Selection for Efficient Dynamic-Resolution Generation18 Aug 2026
- 2026LinCa: Accelerating Diffusion Models via Learnable Decomposed Feature Caching18 Aug 2026
- 2026MSEditor: Toward Consistent Multi-Shot Video Editing18 Aug 2026
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transport13 Aug 2026
- 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generation16 Jul 2026
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing25 Jun 2026
- 2026Token-Operations-Oriented Inference Optimization Techniques for Large Models18 Jun 2026
- 2026Whispers in the Noise: Surrogate-Guided Concept Awakening via a Multi-Agent Framework18 May 2026
- 2026Beyond Fixed Formulas: Data-Driven Linear Predictor for Efficient Diffusion Models29 Apr 2026
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr 2026
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Acceleration3 Mar 2026
4 more
- 2026Accelerating Masked Image Generation by Learning Controlled Latent Dynamics27 Feb 2026
- 2026LESA: Learnable Stage-Aware Predictors for Diffusion Model Acceleration24 Feb 2026
- 2026Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformers20 Feb 2026
- 2025On Approaches to Building Surrogate ODE Models for Diffusion Bridges14 Dec 2025
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Accelerationcited by 10
- 2026LESA: Learnable Stage-Aware Predictors for Diffusion Model Accelerationcited by 5
- 2026Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformerscited by 2
- 2026Beyond Fixed Formulas: Data-Driven Linear Predictor for Efficient Diffusion Modelscited by 2
- 2026LinCa: Accelerating Diffusion Models via Learnable Decomposed Feature Cachingcited by 1
- 2026Whispers in the Noise: Surrogate-Guided Concept Awakening via a Multi-Agent Frameworkcited by 0
- 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generationcited by 0
- 2026AViTS: Adaptive Spatiotemporal Token Selection for Efficient Dynamic-Resolution Generationcited by 0
- 2026Two Halves are More than One: Phase-wise Velocity Distillation for Fast and High-Quality Image Generationcited by 0
- 2026Two Halves are More than One: Phase-wise Velocity Distillation for Fast and High-Quality Image Generation6 Oct 2026
- 2026AViTS: Adaptive Spatiotemporal Token Selection for Efficient Dynamic-Resolution Generation18 Aug 2026
- 2026LinCa: Accelerating Diffusion Models via Learnable Decomposed Feature Caching18 Aug 2026
- 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generation16 Jul 2026
- 2026Whispers in the Noise: Surrogate-Guided Concept Awakening via a Multi-Agent Framework18 May 2026
- 2026Beyond Fixed Formulas: Data-Driven Linear Predictor for Efficient Diffusion Models29 Apr 2026
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Acceleration3 Mar 2026
- 2026LESA: Learnable Stage-Aware Predictors for Diffusion Model Acceleration24 Feb 2026
- 2026Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformers20 Feb 2026
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2026MSEditor: Toward Consistent Multi-Shot Video Editingcited by 1
- 2025On Approaches to Building Surrogate ODE Models for Diffusion Bridgescited by 0
- 2026Accelerating Masked Image Generation by Learning Controlled Latent Dynamicscited by 0
- 2026Token-Operations-Oriented Inference Optimization Techniques for Large Modelscited by 0
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transportcited by 0
- 2026MSEditor: Toward Consistent Multi-Shot Video Editing18 Aug 2026
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transport13 Aug 2026
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing25 Jun 2026
- 2026Token-Operations-Oriented Inference Optimization Techniques for Large Models18 Jun 2026
- 2026Accelerating Masked Image Generation by Learning Controlled Latent Dynamics27 Feb 2026
- 2025On Approaches to Building Surrogate ODE Models for Diffusion Bridges14 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference
- 2025Evolutionary Caching to Accelerate Your Off-the-Shelf Diffusion Model
- 2025No Cache Left Idle: Accelerating diffusion model via Extreme-slimming Caching
- 2025CacheQuant: Comprehensively Accelerated Diffusion Models
- 2025H2-Cache: A Novel Hierarchical Dual-Stage Cache for High-Performance Acceleration of Generative Diffusion Models
- 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching
- 2026Budget-Constrained Step-Level Diffusion Caching
- 2026OTCache: Optimal Transport for Geometry-Aware Caching in Diffusion Models