From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion
On the map: Diffusion models → Video generation
Abstract (arXiv)
Diffusion models have achieved dominant performance in visual generation but suffer from substantial inference overhead. While cache-based acceleration has emerged as a promising solution, existing policies rely on local similarity heuristics, which we identify as being significantly misaligned with final generation quality. This discrepancy stems from the non-uniform propagation and accumulation of errors along the denoising trajectory. To address this, we propose Global-Impact Cache (GCache). We first establish a rigorous theoretical characterization of the error propagation upper bound. Recognizing that this bound can be overly conservative for complex, highly non-convex diffusion models, we further reparameterize the propagation exponent with a Bernstein form and reformulate cache policy search as a bilevel optimization problem. In detail, GCache identifies an optimal reuse policy in the inner objective while aligning the error-weighting function with generation quality loss in the outer objective. This framework effectively reconciles theoretical rigor with empirical performance, learning to prioritize computation where it most impacts visual fidelity. Extensive experiments demonstrate that GCache consistently outperforms prior caching strategies on both video and image generation. Notably, on the state-of-the-art Wan2.1 video diffusion model, GCache maintains a 2.17x speedup while significantly enhancing generation quality, reducing LPIPS from 0.1095 to 0.0316.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 33 of its 36 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
33 of 36 references.
Closest ancestors · 6
Same direction, newest first
- 2025Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Models4 Apr
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
- 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality25 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
Other references · 27
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
15 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2025Large Language Diffusion Modelscited by 912
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptionscited by 219
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 175
- 2023PTQD: Accurate Post-Training Quantization for Diffusion Modelscited by 170
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 149
- 2024FORA: Fast-Forward Caching in Diffusion Transformer Accelerationcited by 137
- 2022Diffusion Probabilistic Model Made Slimcited by 121
- 2024LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insightscited by 65
- 2025ERTACache: Error Rectification and Timesteps Adjustment for Efficient Diffusioncited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ACID: Adaptive Caching for vIDeo generation
- 2026MORCA: Offline-to-Online Reinforcement Learning for Adaptive Cache Reuse in Video Diffusion Acceleration
- 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching
- 2026Heuristics are Not Enough: Calibrated and Corrected Caching for Video Diffusion Acceleration
- 2026OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference
- 2025TaoCache: Structure-Maintained Video Generation Acceleration
- 2025AB-Cache: Training-Free Acceleration of Diffusion Models via Adams-Bashforth Cached Feature Reuse
- 2026SeaCache: Spectral-Evolution-Aware Cache for Accelerating Diffusion Models