ERTACache: Error Rectification and Timesteps Adjustment for Efficient Diffusion
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models suffer from substantial computational overhead due to their inherently iterative inference process. While feature caching offers a promising acceleration strategy by reusing intermediate outputs across timesteps, naive reuse often incurs noticeable quality degradation. In this work, we formally analyze the cumulative error introduced by caching and decompose it into two principal components: feature shift error, caused by inaccuracies in cached outputs, and step amplification error, which arises from error propagation under fixed timestep schedules. To address these issues, we propose ERTACache, a principled caching framework that jointly rectifies both error types. Our method employs an offline residual profiling stage to identify reusable steps, dynamically adjusts integration intervals via a trajectory-aware correction coefficient, and analytically approximates cache-induced errors through a closed-form residual linearization model. Together, these components enable accurate and efficient sampling under aggressive cache reuse. Extensive experiments across standard image and video generation benchmarks show that ERTACache achieves up to 2x inference speedup while consistently preserving or even improving visual quality. Notably, on the state-of-the-art Wan2.1 video diffusion model, ERTACache delivers 2x acceleration with minimal VBench degradation, effectively maintaining baseline fidelity while significantly improving efficiency. The code is available at https://github.com/bytedance/ERTACache.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 34 of its 37 references that are in the map. First posted on arXiv 27 Aug 2025.
Builds on
34 of 37 references.
Closest ancestors · 16
Same direction, newest first
- 2025Block-wise Adaptive Caching for Accelerating Diffusion Policy16 Jun
- 2025FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation26 May
- 2025Accelerating Diffusion Transformer via Increment-Calibrated Caching with Channel-Aware Singular Value Decomposition9 May
- 2024Rethinking Token-wise Feature Caching: Accelerating Diffusion Transformers with Dual Feature Caching25 Dec
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers17 Dec
- 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models7 Nov
- 2024Simple and Fast Distillation of Diffusion Models29 Sep
- 2024Token Caching for Diffusion Transformer Acceleration27 Sep
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
4 more
Other references · 18
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 269
- 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 122
- 2024DiTFastAttn: Attention Compression for Diffusion Transformer Modelscited by 115
6 more
- 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 108
- 2023Mousai: Text-to-Music Generation with Long-Context Latent Diffusioncited by 78
- 2024Faster Diffusion via Temporal Attention Decompositioncited by 54
- 2023DreamControl: Control-Based Text-to-3D Generation with 3D Self-Priorcited by 39
- 2025DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidancecited by 22
- 2025Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Modelscited by 15
Built on by
Citing papers per year: 2025: 1; 2026: 11.
12 papers.
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generationcited by 16
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 7
- 2026Motion-Aware Caching for Efficient Autoregressive Video Generationcited by 6
- 2026Budget-Constrained Step-Level Diffusion Cachingcited by 3
- 2026S2O: Early Stopping for Sparse Attention via Online Permutationcited by 1
- 2026OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inferencecited by 1
- 2026BAG: Budget-Aware Gating for Diffusion Cachingcited by 1
- 2026From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusioncited by 0
- 2026Accelerating Unified Multimodal Models with Core-Expansion Routing and Unified Computation Schedulingcited by 0
- 2026SelfLift: Accelerating Few-Step Diffusion via Self-Recovering Resolution Transitioncited by 0
- 2026RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidancecited by 0
- 2026Frequency-Step Cache: Separating Synchronization and Repair for Efficient Autoregressive Video Diffusioncited by 0
- 2026Frequency-Step Cache: Separating Synchronization and Repair for Efficient Autoregressive Video Diffusion11 Oct 2026
- 2026RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidance29 Sep 2026
- 2026SelfLift: Accelerating Few-Step Diffusion via Self-Recovering Resolution Transition2 Sep 2026
- 2026Accelerating Unified Multimodal Models with Core-Expansion Routing and Unified Computation Scheduling29 Aug 2026
- 2026From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion13 Aug 2026
- 2026BAG: Budget-Aware Gating for Diffusion Caching10 Aug 2026
- 2026OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference31 Jul 2026
- 2026Budget-Constrained Step-Level Diffusion Caching11 Jun 2026
- 2026Motion-Aware Caching for Efficient Autoregressive Video Generation3 May 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026S2O: Early Stopping for Sparse Attention via Online Permutation26 Feb 2026
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generation22 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Heuristics are Not Enough: Calibrated and Corrected Caching for Video Diffusion Acceleration
- 2025No Cache Left Idle: Accelerating diffusion model via Extreme-slimming Caching
- 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching
- 2026FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inference
- 2025AB-Cache: Training-Free Acceleration of Diffusion Models via Adams-Bashforth Cached Feature Reuse
- 2026ReCache: Learning Budget-Aware Caching Schedules for Diffusion Models via REINFORCE
- 2026OmniCache: Multidimensional Hierarchical Feature Caching For Diffusion Models
- 2026BeCARE: Budgeted Cache Refresh for Diffusion Transformer Acceleration