mlsanityData to 14 Oct 2026

ERTACache: Error Rectification and Timesteps Adjustment for Efficient Diffusion

arXiv 2508.21091 ↗First posted 27 Aug 2025cs.CVcited by 12

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion models suffer from substantial computational overhead due to their inherently iterative inference process. While feature caching offers a promising acceleration strategy by reusing intermediate outputs across timesteps, naive reuse often incurs noticeable quality degradation. In this work, we formally analyze the cumulative error introduced by caching and decompose it into two principal components: feature shift error, caused by inaccuracies in cached outputs, and step amplification error, which arises from error propagation under fixed timestep schedules. To address these issues, we propose ERTACache, a principled caching framework that jointly rectifies both error types. Our method employs an offline residual profiling stage to identify reusable steps, dynamically adjusts integration intervals via a trajectory-aware correction coefficient, and analytically approximates cache-induced errors through a closed-form residual linearization model. Together, these components enable accurate and efficient sampling under aggressive cache reuse. Extensive experiments across standard image and video generation benchmarks show that ERTACache achieves up to 2x inference speedup while consistently preserving or even improving visual quality. Notably, on the state-of-the-art Wan2.1 video diffusion model, ERTACache delivers 2x acceleration with minimal VBench degradation, effectively maintaining baseline fidelity while significantly improving efficiency. The code is available at https://github.com/bytedance/ERTACache.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 34 of its 37 references that are in the map. First posted on arXiv 27 Aug 2025.

Builds on

34 of 37 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025Block-wise Adaptive Caching for Accelerating Diffusion Policy16 Jun
  2. 2025FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation26 May
  3. 2025Accelerating Diffusion Transformer via Increment-Calibrated Caching with Channel-Aware Singular Value Decomposition9 May
  4. 2024Rethinking Token-wise Feature Caching: Accelerating Diffusion Transformers with Dual Feature Caching25 Dec
  5. 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers17 Dec
  6. 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models7 Nov
  7. 2024Simple and Fast Distillation of Diffusion Models29 Sep
  8. 2024Token Caching for Diffusion Transformer Acceleration27 Sep
  9. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
  11. 2022Scalable Diffusion Models with Transformers19 Dec
  12. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
4 more
  1. 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  3. 2020Denoising Diffusion Implicit Models6 Oct
  4. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  8. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  9. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  10. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 269
  11. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 122
  12. 2024DiTFastAttn: Attention Compression for Diffusion Transformer Modelscited by 115
6 more
  1. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 108
  2. 2023Mousai: Text-to-Music Generation with Long-Context Latent Diffusioncited by 78
  3. 2024Faster Diffusion via Temporal Attention Decompositioncited by 54
  4. 2023DreamControl: Control-Based Text-to-3D Generation with 3D Self-Priorcited by 39
  5. 2025DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidancecited by 22
  6. 2025Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Modelscited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 11.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Heuristics are Not Enough: Calibrated and Corrected Caching for Video Diffusion Acceleration
  2. 2025No Cache Left Idle: Accelerating diffusion model via Extreme-slimming Caching
  3. 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching
  4. 2026FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inference
  5. 2025AB-Cache: Training-Free Acceleration of Diffusion Models via Adams-Bashforth Cached Feature Reuse
  6. 2026ReCache: Learning Budget-Aware Caching Schedules for Diffusion Models via REINFORCE
  7. 2026OmniCache: Multidimensional Hierarchical Feature Caching For Diffusion Models
  8. 2026BeCARE: Budgeted Cache Refresh for Diffusion Transformer Acceleration