AdaCorrection: Adaptive Offset Cache Correction for Accurate Diffusion Transformers
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion Transformers (DiTs) achieve state-of-the-art performance in high-fidelity image and video generation but suffer from expensive inference due to their iterative denoising structure. While prior methods accelerate sampling by caching intermediate features, they rely on static reuse schedules or coarse-grained heuristics, which often lead to temporal drift and cache misalignment that significantly degrade generation quality. We introduce AdaCorrection, an adaptive offset cache correction framework that maintains high generation fidelity while enabling efficient cache reuse across Transformer layers during diffusion inference. At each timestep, AdaCorrection estimates cache validity with lightweight spatio-temporal signals and adaptively blends cached and fresh activations. This correction is computed on-the-fly without additional supervision or retraining. Our approach achieves strong generation quality with minimal computational overhead, maintaining near-original FID while providing moderate acceleration. Experiments on image and video diffusion benchmarks show that AdaCorrection consistently improves generation performance. Our code has been integrated into FastCache-xDiT at https://github.com/NoakLiu/FastCache-xDiT.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 27 of its 32 references that are in the map. First posted on arXiv 13 Feb 2026.
Builds on
27 of 32 references.
Closest ancestors · 18
Same direction, newest first
- 2025FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation26 May
- 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers10 Mar
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers17 Dec
- 2024Accelerating Diffusion Transformers with Token-wise Feature Caching5 Oct
- 2024FORA: Fast-Forward Caching in Diffusion Transformer Acceleration1 Jul
- 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching3 Jun
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
- 2023Clockwork Diffusion: Efficient Generation With Model-Step Distillation13 Dec
- 2023Cache Me if You Can: Accelerating Diffusion Models through Block Caching6 Dec
- 2023DeepCache: Accelerating Diffusion Models for Free1 Dec
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
- 2023Token Merging for Fast Stable Diffusion30 Mar
6 more
- 2023Consistency Models2 Mar
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Post-training Quantization on Diffusion Models28 Nov
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 9
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
- 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 100
- 2025TinyServe: Query-Aware Cache Selection for Efficient LLM Servingcited by 9
- 2025CXL-SpecKV: A Disaggregated FPGA Speculative KV-Cache for Datacenter LLM Servingcited by 8
- 2025CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inferencecited by 7
- 2025HSGM: Hierarchical Segment-Graph Memory for Scalable Long-Text Semanticscited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025OmniCache: A Trajectory-Oriented Global Perspective on Training-Free Cache Reuse for Diffusion Transformer Models
- 2026BeCARE: Budgeted Cache Refresh for Diffusion Transformer Acceleration
- 2026Frequency-Aware Error-Bounded Caching for Accelerating Diffusion Transformers
- 2025Accelerating Diffusion Transformer via Increment-Calibrated Caching with Channel-Aware Singular Value Decomposition
- 2025Accelerating Diffusion Transformer via Gradient-Optimized Cache
- 2025CorGi: Contribution-Guided Block-Wise Interval Caching for Training-Free Acceleration of Diffusion Transformers
- 2024HarmoniCa: Harmonizing Training and Inference for Better Feature Caching in Diffusion Transformer Acceleration
- 2025Q&C: When Quantization Meets Cache in Efficient Image Generation