AB-Cache: Training-Free Acceleration of Diffusion Models via Adams-Bashforth Cached Feature Reuse
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models have demonstrated remarkable success in generative tasks, yet their iterative denoising process results in slow inference, limiting their practicality. While existing acceleration methods exploit the well-known U-shaped similarity pattern between adjacent steps through caching mechanisms, they lack theoretical foundation and rely on simplistic computation reuse, often leading to performance degradation. In this work, we provide a theoretical understanding by analyzing the denoising process through the second-order Adams-Bashforth method, revealing a linear relationship between the outputs of consecutive steps. This analysis explains why the outputs of adjacent steps exhibit a U-shaped pattern. Furthermore, extending Adams-Bashforth method to higher order, we propose a novel caching-based acceleration approach for diffusion models, instead of directly reusing cached results, with a truncation error bound of only (O(hk)) where h is the step size. Extensive validation across diverse image and video diffusion models (including HunyuanVideo and FLUX.1-dev) with various schedulers demonstrates our method's effectiveness in achieving nearly 3× speedup while maintaining original performance levels, offering a practical real-time solution without compromising generation quality.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 34 of its 47 references that are in the map. First posted on arXiv 13 Apr 2025.
Builds on
34 of 47 references.
Closest ancestors · 13
Same direction, newest first
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers17 Dec
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
- 2023One-Step Diffusion Distillation via Deep Equilibrium Models12 Dec
- 2023DeepCache: Accelerating Diffusion Models for Free1 Dec
- 2023AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Acceleration19 Sep
- 2022Post-training Quantization on Diffusion Models28 Nov
- 2022On Distillation of Guided Diffusion Models6 Oct
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
1 more
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 21
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
9 more
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
- 2017Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeoncited by 219
- 2020LSQ+: Improving low-bit quantization through learnable offsets and better initializationcited by 180
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2021Group Fisher Pruning for Practical Network Compressioncited by 130
- 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 115
- 2019A Signal Propagation Perspective for Pruning Neural Networks at Initializationcited by 96
- 2025AudioX: A Unified Framework for Anything-to-Audio Generationcited by 25
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generationcited by 14
- 2025SuperGen: An Efficient Ultra-high-resolution Video Generation System with Sketching and Tilingcited by 6
- 2025Sortblock: Similarity-Aware Feature Reuse for Diffusion Modelcited by 3
- 2026TAP: A Token-Adaptive Predictor Framework for Training-Free Diffusion Accelerationcited by 3
- 2026ZEUS: Accelerating Diffusion Models with Only Second-Order Predictorcited by 3
- 2026Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformerscited by 2
- 2026Motion-Aware Caching for Efficient Autoregressive Video Generationcited by 2
- 2025Predictive Feature Caching for Training-free Acceleration of Molecular Geometry Generationcited by 1
- 2026OmniCache: Multidimensional Hierarchical Feature Caching For Diffusion Modelscited by 0
- 2026Magnitude-Direction Decoupling for Fast Video Generation with Flow Matching Modelscited by 0
- 2026RegionCache: Semantic-Aware Region Reuse for Efficient Multi-Turn Image Generationcited by 0
- 2026RegionCache: Semantic-Aware Region Reuse for Efficient Multi-Turn Image Generation30 Aug 2026
- 2026Magnitude-Direction Decoupling for Fast Video Generation with Flow Matching Models18 Aug 2026
- 2026OmniCache: Multidimensional Hierarchical Feature Caching For Diffusion Models26 Jul 2026
- 2026Motion-Aware Caching for Efficient Autoregressive Video Generation3 May 2026
- 2026ZEUS: Accelerating Diffusion Models with Only Second-Order Predictor2 Apr 2026
- 2026TAP: A Token-Adaptive Predictor Framework for Training-Free Diffusion Acceleration4 Mar 2026
- 2026Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformers20 Feb 2026
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generation22 Oct 2025
- 2025Predictive Feature Caching for Training-free Acceleration of Molecular Geometry Generation6 Oct 2025
- 2025SuperGen: An Efficient Ultra-high-resolution Video Generation System with Sketching and Tiling25 Aug 2025
- 2025Sortblock: Similarity-Aware Feature Reuse for Diffusion Model1 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025H2-Cache: A Novel Hierarchical Dual-Stage Cache for High-Performance Acceleration of Generative Diffusion Models
- 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching
- 2025CacheQuant: Comprehensively Accelerated Diffusion Models
- 2026ReCache: Learning Budget-Aware Caching Schedules for Diffusion Models via REINFORCE
- 2026Denoising as Path Planning: Training-Free Acceleration of Diffusion Models with DPCache
- 2023Cache Me if You Can: Accelerating Diffusion Models through Block Caching
- 2025FreqCa: Accelerating Diffusion Models via Frequency-Aware Caching
- 2025No Cache Left Idle: Accelerating diffusion model via Extreme-slimming Caching