Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformers
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on feature caching and reuse under the assumption of temporal stability. However, reusing features for multiple steps may lead to latent drift and visual degradation. We observe that model outputs evolve smoothly along much of the diffusion trajectory, enabling principled predictions rather than naive reuse. Based on this insight, we propose PrediT, a training-free acceleration framework that formulates feature prediction as a linear multistep problem. We employ classical linear multistep methods to forecast future model outputs from historical information, combined with a corrector that activates in high-dynamics regions to prevent error accumulation. A dynamic step modulation mechanism adaptively adjusts the prediction horizon by monitoring the feature change rate. Together, these components enable substantial acceleration while preserving generation fidelity. Extensive experiments validate that our method achieves up to 5.54× latency reduction across various DiT-based image and video generation models, while incurring negligible quality degradation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 48 of its 57 references that are in the map. First posted on arXiv 20 Feb 2026.
Builds on
48 of 57 references.
Closest ancestors · 27
Same direction, newest first
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generation22 Oct
- 2025AB-Cache: Training-Free Acceleration of Diffusion Models via Adams-Bashforth Cached Feature Reuse13 Apr
- 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers10 Mar
- 2024SmoothCache: A Universal Inference Acceleration Technique for Diffusion Transformers15 Nov
- 2024FORA: Fast-Forward Caching in Diffusion Transformer Acceleration1 Jul
- 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching3 Jun
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation7 Mar
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
- 2023DeepCache: Accelerating Diffusion Models for Free1 Dec
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
15 more
- 2023Q-Diffusion: Quantizing Diffusion Models8 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Post-training Quantization on Diffusion Models28 Nov
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
- 2022On Distillation of Guided Diffusion Models6 Oct
- 2022Diffusion Models in Vision: A Survey10 Sep
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2016Improved Techniques for Training GANscited by 2,938
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
9 more
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2024Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Modelscited by 41
- 2025Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Modelscited by 14
- 2025Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flowcited by 10
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Forecast then Calibrate: Feature Caching as ODE for Efficient Diffusion Transformers
- 2026LESA: Learnable Stage-Aware Predictors for Diffusion Model Acceleration
- 2026Adaptive Spectral Feature Forecasting for Diffusion Sampling Acceleration
- 2026Beyond Fixed Formulas: Data-Driven Linear Predictor for Efficient Diffusion Models
- 2026BRACE: Taming Sharp Irregularities via Barycentric Rational Forecasting for Fast Diffusion Transformers Inference
- 2025Forecasting When to Forecast: Accelerating Diffusion Models with Confidence-Gated Taylor
- 2025BlockDance: Reuse Structurally Similar Spatio-Temporal Features to Accelerate Diffusion Transformers
- 2026Forecast the Principal, Stabilize the Residual: Subspace-Aware Feature Caching for Efficient Diffusion Transformers