MagCache: Fast Video Generation with Magnitude-Aware Cache
On the map: Diffusion models → Video generation
Abstract (arXiv)
Existing acceleration techniques for video diffusion models often rely on uniform heuristics or time-embedding variants to skip timesteps and reuse cached features. These approaches typically require extensive calibration with curated prompts and risk inconsistent outputs due to prompt-specific overfitting. In this paper, we introduce a novel and robust discovery: a unified magnitude law observed across different models and prompts. Specifically, the magnitude ratio of successive residual outputs decreases monotonically, steadily in most timesteps while rapidly in the last several steps. Leveraging this insight, we introduce a Magnitude-aware Cache (MagCache) that adaptively skips unimportant timesteps using an error modeling mechanism and adaptive caching strategy. Unlike existing methods requiring dozens of curated samples for calibration, MagCache only requires a single sample for calibration. Experimental results show that MagCache achieves 2.10x-2.68x speedups on Open-Sora, CogVideoX, Wan 2.1, and HunyuanVideo, while preserving superior visual fidelity. It significantly outperforms existing methods in LPIPS, SSIM, and PSNR, under similar computational budgets.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 66 of its 81 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
66 of 81 references.
Closest ancestors · 14
Same direction, newest first
- 2025Training-free and Adaptive Sparse Attention for Efficient Long Video Generation28 Feb
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
- 2024VideoMaker: Zero-shot Customized Video Generation with the Inherent Force of Video Diffusion Models27 Dec
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
- 2024Adaptive Caching for Faster Video Generation with Diffusion Transformers4 Nov
- 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality25 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
- 2023VideoLCM: Video Latent Consistency Model14 Dec
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
2 more
- 2023ModelScope Text-to-Video Technical Report12 Aug
- 2022Video Diffusion Models7 Apr
Other references · 52
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
38 more
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2023Consistency Modelscited by 1,778
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2023Adversarial Diffusion Distillationcited by 741
- 2022On Distillation of Guided Diffusion Modelscited by 721
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2022Post-training Quantization on Diffusion Modelscited by 262
- 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
- 2023Token Merging for Fast Stable Diffusioncited by 220
- 2021Gotta Go Fast When Generating Data with Score-Based Modelscited by 218
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 169
- 2023PTQD: Accurate Post-Training Quantization for Diffusion Modelscited by 167
- 2023Cache Me if You Can: Accelerating Diffusion Models through Block Cachingcited by 149
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Cachingcited by 138
- 2024FORA: Fast-Forward Caching in Diffusion Transformer Accelerationcited by 127
- 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeerscited by 124
- 2023Parallel Sampling of Diffusion Modelscited by 112
- 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformerscited by 91
- 2023Temporal Dynamic Quantization for Diffusion Modelscited by 81
- 2023Language Model Self-improvement by Reinforcement Learning Contemplationcited by 75
- 2023AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Accelerationcited by 70
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 58
- 2017DeepCache: Principled Cache for Mobile Deep Visioncited by 57
- 2024LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Modelscited by 52
- 2023Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMscited by 47
- 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 42
- 2024Attention-Driven Training-Free Efficiency Enhancement of Diffusion Modelscited by 37
- 2024ShortcutsBench: A Large-Scale Real-world Benchmark for API-based Agentscited by 36
- 2024Rethinking Token-wise Feature Caching: Accelerating Diffusion Transformers with Dual Feature Cachingcited by 26
- 2023Denoising Diffusion Step-aware Modelscited by 24
- 2023FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Modelscited by 19
- 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Modelcited by 17
- 2024SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Modelcited by 13
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 9; 2026: 27.
36 papers.
Sort:
By area:
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generationcited by 55
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generationcited by 14
- 2026SeaCache: Spectral-Evolution-Aware Cache for Accelerating Diffusion Modelscited by 10
- 2026SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routingcited by 9
- 2025TaoCache: Structure-Maintained Video Generation Accelerationcited by 8
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Accelerationcited by 8
- 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Cachingcited by 6
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 6
- 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decouplingcited by 4
- 2026DisCa: Accelerating Video Diffusion Transformers with Distillation-Compatible Learnable Feature Cachingcited by 4
- 2025Adaptive Hybrid Caching for Efficient Text-to-Video Diffusion Model Accelerationcited by 2
24 more
- 2026CHAI: CacHe Attention Inference for text2videocited by 2
- 2026Jano: Adaptive Diffusion Generation with Early-stage Convergence Awarenesscited by 2
- 2026Accelerating Rectified Flow Models via Trajectory-Aware Cachingcited by 2
- 2026Budget-Constrained Step-Level Diffusion Cachingcited by 2
- 2026NaviCache: Test-Time Self-Calibration Caching for Video Generationcited by 2
- 2025Predictive Feature Caching for Training-free Acceleration of Molecular Geometry Generationcited by 1
- 2025Phase-Aligned RoPE for Mixed-Resolution Diffusion Transformercited by 1
- 2026FIS-DiT: Breaking the Few-Step Video Inference Barrier via Training-Free Frame Interleaved Sparsitycited by 1
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolutioncited by 1
- 2026Chorus II: Cross-Request Sparsity Reuse for Efficient Image-to-Video Generationcited by 1
- 2026BAG: Budget-Aware Gating for Diffusion Cachingcited by 1
- 2026EpaCache: Error-Propagation-Aware Caching for Accelerating Diffusion-Based Visual Generationcited by 1
- 2025ETC: training-free diffusion models acceleration with Error-aware Trend Consistencycited by 0
- 2025InvarDiff: Cross-Scale Invariance Caching for Accelerated Diffusion Modelscited by 0
- 2026LayerCache: Exploiting Layer-wise Velocity Heterogeneity for Efficient Flow Matching Inferencecited by 0
- 2026Not All Tokens Need 40 Steps: Heterogeneous Step Allocation in Diffusion Transformers for Efficient Video Generationcited by 0
- 2026AtlasVid: Efficient Ultra-High-Resolution Long Video Generation via Decoupled Global-Local Modelingcited by 0
- 2026SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animationcited by 0
- 2026FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inferencecited by 0
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transportcited by 0
- 2026Magnitude-Direction Decoupling for Fast Video Generation with Flow Matching Modelscited by 0
- 2026GeoShrink: Accelerating Diffusion Transformers with Two Lines of Codecited by 0
- 2026CAST: Reconstruction-Coupled Acceleration of Interactive World Modelscited by 0
- 2026RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidancecited by 0
- 2026RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidance29 Sep 2026
- 2026CAST: Reconstruction-Coupled Acceleration of Interactive World Models28 Sep 2026
- 2026GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code27 Sep 2026
- 2026EpaCache: Error-Propagation-Aware Caching for Accelerating Diffusion-Based Visual Generation29 Aug 2026
- 2026Magnitude-Direction Decoupling for Fast Video Generation with Flow Matching Models18 Aug 2026
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transport13 Aug 2026
- 2026BAG: Budget-Aware Gating for Diffusion Caching10 Aug 2026
- 2026FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inference30 Jul 2026
- 2026SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animation29 Jun 2026
- 2026NaviCache: Test-Time Self-Calibration Caching for Video Generation25 Jun 2026
- 2026Chorus II: Cross-Request Sparsity Reuse for Efficient Image-to-Video Generation23 Jun 2026
- 2026Budget-Constrained Step-Level Diffusion Caching11 Jun 2026
24 more
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolution25 May 2026
- 2026Accelerating Rectified Flow Models via Trajectory-Aware Caching16 May 2026
- 2026AtlasVid: Efficient Ultra-High-Resolution Long Video Generation via Decoupled Global-Local Modeling15 May 2026
- 2026FIS-DiT: Breaking the Few-Step Video Inference Barrier via Training-Free Frame Interleaved Sparsity12 May 2026
- 2026Not All Tokens Need 40 Steps: Heterogeneous Step Allocation in Diffusion Transformers for Efficient Video Generation7 May 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026LayerCache: Exploiting Layer-wise Velocity Heterogeneity for Efficient Flow Matching Inference13 Apr 2026
- 2026SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routing9 Mar 2026
- 2026Helios: Real Real-Time Long Video Generation Model4 Mar 2026
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Acceleration3 Mar 2026
- 2026Jano: Adaptive Diffusion Generation with Early-stage Convergence Awareness28 Feb 2026
- 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching27 Feb 2026
- 2026SeaCache: Spectral-Evolution-Aware Cache for Accelerating Diffusion Models22 Feb 2026
- 2026CHAI: CacHe Attention Inference for text2video18 Feb 2026
- 2026DisCa: Accelerating Video Diffusion Transformers with Distillation-Compatible Learnable Feature Caching5 Feb 2026
- 2025InvarDiff: Cross-Scale Invariance Caching for Accelerated Diffusion Models29 Nov 2025
- 2025Phase-Aligned RoPE for Mixed-Resolution Diffusion Transformer24 Nov 2025
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation24 Nov 2025
- 2025ETC: training-free diffusion models acceleration with Error-aware Trend Consistency28 Oct 2025
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generation22 Oct 2025
- 2025Predictive Feature Caching for Training-free Acceleration of Molecular Geometry Generation6 Oct 2025
- 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decoupling24 Aug 2025
- 2025Adaptive Hybrid Caching for Efficient Text-to-Video Diffusion Model Acceleration18 Aug 2025
- 2025TaoCache: Structure-Maintained Video Generation Acceleration12 Aug 2025
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generationcited by 55
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generationcited by 14
- 2026SeaCache: Spectral-Evolution-Aware Cache for Accelerating Diffusion Modelscited by 10
- 2026SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routingcited by 9
- 2025TaoCache: Structure-Maintained Video Generation Accelerationcited by 8
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Accelerationcited by 8
- 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Cachingcited by 6
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 6
- 2026DisCa: Accelerating Video Diffusion Transformers with Distillation-Compatible Learnable Feature Cachingcited by 4
- 2025Adaptive Hybrid Caching for Efficient Text-to-Video Diffusion Model Accelerationcited by 2
- 2026CHAI: CacHe Attention Inference for text2videocited by 2
- 2026Jano: Adaptive Diffusion Generation with Early-stage Convergence Awarenesscited by 2
12 most cited of 30 All 30 (JSON)
- 2026RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidance29 Sep 2026
- 2026GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code27 Sep 2026
- 2026Magnitude-Direction Decoupling for Fast Video Generation with Flow Matching Models18 Aug 2026
- 2026BAG: Budget-Aware Gating for Diffusion Caching10 Aug 2026
- 2026FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inference30 Jul 2026
- 2026SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animation29 Jun 2026
- 2026NaviCache: Test-Time Self-Calibration Caching for Video Generation25 Jun 2026
- 2026Chorus II: Cross-Request Sparsity Reuse for Efficient Image-to-Video Generation23 Jun 2026
- 2026Budget-Constrained Step-Level Diffusion Caching11 Jun 2026
- 2026Accelerating Rectified Flow Models via Trajectory-Aware Caching16 May 2026
- 2026AtlasVid: Efficient Ultra-High-Resolution Long Video Generation via Decoupled Global-Local Modeling15 May 2026
- 2026FIS-DiT: Breaking the Few-Step Video Inference Barrier via Training-Free Frame Interleaved Sparsity12 May 2026
12 newest of 30 All 30 (JSON)
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decouplingcited by 4
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolutioncited by 1
- 2026EpaCache: Error-Propagation-Aware Caching for Accelerating Diffusion-Based Visual Generationcited by 1
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transportcited by 0
- 2026EpaCache: Error-Propagation-Aware Caching for Accelerating Diffusion-Based Visual Generation29 Aug 2026
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transport13 Aug 2026
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolution25 May 2026
- 2026Helios: Real Real-Time Long Video Generation Model4 Mar 2026
- 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decoupling24 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching
- 2026ACID: Adaptive Caching for vIDeo generation
- 2026From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion
- 2024FlexCache: Flexible Approximate Cache System for Video Diffusion
- 2025BWCache: Accelerating Video Diffusion Transformers through Block-Wise Caching
- 2025LightCache: Memory-Efficient, Training-Free Acceleration for Video Generation
- 2026Past- and Future-Informed KV Cache Policy with Salience Estimation in Autoregressive Video Diffusion
- 2026MORCA: Offline-to-Online Reinforcement Learning for Adaptive Cache Reuse in Video Diffusion Acceleration