MobileWan: Closing the Quality Gap for Mobile Video Diffusion
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent advances in video diffusion have been driven by scaling transformer-based architectures to billions of parameters, substantially improving visual fidelity and motion coherence. In contrast, existing mobile video diffusion models remain limited to relatively small parameter budgets, typically 0.4-1.8B, restricting generation quality. In this work, we show that high-quality mobile video generation does not require small models. Instead, we demonstrate that a server-scale 5B-parameter video diffusion transformer can be deployed efficiently on memory-constrained mobile hardware through recurrent reformulation and structured compression. Starting from Wan2.2-5B, we rely on a recurrence distillation framework that converts video generation into a chunk-wise autoregressive process with constant-memory attention computation. Combined with causal linear attention, the model operates as an RNN at inference time while preserving temporal coherence across chunks. We further propose a learnable attention head pruning method based on binary per-head gates optimized end-to-end using a noise-biased sparsity objective and distillation-based finetuning. Together with sampling-step distillation and memory-optimized VAE decoding, MobileWan becomes the first 5B-scale video diffusion model deployable on a commercial mobile device. Our system generates 5-second 480x832 videos at 16 FPS in 20 seconds end-to-end latency, achieving a VBench score of 83.79 and establishing a new state of the art in mobile video generation. Please find the released DiT checkpoint and the sampling code in the project page: https://qualcomm-ai-research.github.io/MobileWan
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 70 of its 82 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
70 of 82 references.
Closest ancestors · 25
Same direction, newest first
- 2026A Systematic Post-Train Framework for Video Generation28 Apr
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr
- 2026S2DiT: Sandwich Diffusion Transformer for Mobile Streaming Video Generation19 Jan
- 2026ReHyAt: Recurrent Hybrid Attention for Video Diffusion Transformers7 Jan
- 2025LiteAttention: A Temporal Sparse Attention for Diffusion Transformers14 Nov
- 2025Neodragon: Mobile Video Generation using Diffusion Transformer8 Nov
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models21 Oct
- 2025Attention Surgery: An Efficient Recipe to Linearize Your Video Diffusion Transformer29 Sep
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
- 2025SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention28 Sep
- 2025Astraea: A Token-wise Acceleration Framework for Video Diffusion Transformers5 Jun
- 2025VSA: Faster Video Diffusion with Trainable Sparse Attention19 May
13 more
- 2025MagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesis17 Mar
- 2025TPDiff: Temporal Pyramid Video Diffusion Model12 Mar
- 2025Fast Video Generation with Sliding Tile Attention6 Feb
- 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devices5 Feb
- 2025Diffusion Adversarial Post-Training for One-Step Video Generation14 Jan
- 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
- 2024SnapGen-V: Generating a Five-Second Video within Five Seconds on a Mobile Device13 Dec
- 2024Mobile Video Diffusion10 Dec
- 2024MoViE: Mobile Diffusion for Video Editing9 Dec
- 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024SF-V: Single Forward Video Generation Model6 Jun
- 2024Object-Centric Diffusion for Efficient Video Editing11 Jan
Other references · 45
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2020Reformer: The Efficient Transformercited by 1,668
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2020Rethinking Attention with Performerscited by 1,601
33 more
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2020Efficient Content-Based Sparse Attention with Routing Transformerscited by 471
- 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 471
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 87
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
- 2024CV-VAE: A Compatible Video VAE for Latent Generative Video Modelscited by 70
- 2024WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Modelcited by 57
- 2024Improved Video VAE for Latent Video Diffusion Modelcited by 48
- 2018The 2018 DAVIS Challenge on Video Object Segmentationcited by 47
- 2024TinyFusion: Diffusion Transformers Learned Shallowcited by 45
- 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 45
- 2024Rethinking Score Distillation as a Bridge Between Image Distributionscited by 38
- 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervalscited by 24
- 2025OBS-Diff: Accurate Pruning For Diffusion Models in One-Shotcited by 19
- 2023Clockwork Diffusion: Efficient Generation With Model-Step Distillationcited by 18
- 2025LeanVAE: An Ultra-Efficient Reconstruction VAE for Video Diffusion Modelscited by 17
- 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flowscited by 17
- 2025Turbo-VAED: Fast and Stable Transfer of Video-VAEs to Mobile Devicescited by 16
- 2025Exploring Diffusion Transformer Designs via Graftingcited by 12
- 2024Learnable Sparsity for Vision Generative Modelscited by 9
- 2025AMD-Hummingbird: Towards an Efficient Text-to-Video Modelcited by 8
- 2026FastLightGen: Fast and Light Video Generation with Fewer Steps and Parameterscited by 5
- 2026PyramidalWan: On Making Pretrained Video Model Pyramidal for Efficient Inferencecited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025MobileI2V: Fast and High-Resolution Image-to-Video on Mobile Devices
- 2025Taming Diffusion Transformer for Efficient Mobile Video Generation in Seconds
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models
- 2026Ride the Wave: Precision-Allocated Sparse Attention for Smooth Video Generation
- 2026Veda: Scalable Video Diffusion via Distilled Sparse Attention
- 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusion
- 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model
- 2026Temporal Aware Pruning for Efficient Diffusion-based Video Generation