mlsanityData to 7 Oct 2026

Motif-Video 2B: Technical Report

arXiv 2604.16503 ↗First posted 14 Apr 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Training strong video generation models usually requires massive datasets, large parameter counts, and substantial compute. In this work, we ask whether strong text-to-video quality is possible at a much smaller budget: fewer than 10M clips and less than 100,000 H200 GPU hours. Our core claim is that part of the answer lies in how model capacity is organized, not only in how much of it is used. In video generation, prompt alignment, temporal consistency, and fine-detail recovery can interfere with one another when they are handled through the same pathway. Motif-Video 2B addresses this by separating these roles architecturally, rather than relying on scale alone. The model combines two key ideas. First, Shared Cross-Attention strengthens text control when video token sequences become long. Second, a three-part backbone separates early fusion, joint representation learning, and detail refinement. To make this design effective under a limited compute budget, we pair it with an efficient training recipe based on dynamic token routing and early-phase feature alignment to a frozen pretrained video encoder. Our analysis shows that later blocks develop clearer cross-frame attention structure than standard single-stream baselines. On VBench, Motif-Video~2B reaches 83.76%, surpassing Wan2.1 14B while using 7× fewer parameters and substantially less training data. These results suggest that careful architectural specialization, combined with an efficiency-oriented training recipe, can narrow or exceed the quality gap typically associated with much larger video models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 52 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

44 of 52 references.

References · 44

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  9. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  10. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  11. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  12. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
32 more
  1. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  2. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  3. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  4. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
  5. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
  6. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  7. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
  8. 2025Video models are zero-shot learners and reasonerscited by 208
  9. 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 177
  10. 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 175
  11. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
  12. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
  13. 2025HunyuanVideo 1.5 Technical Reportcited by 148
  14. 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 132
  15. 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Modelscited by 107
  16. 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 104
  17. 2025DDT: Decoupled Diffusion Transformercited by 100
  18. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 91
  19. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
  20. 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Modelcited by 84
  21. 2025What matters for Representation Alignment: Global Information or Spatial Structure?cited by 76
  22. 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 73
  23. 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
  24. 2024Scaling Laws For Diffusion Transformerscited by 41
  25. 2025REPA Works Until It Doesn't: Early-Stopped, Holistic Alignment Supercharges Diffusion Trainingcited by 33
  26. 2025TREAD: Token Routing for Efficient Architecture-agnostic Diffusion Trainingcited by 21
  27. 2025T5Gemma 2: Seeing, Reading, and Understanding Longercited by 12
  28. 2025Enhance-A-Video: Better Generated Video for Freecited by 11
  29. 2026SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing modelcited by 11
  30. 2025A Comprehensive Study of Decoder-Only LLMs for Text-to-Image Generationcited by 10
  31. 2025Improving Motion in Image-to-Video Models via Adaptive Low-Pass Guidancecited by 4
  32. 2025Speedrunning ImageNet Diffusioncited by 1

Built on by

Not cited yet.