mlsanityData to 7 Oct 2026

Goku: Flow Based Video Generative Foundation Models

arXiv 2502.04896 ↗First posted 7 Feb 2025cs.CVcited by 67

On the map: Diffusion models → Video generation

Abstract (arXiv)

This paper introduces Goku, a state-of-the-art family of joint image-and-video generation models leveraging rectified flow Transformers to achieve industry-leading performance. We detail the foundational elements enabling high-quality visual generation, including the data curation pipeline, model architecture design, flow formulation, and advanced infrastructure for efficient and robust large-scale training. The Goku models demonstrate superior performance in both qualitative and quantitative evaluations, setting new benchmarks across major tasks. Specifically, Goku achieves 0.76 on GenEval and 83.65 on DPG-Bench for text-to-image generation, and 84.85 on VBench for text-to-video tasks. We believe that this work provides valuable insights and practical advancements for the research community in developing joint image-and-video generation models.

Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 74 of its 100 references that are in the map. First posted on arXiv 7 Feb 2025.

Builds on

74 of 100 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models14 Jan
  2. 2024Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLM19 Dec
  3. 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
  4. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  6. 2024VEnhancer: Generative Space-Time Enhancement for Video Generation10 Jul
  7. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Models7 May
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  9. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models26 Sep
  10. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models17 May
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
  12. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
3 more
  1. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Models20 Nov
  2. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
  3. 2022Video Diffusion Models7 Apr

Other references · 59

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
38 more
  1. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  2. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  3. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  6. 2024Qwen2 Technical Reportcited by 2,076
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  9. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  10. 2018World Modelscited by 1,444
  11. 2019Root Mean Square Layer Normalizationcited by 1,425
  12. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  13. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  14. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  15. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  16. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  17. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  18. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  19. 2016Training Deep Nets with Sublinear Memory Costcited by 825
  20. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  21. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  22. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  23. 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
  24. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
  25. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  26. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
  27. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
  28. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  29. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  30. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
  31. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 352
  32. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  33. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
  34. 2022Reducing Activation Recomputation in Large Transformer Modelscited by 300
  35. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
  36. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
  37. 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
  38. 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 144

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 46; 2026: 21.

67 papers.

Sort:

By area:

  1. 2025VACE: All-in-One Video Creation and Editingcited by 467
  2. 2025VSA: Faster Video Diffusion with Trainable Sparse Attentioncited by 100
  3. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 93
  4. 2025PixelFlow: Pixel-Space Generative Models with Flowcited by 91
  5. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 91
  6. 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 85
  7. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
  8. 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
  9. 2025Towards Understanding Camera Motions in Any Videocited by 62
  10. 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 54
  11. 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
  12. 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
38 more
  1. 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 43
  2. 2025Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcingcited by 37
  3. 2025FlowTok: Flowing Seamlessly Across Text and Image Tokenscited by 31
  4. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  5. 2025MoCha: Towards Movie-Grade Talking Character Synthesiscited by 31
  6. 2025A Survey of Interactive Generative Videocited by 23
  7. 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integrationcited by 22
  8. 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 22
  9. 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generationcited by 20
  10. 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
  11. 2025Yan: Foundational Interactive Video Generationcited by 15
  12. 2025Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Modelscited by 14
  13. 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perceptioncited by 14
  14. 2025M4V: Multimodal Mamba for Efficient Text-to-Video Generationcited by 11
  15. 2025Can Video Diffusion Model Reconstruct 4D Geometry?cited by 10
  16. 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
  17. 2025BadVideo: Stealthy Backdoor Attack against Text-to-Video Generationcited by 9
  18. 2025InfinityHuman: Towards Long-Term Audio-Driven Humancited by 9
  19. 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
  20. 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 9
  21. 2025Scaling Sequence-to-Sequence Generative Neural Renderingcited by 8
  22. 2026LaDi-RL: Latent Diffusion Reasoning Prevents Entropy Collapse in Reinforcement Learningcited by 7
  23. 2026Evolution of Video Generative Foundationscited by 6
  24. 2026PhysVid: Physics Aware Local Conditioning for Generative Video Modelscited by 5
  25. 2025VHOI: Controllable Video Generation of Human-Object Interactions from Sparse Trajectories via Motion Densificationcited by 4
  26. 2026The Unreasonable Effectiveness of Text Embedding Interpolation for Continuous Image Steeringcited by 4
  27. 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effectscited by 4
  28. 2025A Survey: Spatiotemporal Consistency in Video Generationcited by 3
  29. 2025View-Consistent Diffusion Representations for 3D-Consistent Video Generationcited by 3
  30. 2025TEAR: Temporal-aware Automated Red-teaming for Text-to-Video Modelscited by 3
  31. 2025Transform Trained Transformer for Accelerating Native 4K Video Generationcited by 3
  32. 2025Soul: Breathe Life into Digital Human for High-fidelity Long-term Multimodal Animationcited by 3
  33. 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Modelscited by 3
  34. 2026Immune2V: Image Immunization Against Dual-Stream Image-to-Video Generationcited by 3
  35. 2025Aligning Latent Spaces with Flow Priorscited by 2
  36. 2025Improving Video Diffusion Transformer Training by Multi-Feature Fusion and Alignment from Self-Supervised Vision Encoderscited by 2
  37. 2026MotionPhysics: Learnable Motion Distillation for Text-Guided Simulationcited by 2
  38. 2026Low-Dimensional Adaptation of Rectified Flow: A Diffusion and Stochastic Localization Perspectivecited by 2

50 most cited of 67 All 67 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2021VideoGPT: Video Generation using VQ-VAE and Transformers
  2. 2024Video Is Worth a Thousand Images: Exploring the Latest Trends in Long Video Generation
  3. 2026Goku: A Million-Scale Universal Dataset and Benchmark for Instruction-Based Video Editing
  4. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models
  5. 2025Pushing the Boundaries of State Space Models for Image and Video Generation
  6. 2025Generative AI for Vision: A Comprehensive Study of Frameworks and Applications
  7. 2024Grid: Omni Visual Generation
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Models