mlsanityData to 14 Oct 2026

World-R1: Reinforcing 3D Constraints for Text-to-Video Generation

arXiv 2604.24764 ↗First posted 27 Apr 2026cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Recent video foundation models demonstrate impressive visual synthesis but frequently suffer from geometric inconsistencies. While existing methods attempt to inject 3D priors via architectural modifications, they often incur high computational costs and limit scalability. We propose World-R1, a framework that aligns video generation with 3D constraints through reinforcement learning. To facilitate this alignment, we introduce a specialized pure text dataset tailored for world simulation. Utilizing Flow-GRPO, we optimize the model using feedback from pre-trained 3D foundation models and vision-language models to enforce structural coherence without altering the underlying architecture. We further employ a periodic decoupled training strategy to balance rigid geometric consistency with dynamic scene fluidity. Extensive evaluations reveal that our approach significantly enhances 3D consistency while preserving the original visual quality of the foundation model, effectively bridging the gap between video generation and scalable world simulation.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 61 of its 68 references that are in the map. First posted on arXiv 27 Apr 2026.

Builds on

61 of 68 references.

References · 61

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  7. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  8. 2025Qwen3-VL Technical Reportcited by 2,793
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  12. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
38 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  3. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  4. 2024Depth Anything V2cited by 1,422
  5. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  6. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  7. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  8. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  9. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  10. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  11. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
  12. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  13. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  14. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
  15. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  16. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  17. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  18. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  19. 2025Video World Models with Long-term Spatial Memorycited by 136
  20. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
  21. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
  22. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  23. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
  24. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
  25. 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
  26. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 101
  27. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 96
  28. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
  29. 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 65
  30. 2024Trajectory Attention for Fine-grained Video Motion Controlcited by 63
  31. 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 57
  32. 2025VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Predictioncited by 48
  33. 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 46
  34. 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videoscited by 41
  35. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 40
  36. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
  37. 20254DNeX: Feed-Forward 4D Generative Modeling Made Easycited by 34
  38. 2025ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGScited by 32

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DreamWorld: Unified World Modeling in Video Generation
  2. 2025Are We Ready for RL in Text-to-3D Generation? A Progressive Investigation
  3. 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward
  4. 2025IC-World: In-Context Generation for Shared World Modeling
  5. 2026Beyond Pixel Histories: World Models with Persistent 3D State
  6. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
  7. 2026Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding
  8. 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception