World-R1: Reinforcing 3D Constraints for Text-to-Video Generation
Not on the map. Why?
Abstract (arXiv)
Recent video foundation models demonstrate impressive visual synthesis but frequently suffer from geometric inconsistencies. While existing methods attempt to inject 3D priors via architectural modifications, they often incur high computational costs and limit scalability. We propose World-R1, a framework that aligns video generation with 3D constraints through reinforcement learning. To facilitate this alignment, we introduce a specialized pure text dataset tailored for world simulation. Utilizing Flow-GRPO, we optimize the model using feedback from pre-trained 3D foundation models and vision-language models to enforce structural coherence without altering the underlying architecture. We further employ a periodic decoupled training strategy to balance rigid geometric consistency with dynamic scene fluidity. Extensive evaluations reveal that our approach significantly enhances 3D consistency while preserving the original visual quality of the foundation model, effectively bridging the gap between video generation and scalable world simulation.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 61 of its 68 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
61 of 68 references.
References · 61
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
38 more
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2025Video World Models with Long-term Spatial Memorycited by 136
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
- 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
- 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 101
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 96
- 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
- 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 65
- 2024Trajectory Attention for Fine-grained Video Motion Controlcited by 63
- 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 57
- 2025VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Predictioncited by 48
- 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 46
- 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videoscited by 41
- 2025Spatia: Video Generation with Updatable Spatial Memorycited by 40
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
- 20254DNeX: Feed-Forward 4D Generative Modeling Made Easycited by 34
- 2025ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGScited by 32
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Latent Spatial Memory for Video World Modelscited by 17
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modelingcited by 7
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 6
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generationcited by 4
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generationcited by 0
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Modelscited by 0
- 2026LoGo: Local-Global Rewards for Consistent Long-Horizon Video Generationcited by 0
- 2026WorldAlign: Decoupled 4D Reward for World-Consistent Video Generationcited by 0
- 2026ScenePlacer: Reformulating Scene-Level Object Pose Estimation as Visibility Field Learningcited by 0
- 2026GAD: Geometry Attention Distillation for Consistent Video Generationcited by 0
- 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generationcited by 0
- 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation14 Oct 2026
- 2026GAD: Geometry Attention Distillation for Consistent Video Generation13 Oct 2026
- 2026ScenePlacer: Reformulating Scene-Level Object Pose Estimation as Visibility Field Learning11 Oct 2026
- 2026WorldAlign: Decoupled 4D Reward for World-Consistent Video Generation8 Oct 2026
- 2026LoGo: Local-Global Rewards for Consistent Long-Horizon Video Generation2 Oct 2026
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models20 Aug 2026
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation25 Jun 2026
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling12 Jun 2026
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?9 Jun 2026
- 2026Latent Spatial Memory for Video World Models8 Jun 2026
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation22 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026DreamWorld: Unified World Modeling in Video Generation
- 2025Are We Ready for RL in Text-to-3D Generation? A Progressive Investigation
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward
- 2025IC-World: In-Context Generation for Shared World Modeling
- 2026Beyond Pixel Histories: World Models with Persistent 3D State
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
- 2026Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding
- 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception