PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models
On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation
Abstract (arXiv)
Physical principles are fundamental to realistic visual simulation, but remain a significant oversight in transformer-based video generation. This gap highlights a critical limitation in rendering rigid body motion, a core tenet of classical mechanics. While computer graphics and physics-based simulators can easily model such collisions using Newton formulas, modern pretrain-finetune paradigms discard the concept of object rigidity during pixel-level global denoising. Even perfectly correct mathematical constraints are treated as suboptimal solutions (i.e., conditions) during model optimization in post-training, fundamentally limiting the physical realism of generated videos. Motivated by these considerations, we introduce, for the first time, a physics-aware reinforcement learning paradigm for video generation models that enforces physical collision rules directly in high-dimensional spaces, ensuring the physics knowledge is strictly applied rather than treated as conditions. Subsequently, we extend this paradigm to a unified framework, termed Mimicry-Discovery Cycle (MDcycle), which allows substantial fine-tuning while fully preserving the model's ability to leverage physics-grounded feedback. To validate our approach, we construct new benchmark PhysRVGBench and perform extensive qualitative and quantitative experiments to thoroughly assess its effectiveness.
Key facts. Cited by 15 papers in the map (data through 13 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 38 of its 48 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
38 of 48 references.
References · 38
- 2022Training language models to follow instructions with human feedbackcited by 15,856
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,607
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,820
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,218
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,775
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,625
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,362
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,077
- 2023Training Diffusion Models with Reinforcement Learningcited by 955
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 625
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 590
26 more
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 414
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 401
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 370
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 267
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 188
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 179
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 174
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 170
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 166
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 143
- 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Modelscited by 94
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 92
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 78
- 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
- 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 50
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 41
- 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 40
- 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 31
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025DreamRelation: Relation-Centric Video Customizationcited by 23
- 2023Check, Locate, Rectify: A Training-Free Layout Calibration System for Text-to-Image Generationcited by 19
- 2024Mimir: Improving Video Diffusion Models for Precise Text Understandingcited by 16
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
- 2023UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Trainingcited by 14
- 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
- 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 11
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026Olaf-World: Orienting Latent Actions for Video World Modelingcited by 9
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine Systemcited by 8
- 2026Toward Native Multimodal Modeling: A Roadmapcited by 6
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generationcited by 4
- 2026CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generationcited by 4
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modelingcited by 3
- 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusioncited by 2
- 2026Advances in GRPO for Generation Models: A Surveycited by 2
- 2026NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamicscited by 1
- 2026Distilling Physical Priors into Streaming World Modelscited by 1
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generationcited by 0
- 2026DeforM: Reasoning-Guided Physics-Aware Video Generation via Spatial-Temporal Maskingcited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation18 Sep 2026
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning1 Sep 2026
- 2026Distilling Physical Priors into Streaming World Models8 Aug 2026
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System29 Jul 2026
- 2026DeforM: Reasoning-Guided Physics-Aware Video Generation via Spatial-Temporal Masking21 Jul 2026
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation25 Jun 2026
- 2026NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamics12 Jun 2026
- 2026CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generation12 Jun 2026
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation22 May 2026
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modeling3 Apr 2026
3 more
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generationcited by 4
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modelingcited by 3
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generationcited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation18 Sep 2026
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation22 May 2026
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modeling3 Apr 2026
- 2026Distilling Physical Priors into Streaming World Models8 Aug 2026
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion3 Mar 2026
- 2026Olaf-World: Orienting Latent Actions for Video World Modeling10 Feb 2026