mlsanityData to 13 Oct 2026

PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models

arXiv 2601.11087 ↗First posted 16 Jan 2026cs.CVcited by 15

On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation

Abstract (arXiv)

Physical principles are fundamental to realistic visual simulation, but remain a significant oversight in transformer-based video generation. This gap highlights a critical limitation in rendering rigid body motion, a core tenet of classical mechanics. While computer graphics and physics-based simulators can easily model such collisions using Newton formulas, modern pretrain-finetune paradigms discard the concept of object rigidity during pixel-level global denoising. Even perfectly correct mathematical constraints are treated as suboptimal solutions (i.e., conditions) during model optimization in post-training, fundamentally limiting the physical realism of generated videos. Motivated by these considerations, we introduce, for the first time, a physics-aware reinforcement learning paradigm for video generation models that enforces physical collision rules directly in high-dimensional spaces, ensuring the physics knowledge is strictly applied rather than treated as conditions. Subsequently, we extend this paradigm to a unified framework, termed Mimicry-Discovery Cycle (MDcycle), which allows substantial fine-tuning while fully preserving the model's ability to leverage physics-grounded feedback. To validate our approach, we construct new benchmark PhysRVGBench and perform extensive qualitative and quantitative experiments to thoroughly assess its effectiveness.

Key facts. Cited by 15 papers in the map (data through 13 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 38 of its 48 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

38 of 48 references.

References · 38

  1. 2022Training language models to follow instructions with human feedbackcited by 15,856
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,607
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,820
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,218
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,775
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,625
  8. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,362
  9. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,077
  10. 2023Training Diffusion Models with Reinforcement Learningcited by 955
  11. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 625
  12. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 590
26 more
  1. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 414
  2. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 401
  3. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 370
  4. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 267
  5. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 188
  6. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 179
  7. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 174
  8. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 170
  9. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 166
  10. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 143
  11. 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Modelscited by 94
  12. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 92
  13. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 78
  14. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
  15. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 50
  16. 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 41
  17. 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 40
  18. 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 31
  19. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  20. 2025DreamRelation: Relation-Centric Video Customizationcited by 23
  21. 2023Check, Locate, Rectify: A Training-Free Layout Calibration System for Text-to-Image Generationcited by 19
  22. 2024Mimir: Improving Video Diffusion Models for Precise Text Understandingcited by 16
  23. 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
  24. 2023UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Trainingcited by 14
  25. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
  26. 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 11

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area: