PhysCorr: Dual-Reward DPO for Physics-Constrained Text-to-Video Generation with Automated Preference Selection
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Recent advances in text-to-video generation have achieved impressive perceptual quality, yet generated content often violates fundamental principles of physical plausibility - manifesting as implausible object dynamics, incoherent interactions, and unrealistic motion patterns. Such failures hinder the deployment of video generation models in embodied AI, robotics, and simulation-intensive domains. To bridge this gap, we propose PhysCorr, a unified framework for modeling, evaluating, and optimizing physical consistency in video generation. Specifically, we introduce PhysicsRM, the first dual-dimensional reward model that quantifies both intra-object stability and inter-object interactions. On this foundation, we develop PhyDPO, a novel direct preference optimization pipeline that leverages contrastive feedback and physics-aware reweighting to guide generation toward physically coherent outputs. Our approach is model-agnostic and scalable, enabling seamless integration into a wide range of video diffusion and transformer-based backbones. Extensive experiments across multiple benchmarks demonstrate that PhysCorr achieves significant improvements in physical realism while preserving visual fidelity and semantic alignment. This work takes a critical step toward physically grounded and trustworthy video generation.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 38 of its 46 references that are in the map. First posted on arXiv 6 Nov 2025.
Builds on
38 of 46 references.
Closest ancestors · 6
Same direction, newest first
- 2025Improving Video Generation with Human Feedback23 Jan
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
- 2024Improving Dynamic Object Interactions in Text-to-Video Generation with AI Feedback3 Dec
- 2024T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Design8 Oct
- 2024Video Diffusion Alignment via Reward Gradients11 Jul
- 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedback29 May
Other references · 32
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2017Neural Discrete Representation Learningcited by 4,650
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
20 more
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
- 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 300
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Modelscited by 127
- 2023Collaborative Diffusion for Multi-Modal Face Generation and Editingcited by 116
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptationcited by 50
- 2025RepVideo: Rethinking Cross-Layer Representation for Video Generationcited by 12
Built on by
Citing papers per year: 2025: 1; 2026: 13.
14 papers.
Sort:
By area:
- 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignmentcited by 23
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 19
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine Systemcited by 7
- 2025Planning with Sketch-Guided Verification for Physics-Aware Video Generationcited by 6
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2026A Definition and Roadmap for World Modelscited by 3
- 2026When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generationcited by 3
- 2026GEOPHYS: The Geometry of Physical Plausibilitycited by 2
- 2026Off-Manifold Refinement: Guiding Video Generators with a Frozen World Modelcited by 2
- 2026Physics Question Scene Graph: Fine-grained Evaluation of Physical Plausibility in Text-to-Video Generationcited by 1
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generationcited by 0
- 2026SciForma: Structure-Faithful Generation of Scientific Diagramscited by 0
- 2026Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model30 Sep 2026
- 2026PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videos29 Sep 2026
- 2026Off-Manifold Refinement: Guiding Video Generators with a Frozen World Model30 Aug 2026
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System29 Jul 2026
- 2026SciForma: Structure-Faithful Generation of Scientific Diagrams20 Jul 2026
- 2026When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generation18 Jul 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation25 Jun 2026
- 2026Physics Question Scene Graph: Fine-grained Evaluation of Physical Plausibility in Text-to-Video Generation24 Jun 2026
- 2026GEOPHYS: The Geometry of Physical Plausibility15 Jun 2026
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward27 Mar 2026
- 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignment24 Mar 2026
2 more
- 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignmentcited by 23
- 2026A Definition and Roadmap for World Modelscited by 3
- 2026Off-Manifold Refinement: Guiding Video Generators with a Frozen World Modelcited by 2
- 2026Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Modelcited by 0
- 2026Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model30 Sep 2026
- 2026Off-Manifold Refinement: Guiding Video Generators with a Frozen World Model30 Aug 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
- 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignment24 Mar 2026
- 2025Planning with Sketch-Guided Verification for Physics-Aware Video Generationcited by 6
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2026GEOPHYS: The Geometry of Physical Plausibilitycited by 2
- 2026Physics Question Scene Graph: Fine-grained Evaluation of Physical Plausibility in Text-to-Video Generationcited by 1
- 2026SciForma: Structure-Faithful Generation of Scientific Diagramscited by 0
- 2026SciForma: Structure-Faithful Generation of Scientific Diagrams20 Jul 2026
- 2026Physics Question Scene Graph: Fine-grained Evaluation of Physical Plausibility in Text-to-Video Generation24 Jun 2026
- 2026GEOPHYS: The Geometry of Physical Plausibility15 Jun 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2025Planning with Sketch-Guided Verification for Physics-Aware Video Generation21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learning
- 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generation
- 2026PhyPrompt: RL-based Prompt Refinement for Physically Plausible Text-to-Video Generation
- 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generation
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models
- 2026PhyWorld: Physics-Faithful World Model for Video Generation
- 2026PhyRPR: Training-Free Physics-Constrained Video Generation