mlsanityData to 7 Oct 2026

PhysCorr: Dual-Reward DPO for Physics-Constrained Text-to-Video Generation with Automated Preference Selection

arXiv 2511.03997 ↗First posted 6 Nov 2025cs.CVcited by 14

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Recent advances in text-to-video generation have achieved impressive perceptual quality, yet generated content often violates fundamental principles of physical plausibility - manifesting as implausible object dynamics, incoherent interactions, and unrealistic motion patterns. Such failures hinder the deployment of video generation models in embodied AI, robotics, and simulation-intensive domains. To bridge this gap, we propose PhysCorr, a unified framework for modeling, evaluating, and optimizing physical consistency in video generation. Specifically, we introduce PhysicsRM, the first dual-dimensional reward model that quantifies both intra-object stability and inter-object interactions. On this foundation, we develop PhyDPO, a novel direct preference optimization pipeline that leverages contrastive feedback and physics-aware reweighting to guide generation toward physically coherent outputs. Our approach is model-agnostic and scalable, enabling seamless integration into a wide range of video diffusion and transformer-based backbones. Extensive experiments across multiple benchmarks demonstrate that PhysCorr achieves significant improvements in physical realism while preserving visual fidelity and semantic alignment. This work takes a critical step toward physically grounded and trustworthy video generation.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 38 of its 46 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

38 of 46 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Improving Video Generation with Human Feedback23 Jan
  2. 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
  3. 2024Improving Dynamic Object Interactions in Text-to-Video Generation with AI Feedback3 Dec
  4. 2024T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Design8 Oct
  5. 2024Video Diffusion Alignment via Reward Gradients11 Jul
  6. 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedback29 May

Other references · 32

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2017Neural Discrete Representation Learningcited by 4,650
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
20 more
  1. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  4. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  5. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  6. 2023ModelScope Text-to-Video Technical Reportcited by 651
  7. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  8. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  9. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
  10. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
  11. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 300
  12. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  13. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
  14. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
  15. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
  16. 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Modelscited by 127
  17. 2023Collaborative Diffusion for Multi-Modal Face Generation and Editingcited by 116
  18. 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
  19. 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptationcited by 50
  20. 2025RepVideo: Rethinking Cross-Layer Representation for Video Generationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 13.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learning
  2. 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generation
  3. 2026PhyPrompt: RL-based Prompt Refinement for Physically Plausible Text-to-Video Generation
  4. 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generation
  5. 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
  6. 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models
  7. 2026PhyWorld: Physics-Faithful World Model for Video Generation
  8. 2026PhyRPR: Training-Free Physics-Constrained Video Generation