Proprio: Latent Self-Scoring and Inference-Time Refinement for Physically Plausible Video Generation
Not on the map. Why?
Abstract (arXiv)
Modern video generative models produce visually impressive results, yet frequently violate basic physical principles. We propose Proprio, a training-free framework that enables a frozen video generator to assess and improve the physical plausibility of its own outputs. Inspired by proprioception, the biological sense of one's own movement, Proprio treats the model's flow residual under controlled latent perturbations as a self-scoring signal. Samples that are better explained by the generator's learned dynamics induce smaller and more stable residuals. We aggregate this signal across timesteps and perturbations, focus it on motion-relevant regions with a dynamic spatiotemporal mask, and use it for best-of-N search, gradient-based self-refinement, or both. Across text-to-video and image-to-video benchmarks, Proprio consistently improves physical plausibility, outperforming VLM-based scoring, and external world-model baselines in several settings. With TurboWan2.2, Proprio improves Physics-IQ from 32.2 to 37.5 (+16.5%) and VideoPhy2-hard physical commonsense from 45.6 to 55.0 (+20.6%). Human evaluation further shows that raters prefer Proprio-selected or refined videos for physical plausibility in roughly two-thirds of comparisons. These results suggest that frozen video generators contain actionable internal signals for evaluating and improving the physical plausibility of their own outputs.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 42 of its 44 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
42 of 44 references.
References · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
30 more
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 306
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2025Do generative video models understand physical principles?cited by 161
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
- 2024Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decodingcited by 136
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
- 2024TFG: Unified Training-Free Guidance for Diffusion Modelscited by 107
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 98
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
- 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
- 2024Inference-Time Alignment of Diffusion Models with Direct Noise Optimizationcited by 55
- 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 52
- 2025Inference-time Scaling of Diffusion Models through Classical Searchcited by 49
- 2024Video Motion Transfer with Diffusion Transformerscited by 39
- 2025Dynamic Search for Inference-Time Alignment in Diffusion Modelscited by 37
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
- 2025Diffusion Tree Sampling: Scalable inference-time alignment of diffusion modelscited by 34
- 2025TurboDiffusion: Accelerating Video Diffusion Models by 100-200 Timescited by 33
- 2024Improving Geo-diversity of Generated Images with Contextualized Vendi Score Guidancecited by 24
- 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 23
- 2023Extracting Reward Functions from Diffusion Modelscited by 18
- 2025LikePhys: Evaluating Intuitive Physics Understanding in Video Diffusion Models via Likelihood Preferencecited by 16
- 2025Video Generation Models Are Good Latent Reward Modelscited by 16
- 2026Self-Refining Video Samplingcited by 15
- 2025Increasing the Utility of Synthetic Images through Chamfer Guidancecited by 6
- 2026Beyond VLM-Based Rewards: Diffusion-Native Latent Reward Modelingcited by 6
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 35
- 2026YoCausal: How Far is Video Generation from World Model? A Causality Perspectivecited by 3
- 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimizationcited by 1
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioningcited by 0
- 2026Sampling headroom is not selection gain: a compute-value audit of test-time scaling for video world modelscited by 0
- 2026Learning via Self-Consistency for Diffusion-based Video Reasoningcited by 0
- 2026Learning via Self-Consistency for Diffusion-based Video Reasoning29 Sep 2026
- 2026Sampling headroom is not selection gain: a compute-value audit of test-time scaling for video world models6 Sep 2026
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning1 Sep 2026
- 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization16 Jul 2026
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops8 Jul 2026
- 2026YoCausal: How Far is Video Generation from World Model? A Causality Perspective28 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinement
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models
- 2026Physics-Informed Video Generation via Mixture-of-Experts Latent Alignment
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
- 2026PhyRPR: Training-Free Physics-Constrained Video Generation
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics