mlsanityData to 14 Oct 2026

Proprio: Latent Self-Scoring and Inference-Time Refinement for Physically Plausible Video Generation

arXiv 2605.28230 ↗First posted 27 May 2026cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Modern video generative models produce visually impressive results, yet frequently violate basic physical principles. We propose Proprio, a training-free framework that enables a frozen video generator to assess and improve the physical plausibility of its own outputs. Inspired by proprioception, the biological sense of one's own movement, Proprio treats the model's flow residual under controlled latent perturbations as a self-scoring signal. Samples that are better explained by the generator's learned dynamics induce smaller and more stable residuals. We aggregate this signal across timesteps and perturbations, focus it on motion-relevant regions with a dynamic spatiotemporal mask, and use it for best-of-N search, gradient-based self-refinement, or both. Across text-to-video and image-to-video benchmarks, Proprio consistently improves physical plausibility, outperforming VLM-based scoring, and external world-model baselines in several settings. With TurboWan2.2, Proprio improves Physics-IQ from 32.2 to 37.5 (+16.5%) and VideoPhy2-hard physical commonsense from 45.6 to 55.0 (+20.6%). Human evaluation further shows that raters prefer Proprio-selected or refined videos for physical plausibility in roughly two-thirds of comparisons. These results suggest that frozen video generators contain actionable internal signals for evaluating and improving the physical plausibility of their own outputs.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 42 of its 44 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

42 of 44 references.

References · 42

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  7. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  8. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  9. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  10. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  11. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  12. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
30 more
  1. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  2. 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 306
  3. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
  4. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  5. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  6. 2025Do generative video models understand physical principles?cited by 161
  7. 2025HunyuanVideo 1.5 Technical Reportcited by 160
  8. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
  9. 2024Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decodingcited by 136
  10. 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
  11. 2024TFG: Unified Training-Free Guidance for Diffusion Modelscited by 107
  12. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 98
  13. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
  14. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
  15. 2024Inference-Time Alignment of Diffusion Models with Direct Noise Optimizationcited by 55
  16. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 52
  17. 2025Inference-time Scaling of Diffusion Models through Classical Searchcited by 49
  18. 2024Video Motion Transfer with Diffusion Transformerscited by 39
  19. 2025Dynamic Search for Inference-Time Alignment in Diffusion Modelscited by 37
  20. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
  21. 2025Diffusion Tree Sampling: Scalable inference-time alignment of diffusion modelscited by 34
  22. 2025TurboDiffusion: Accelerating Video Diffusion Models by 100-200 Timescited by 33
  23. 2024Improving Geo-diversity of Generated Images with Contextualized Vendi Score Guidancecited by 24
  24. 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 23
  25. 2023Extracting Reward Functions from Diffusion Modelscited by 18
  26. 2025LikePhys: Evaluating Intuitive Physics Understanding in Video Diffusion Models via Likelihood Preferencecited by 16
  27. 2025Video Generation Models Are Good Latent Reward Modelscited by 16
  28. 2026Self-Refining Video Samplingcited by 15
  29. 2025Increasing the Utility of Synthetic Images through Chamfer Guidancecited by 6
  30. 2026Beyond VLM-Based Rewards: Diffusion-Native Latent Reward Modelingcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinement
  2. 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation
  3. 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models
  4. 2026Physics-Informed Video Generation via Mixture-of-Experts Latent Alignment
  5. 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
  6. 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
  7. 2026PhyRPR: Training-Free Physics-Constrained Video Generation
  8. 2026A Mechanistic View on Video Generation as World Models: State and Dynamics