Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinement
On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data
Abstract (arXiv)
Recent progress in video generation has led to impressive visual quality, yet current models still struggle to produce results that align with real-world physical principles. To this end, we propose an iterative self-refinement framework that leverages large language models and vision-language models to provide physics-aware guidance for video generation. Specifically, we introduce a multimodal chain-of-thought (MM-CoT) process that refines prompts based on feedback from physical inconsistencies, progressively enhancing generation quality. This method is training-free and plug-and-play, making it readily applicable to a wide range of video generation models. Experiments on the PhyIQ benchmark show that our method improves the Physics-IQ score from 56.31 to 62.38. We hope this work serves as a preliminary exploration of physics-consistent video generation and may offer insights for future research.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 20 of its 29 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
20 of 29 references.
References · 20
- 2023GPT-4 Technical Reportcited by 18,132
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Qwen Technical Reportcited by 3,273
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2025DINOv3cited by 1,297
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
8 more
- 2025Do generative video models understand physical principles?cited by 151
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025Think Before You Diffuse: Infusing Physical Rules into Video Diffusioncited by 14
- 2025Cross-Frame Representation Alignment for Fine-Tuning Video Diffusion Modelscited by 9
- 2025Exploring Structural Degradation in Dense Representations for Self-supervised Learningcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models
- 2026PhyRPR: Training-Free Physics-Constrained Video Generation
- 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Prior
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Models
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modeling