mlsanityData to 7 Oct 2026

Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinement

arXiv 2511.20280 ↗First posted 25 Nov 2025cs.CVcited by 3

On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data

Abstract (arXiv)

Recent progress in video generation has led to impressive visual quality, yet current models still struggle to produce results that align with real-world physical principles. To this end, we propose an iterative self-refinement framework that leverages large language models and vision-language models to provide physics-aware guidance for video generation. Specifically, we introduce a multimodal chain-of-thought (MM-CoT) process that refines prompts based on feedback from physical inconsistencies, progressively enhancing generation quality. This method is training-free and plug-and-play, making it readily applicable to a wide range of video generation models. Experiments on the PhyIQ benchmark show that our method improves the Physics-IQ score from 56.31 to 62.38. We hope this work serves as a preliminary exploration of physics-consistent video generation and may offer insights for future research.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 20 of its 29 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

20 of 29 references.

References · 20

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2023Qwen Technical Reportcited by 3,273
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  6. 2025DINOv3cited by 1,297
  7. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  8. 2024DeepSeek-V3 Technical Reportcited by 724
  9. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  10. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
  11. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  12. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
8 more
  1. 2025Do generative video models understand physical principles?cited by 151
  2. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
  3. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
  4. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  5. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  6. 2025Think Before You Diffuse: Infusing Physical Rules into Video Diffusioncited by 14
  7. 2025Cross-Frame Representation Alignment for Fine-Tuning Video Diffusion Modelscited by 9
  8. 2025Exploring Structural Degradation in Dense Representations for Self-supervised Learningcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation
  2. 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models
  3. 2026PhyRPR: Training-Free Physics-Constrained Video Generation
  4. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Prior
  5. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation
  6. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Models
  7. 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
  8. 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modeling