PhysVid: Physics Aware Local Conditioning for Generative Video Models
Not on the map. Why?
Abstract (arXiv)
Generative video models achieve high visual fidelity but often violate basic physical principles, limiting reliability in real-world settings. Prior attempts to inject physics rely on conditioning: frame-level signals are domain-specific and short-horizon, while global text prompts are coarse and noisy, missing fine-grained dynamics. We present PhysVid, a physics-aware local conditioning scheme that operates over temporally contiguous chunks of frames. Each chunk is annotated with physics-grounded descriptions of states, interactions, and constraints, which are fused with the global prompt via chunk-aware cross-attention during training. At inference, we introduce negative physics prompts (descriptions of locally relevant law violations) to steer generation away from implausible trajectories. On VideoPhy, PhysVid improves physical commonsense scores by ≈ 33% over baseline video generators, and by up to ≈ 8% on VideoPhy2. These results show that local, physics-aware guidance substantially increases physical plausibility in generative video and marks a step toward physics-grounded video models.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 64 of its 70 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
64 of 70 references.
References · 64
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
38 more
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2024Genie: Generative Interactive Environmentscited by 706
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
- 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
- 2023Efficient Guided Generation for Large Language Modelscited by 192
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
- 2017Video Generation From Textcited by 153
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generationcited by 137
- 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 124
- 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 77
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 73
- 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 67
- 2024MagicTime: Time-lapse Video Generation Models as Metamorphic Simulatorscited by 51
- 2024VideoTetris: Towards Compositional Text-to-Video Generationcited by 51
- 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 51
- 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 49
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generationcited by 4
- 2026PhysAgent: Reflective Agentic Physics Control for Physically Plausible Video Generationcited by 2
- 2026muSync-GS: Physics-Synchronized Driving Video Synthesis for Weather and Geometric Road Hazardscited by 0
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioningcited by 0
- 2026OmniFysics-Nano-V2 Technical Report: Understanding the Physical World Across Modalitiescited by 0
- 2026OmniFysics-Nano-V2 Technical Report: Understanding the Physical World Across Modalities22 Sep 2026
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning1 Sep 2026
- 2026muSync-GS: Physics-Synchronized Driving Video Synthesis for Weather and Geometric Road Hazards5 Aug 2026
- 2026PhysAgent: Reflective Agentic Physics Control for Physically Plausible Video Generation17 Jul 2026
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation22 May 2026