mlsanityData to 7 Oct 2026

PhysVid: Physics Aware Local Conditioning for Generative Video Models

arXiv 2603.26285 ↗First posted 27 Mar 2026cs.CV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Generative video models achieve high visual fidelity but often violate basic physical principles, limiting reliability in real-world settings. Prior attempts to inject physics rely on conditioning: frame-level signals are domain-specific and short-horizon, while global text prompts are coarse and noisy, missing fine-grained dynamics. We present PhysVid, a physics-aware local conditioning scheme that operates over temporally contiguous chunks of frames. Each chunk is annotated with physics-grounded descriptions of states, interactions, and constraints, which are fused with the global prompt via chunk-aware cross-attention during training. At inference, we introduce negative physics prompts (descriptions of locally relevant law violations) to steer generation away from implausible trajectories. On VideoPhy, PhysVid improves physical commonsense scores by ≈ 33% over baseline video generators, and by up to ≈ 8% on VideoPhy2. These results show that local, physics-aware guidance substantially increases physical plausibility in generative video and marks a step toward physics-grounded video models.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 64 of its 70 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

64 of 70 references.

References · 64

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  6. 2022Video Diffusion Modelscited by 2,280
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  8. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  9. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  10. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  12. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
38 more
  1. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  2. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  3. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  4. 2024Genie: Generative Interactive Environmentscited by 706
  5. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  6. 2023ModelScope Text-to-Video Technical Reportcited by 651
  7. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  8. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
  9. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  10. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
  11. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  12. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
  13. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  14. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
  15. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  16. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
  17. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  18. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
  19. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  20. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  21. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
  22. 2023Efficient Guided Generation for Large Language Modelscited by 192
  23. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
  24. 2017Video Generation From Textcited by 153
  25. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
  26. 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generationcited by 137
  27. 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 124
  28. 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
  29. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
  30. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  31. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 77
  32. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 73
  33. 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
  34. 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 67
  35. 2024MagicTime: Time-lapse Video Generation Models as Metamorphic Simulatorscited by 51
  36. 2024VideoTetris: Towards Compositional Text-to-Video Generationcited by 51
  37. 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 51
  38. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 49

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.