mlsanityData to 14 Oct 2026

DeforM: Reasoning-Guided Physics-Aware Video Generation via Spatial-Temporal Masking

arXiv 2607.18664 ↗First posted 21 Jul 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Video generation models achieve high visual quality but often struggle to generate physics-aware videos. Unlike rigid-body motion, which can be described by explicit trajectories or formulas, complex deformation dynamics remain challenging to synthesize. We observe that a lack of physical reasoning for localizing dynamic areas allows irrelevant regions to dilute the model's attention, leading to generation failure. In this paper, we propose DeforM, a reasoning-guided image-to-video generation framework that directs the model's focus toward physics-critical regions. To reason about and localize these critical regions, we introduce a VLM-guided physical reasoning module, DeforM-Reason, to identify target objects and generate spatial-temporal masks. For physical guidance, we develop two alternative strategies: DeforM-Free for training-free mechanism analysis and DeforM-Injection as a powerful training-based generator. Experimental results demonstrate that DeforM improves the realism of generated deformation scenarios, outperforming baseline models in both visual quality and physical consistency.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 35 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

35 of 35 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2022Flow Matching for Generative Modelingcited by 5,702
  7. 2024Qwen2.5 Technical Reportcited by 4,942
  8. 2018Neural Ordinary Differential Equationscited by 3,779
  9. 2023Qwen Technical Reportcited by 3,344
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  12. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
23 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  3. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
  4. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  5. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  6. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  7. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
  8. 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 89
  9. 2025LLMDet: Learning Strong Open-Vocabulary Object Detectors under the Supervision of Large Language Modelscited by 57
  10. 2022Efficient Video Prediction via Sparsely Conditioned Flow Matchingcited by 55
  11. 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 53
  12. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 52
  13. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 50
  14. 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
  15. 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 45
  16. 2025Pre-Trained Video Generative Models as World Simulatorscited by 44
  17. 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generationcited by 21
  18. 2024DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generationcited by 18
  19. 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Modelscited by 17
  20. 2025VIVA: VLM-Guided Instruction-Based Video Editing with Reward Optimizationcited by 16
  21. 2026PhyRPR: Training-Free Physics-Constrained Video Generationcited by 7
  22. 2025R-Genie: Reasoning-Guided Generative Image Editingcited by 6
  23. 2025GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generation
  2. 2026CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generation
  3. 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization
  4. 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment
  5. 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning
  6. 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesis
  7. 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
  8. 2025Enhancing Physical Plausibility in Video Generation by Reasoning the Implausibility