mlsanityData to 14 Oct 2026

CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation

arXiv 2609.21455 ↗First posted 18 Sep 2026cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

While diffusion-based text-to-video (T2V) models have demonstrated impressive capability in generating realistic and temporally coherent videos, they often fail to respect fundamental physical dynamics. Although recent physics-constrained methods incorporate explicit dynamics priors to improve physical plausibility, they remain limited to simple single-type motions, depend on manually specified parameters, and struggle to generalize to unseen physical laws. In this work, we propose CompAdapt, a physics-consistent T2V framework for adaptable generation across complex real-world scenarios. It extends neural dynamics modeling beyond single-type motions to encompass composite physical behaviors, including coupled motions, multi-stage transitions, and multi-object collisions. Furthermore, CompAdapt translates natural language prompts into structured physical semantics, enabling end-to-end specification of motion types, temporal relations, and initial physical parameters. To generalize to novel physical environments, CompAdapt introduces dynamics-aware prior matching, achieving one-shot adaptation without retraining the core dynamics module. In addition, a physics-aware latent feature fusion module improves visual fidelity under fast and complex motion. Experiments on physics-focused T2V benchmarks demonstrate that CompAdapt improves physical consistency over both general T2V models and physics-constrained baselines, while preserving high visual quality and adaptability to unseen dynamics. The project page is available at https://makapic.github.io/CompAdapt/ .

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 47 of its 55 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

47 of 55 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
  2. 2024Mojito: Motion Trajectory and Intensity Control for Video Generation12 Dec
  3. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation30 Nov
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  5. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation2 Apr
  6. 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
  7. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
  8. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  10. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
  11. 2022Video Diffusion Models7 Apr

Other references · 36

  1. 2024Qwen2.5 Technical Reportcited by 4,942
  2. 2018Neural Ordinary Differential Equationscited by 3,779
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  5. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  6. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  7. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  8. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  9. 2019Hamiltonian Neural Networkscited by 712
  10. 2020Lagrangian Neural Networkscited by 398
  11. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  12. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
24 more
  1. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  2. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  3. 2018Neural Relational Inference for Interacting Systemscited by 339
  4. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
  5. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
  6. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  7. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  8. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  9. 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
  10. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  11. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
  12. 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 61
  13. 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 53
  14. 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
  15. 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 41
  16. 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 39
  17. 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 35
  18. 2025Epipolar Geometry Improves Video Generation Modelscited by 26
  19. 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 24
  20. 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Modelscited by 17
  21. 2023I-PHYRE: Interactive Physical Reasoningcited by 15
  22. 2025MotionAgent: Fine-grained Controllable Video Generation via Motion Field Agentcited by 11
  23. 2025A Physical Coherence Benchmark for Evaluating Video Generation Models via Optical Flow-guided Frame Predictioncited by 10
  24. 2026Goal Force: Teaching Video Models To Accomplish Physics-Conditioned Goalscited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generation
  2. 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions
  3. 2025PhyVLLM: Physics-Guided Video Language Model with Motion-Appearance Disentanglement
  4. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Prior
  5. 2025Think Before You Diffuse: Infusing Physical Rules into Video Diffusion
  6. 2025Physics-Guided Motion Loss for Video Generation Model
  7. 2026Deltaynamics: Language-Based Representation for Inferring Rigid-Body Dynamics From Videos
  8. 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation