mlsanityData to 14 Oct 2026

DiReCT: Disentangled Regularization of Contrastive Trajectories for Physics-Refined Video Generation

arXiv 2603.25931 ↗First posted 26 Mar 2026cs.CV cs.AIcited by 2

On the map: Diffusion models → Video generation

Abstract (arXiv)

Flow-matching video generators produce temporally coherent, high-fidelity outputs yet routinely violate elementary physics because their reconstruction objectives penalize per-frame deviations without distinguishing physically consistent dynamics from impossible ones. Contrastive flow matching offers a principled remedy by pushing apart velocity-field trajectories of differing conditions, but we identify a fundamental obstacle in the text-conditioned video setting: semantic-physics entanglement. Because natural-language prompts couple scene content with physical behavior, naive negative sampling draws conditions whose velocity fields largely overlap with the positive sample's, causing the contrastive gradient to directly oppose the flow-matching objective. We formalize this gradient conflict, deriving a precise alignment condition that reveals when contrastive learning helps versus harms training. Guided by this analysis, we introduce DiReCT (Disentangled Regularization of Contrastive Trajectories), a lightweight post-training framework that decomposes the contrastive signal into two complementary scales: a macro-contrastive term that draws partition-exclusive negatives from semantically distant regions for interference-free global trajectory separation, and a micro-contrastive term that constructs hard negatives sharing full scene semantics with the positive sample but differing along a single, LLM-perturbed axis of physical behavior; spanning kinematics, forces, materials, interactions, and magnitudes. A velocity-space distributional regularizer helps to prevent catastrophic forgetting of pretrained visual quality. When applied to Wan 2.1-1.3B, our method improves the physical commonsense score on VideoPhy by 16.7% and 11.3% compared to the baseline and SFT, respectively, without increasing training time.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 49 of its 53 references that are in the map. First posted on arXiv 26 Mar 2026.

Builds on

49 of 53 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Prior30 Mar
  2. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Drop12 Mar
  3. 2025HuViDPO:Enhancing Video Generation through Direct Preference Optimization for Human-Centric Alignment2 Feb
  4. 2025Improving Video Generation with Human Feedback23 Jan
  5. 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
  6. 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
  7. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation30 Nov
  8. 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
  9. 2024T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Design8 Oct
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  11. 2024Video Diffusion Alignment via Reward Gradients11 Jul
  12. 2024Efficient Video Diffusion Models via Content-Frame Motion-Latent Decomposition21 Mar
4 more
  1. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planning21 Nov
  2. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Models12 Oct
  3. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  4. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation15 Mar

Other references · 33

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  7. 2025Large Language Diffusion Modelscited by 912
  8. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
  9. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  10. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  11. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  12. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
21 more
  1. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
  2. 2023Learning Interactive Real-World Simulatorscited by 458
  3. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  4. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
  5. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  6. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  7. 2017Unsupervised Learning of Disentangled Representations from Videocited by 139
  8. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
  9. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
  10. 2024World Models for Autonomous Driving: An Initial Surveycited by 80
  11. 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
  12. 2024Dynamic Diffusion Transformercited by 62
  13. 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Modelscited by 54
  14. 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 47
  15. 2022Discrete Contrastive Diffusion for Cross-Modal Music and Image Generationcited by 44
  16. 2025Variational Rectified Flow Matchingcited by 35
  17. 2025Towards Hierarchical Rectified Flowcited by 20
  18. 2025FS-DFM: Fast and Accurate Long Text Generation with Few-Step Diffusion Language Modelscited by 17
  19. 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learningcited by 12
  20. 2025FinePhys: Fine-grained Human Action Generation by Explicitly Incorporating Physical Laws for Effective Skeletal Guidancecited by 9
  21. 2025ImageReFL: Balancing Quality and Diversity in Human-Aligned Diffusion Modelscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models
  2. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Models
  3. 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning
  4. 2026Physics-Informed Video Generation via Mixture-of-Experts Latent Alignment
  5. 2025Think Before You Diffuse: Infusing Physical Rules into Video Diffusion
  6. 2026Seeking Physics in Diffusion Noise
  7. 2026FlowCoMotion: Text-to-Motion Generation via Token-Latent Flow Modeling
  8. 2026A Kinetic Energy Perspective of Flow Matching