mlsanityData to 7 Oct 2026

Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Training

arXiv 2610.10984 ↗First posted 7 Oct 2026cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

We present Fluid-Gen-Zero, a training-free framework for physics-aware fluid-object interaction video generation that decouples physical reasoning from appearance synthesis. Our key insight is to delegate motion dynamics to a physics simulator while preserving the appearance modeling capacity of pretrained video generators. We bridge these two domains through a two-level agentic workflow: generation-time planning, where a vision-language model (VLM) agent interprets intent and the simulation rollout to organize generation clips, and latent-space guidance, which injects simulation signals into denoising through region-aware latent wrapping. This plug-and-play design is compatible with current video foundation models. We further introduce a benchmark for fluid-object interaction video generation. Across Tora (CogVideoX-based), VACE and WanMove (Wan-based), Fluid-Gen-Zero consistently improves simulation alignment, reducing object trajectory error by 26.7%-81.5% and fluid fEPE (fluid flow endpoint error) by 67.9%-84.0%, while largely preserving perceptual quality. In a human preference study, raters favor Fluid-Gen-Zero in 55.1%-74.4% of same-backbone comparisons across three backbones, and in 90.4%-94.2% of comparisons against simulation-based methods. Code and data will be released upon acceptance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 50 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

20 of 50 references.

References · 20

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  4. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  5. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  6. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  7. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
  8. 2025HunyuanVideo 1.5 Technical Reportcited by 148
  9. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
  10. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  11. 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
  12. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
8 more
  1. 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
  2. 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 42
  3. 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 40
  4. 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 22
  5. 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 18
  6. 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoisingcited by 13
  7. 2026Physical Simulator In-the-Loop Video Generationcited by 12
  8. 2026PerpetualWonder: Long-Horizon Action-Conditioned 4D Scene Generationcited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026NEWTON: Agentic Planning for Physically Grounded Video Generation
  2. 2025Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinement
  3. 2026DeforM: Reasoning-Guided Physics-Aware Video Generation via Spatial-Temporal Masking
  4. 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization
  5. 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
  6. 2026VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generation
  7. 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signals
  8. 2026Physics-Informed Video Generation via Mixture-of-Experts Latent Alignment