Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Training
Not on the map. Why?
Abstract (arXiv)
We present Fluid-Gen-Zero, a training-free framework for physics-aware fluid-object interaction video generation that decouples physical reasoning from appearance synthesis. Our key insight is to delegate motion dynamics to a physics simulator while preserving the appearance modeling capacity of pretrained video generators. We bridge these two domains through a two-level agentic workflow: generation-time planning, where a vision-language model (VLM) agent interprets intent and the simulation rollout to organize generation clips, and latent-space guidance, which injects simulation signals into denoising through region-aware latent wrapping. This plug-and-play design is compatible with current video foundation models. We further introduce a benchmark for fluid-object interaction video generation. Across Tora (CogVideoX-based), VACE and WanMove (Wan-based), Fluid-Gen-Zero consistently improves simulation alignment, reducing object trajectory error by 26.7%-81.5% and fluid fEPE (fluid flow endpoint error) by 67.9%-84.0%, while largely preserving perceptual quality. In a human preference study, raters favor Fluid-Gen-Zero in 55.1%-74.4% of same-backbone comparisons across three backbones, and in 90.4%-94.2% of comparisons against simulation-based methods. Code and data will be released upon acceptance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 50 references that are in the map. First posted on arXiv 7 Oct 2026.
Builds on
20 of 50 references.
References · 20
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
- 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
8 more
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
- 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 42
- 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 40
- 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 22
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 18
- 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoisingcited by 13
- 2026Physical Simulator In-the-Loop Video Generationcited by 12
- 2026PerpetualWonder: Long-Horizon Action-Conditioned 4D Scene Generationcited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026NEWTON: Agentic Planning for Physically Grounded Video Generation
- 2025Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinement
- 2026DeforM: Reasoning-Guided Physics-Aware Video Generation via Spatial-Temporal Masking
- 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
- 2026VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generation
- 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signals
- 2026Physics-Informed Video Generation via Mixture-of-Experts Latent Alignment