mlsanityData to 7 Oct 2026

Physics-Grounded Fluid Video Generation with a Simulation Dataset and Dual-Stream Optical-Flow Supervision

arXiv 2607.25321 ↗First posted 28 Jul 2026cs.AIcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video diffusion models generate visually compelling content but routinely violate elementary physics when the subject involves fluids: liquid columns break apart in mid-air, container water levels fail to rise as liquid is poured in, and splashes disperse without regard to momentum or gravity. We attribute this gap to the fact that large-scale video-text corpora contain almost no explicit motion supervision, so models learn to imitate fluid appearance rather than dynamics. We address this with two contributions. First, we build a physics-simulation fluid dataset combining 1,638 MPM-simulated pouring/sloshing videos with 2,320 keyword-filtered real pouring videos mined from stock footage, plus two held-out test sets: a 1,515-video real-video benchmark and an 18-prompt text-to-first-frame generalization benchmark. Second, we introduce a dual-stream image-to-video architecture built on a pretrained diffusion-transformer video generator. It augments the standard RGB decoder with a lightweight Optical-Flow Decoder branch trained with explicit end-point-error and smoothness losses, fused into the RGB stream via zero-initialized convolutions so the pretrained backbone starts undisturbed. Only the two decoders are updated; the encoder, temporal transformer, and text encoder remain frozen. Across two model scales (1.3B and 14B) and two test sets, our method improves VideoPhy-2 Physical-Commonsense and Video-Quality scores over the frozen backbone by up to 8.75 and 4.65 points, outperforms a leading open competitor, and is preferred by human raters in a blind study. A direct optical-flow read-out evaluation further shows an end-point error as low as 0.54 pixels in-distribution, confirming the model has internalized a coherent motion prior rather than merely improving surface appearance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 20 of its 22 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

20 of 22 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  2. 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priors3 Jun
  3. 2022Video Diffusion Models7 Apr

Other references · 17

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  3. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  4. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  5. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  6. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
  7. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
  8. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
  9. 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 34
  10. 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perceptioncited by 23
  11. 2025Integrating Reinforcement Learning with Visual Generative Models: Foundations and Advancescited by 11
  12. 2025Seeing What Matters: Visual Preference Policy Optimization for Visual Generationcited by 9
5 more
  1. 2026TeleBoost: A Systematic Alignment Framework for High-Fidelity, Controllable, and Robust Video Generationcited by 5
  2. 2025Learning What to Trust: Bayesian Prior-Guided Optimization for Visual Generationcited by 4
  3. 2026Reward-Aware Trajectory Shaping for Few-step Visual Generationcited by 1
  4. 2026Learning to Credit the Right Steps: Objective-aware Process Optimization for Visual Generationcited by 1
  5. 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligencecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Physics-Informed Video Diffusion For Shallow Water Equations
  2. 2025Sketch-based Fluid Video Generation Using Motion-Guided Diffusion Models in Still Landscape Images
  3. 2026Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Training
  4. 2026SurfPhase: 3D Interfacial Dynamics in Two-Phase Flows from Sparse Videos
  5. 2025FluidNexus: 3D Fluid Reconstruction and Prediction from a Single Video
  6. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation
  7. 2025Think Before You Diffuse: Infusing Physical Rules into Video Diffusion
  8. 2026MotionPhysics: Learnable Motion Distillation for Text-Guided Simulation