mlsanityData to 14 Oct 2026

UniPixie: Unified and Probabilistic 3D Physics Learning via Flow Matching

arXiv 2606.05399 ↗First posted 3 Jun 2026cs.CVcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

Existing feed-forward networks excel at predicting a single set of physical properties from visual appearance, but this point-estimate paradigm fundamentally fails to capture the real world's inherent physical ambiguity. We address this by reframing physics prediction as a task of learning a controllable, continuous distribution of material properties. We introduce UNIPIXIE, a framework trained to predict a continuous and parameterized path of physically plausible material properties from a single visual input. By learning a direct mapping along an object's softest-to-stiffest spectrum on our PIXIEMULTIVERSE dataset, UNIPIXIE allows for controllable generation of diverse, physically valid material fields via a single intuitive parameter. Crucially, UNIPIXIE introduces a novel unified architecture to produce simulation-ready parameters for diverse physics solvers, including continuum-based Material Point Method (MPM), reduced-order deformation based on Linear Blend Skinning (LBS), and anchor-based Spring-Mass systems, addressing a key portability issue in prior work. Experiments show our approach not only generates a rich variety of plausible dynamics but also reduces Young's Modulus prediction error by over 50% against the strongest deterministic baseline, bridging the gap between static point estimates and the continuous nature of physical reality. Project page: https://unipixie.github.io/

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 23 of its 33 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

23 of 33 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation24 Sep
  2. 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priors3 Jun

Other references · 21

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  6. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  7. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  8. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  9. 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
  10. 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
  11. 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 97
  12. 2023Generative Image Dynamicscited by 94
9 more
  1. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
  2. 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generationcited by 69
  3. 2024Physical Property Understanding from Language-Embedded Feature Fieldscited by 48
  4. 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 45
  5. 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
  6. 2024Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulationcited by 27
  7. 2025PUGS: Zero-shot Physical Understanding with Gaussian Splattingcited by 24
  8. 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 24
  9. 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulationcited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion
  2. 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition
  3. 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics
  4. 2026MotionPhysics: Learnable Motion Distillation for Text-Guided Simulation
  5. 2026MPMWorlds: Material-Point-Method Simulations for Inferring and Extrapolating Physical Dynamics
  6. 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception
  7. 2026Diffusion-Based Material Regularization for Physics-Based Inverse Rendering
  8. 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite