PhysMAS: Physics-Grounded Multi-Agent Synthesis of Compositional 4D Gaussians
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Efficient, fully automatic, and physically plausible 4D Gaussian synthesis is an important goal for dynamic scene generation. Recent physics-based methods couple 3D Gaussians with the Material Point Method (MPM) to generate physically driven motion, but extending this paradigm to heterogeneous multi-part objects and interacting multi-object scenes remains challenging. Object-level physical assignment collapses distinct parts into a single material state, while one-shot predictions from large language models, vision-language models, or agents neither reliably bind different materials to identified parts nor verify that the resulting MPM configuration is executable. Score Distillation Sampling (SDS)-based parameter optimization, meanwhile, requires repeated per-scene score evaluations and gradient backpropagation, incurring lengthy optimization and potentially yielding suboptimal or unstable solutions. We therefore present PhysMAS, a physics-grounded multi-agent framework. From a motion prompt and four scene views, an Object-Part Scene Agent establishes persistent identities and calls a Material Reasoning Agent for part-wise profiles. It invokes solver-aware skills to bind these identities and profiles to per-particle MPM fields and execute all objects in a shared domain; the framework then screens candidate forward-simulation results. This supports heterogeneous multi-part and interacting multi-object scenes without per-scene diffusion-score backpropagation. Extensive experiments demonstrate that, compared with recent physics-based 4D Gaussian baselines that rely on SDS, PhysMAS achieves better semantic alignment and perceived physical plausibility while requiring less runtime.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 36 of its 46 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
36 of 46 references.
Closest ancestors · 1
Same direction, newest first
- 2026PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedback7 Jun
Other references · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
23 more
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 128
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
- 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generationcited by 69
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
- 2024Animate3D: Animating Any 3D Model with Multi-view Video Diffusioncited by 56
- 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 41
- 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
- 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 32
- 2024GaussianProperty: Integrating Physical Properties to 3D Gaussians with LMMscited by 23
- 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulationcited by 20
- 2025DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interactioncited by 17
- 2025FreeGave: 3D Physics Learning from Dynamic Videos by Gaussian Velocitycited by 13
- 2025TRACE: Learning 3D Gaussian Physical Dynamics from Multi-view Videoscited by 11
- 2025PhysGM: Large Physical Gaussian Model for Feed-Forward 4D Synthesiscited by 10
- 2025PhysGS: Bayesian-Inferred Gaussian Splatting for Physical Property Estimationcited by 7
- 2026GaussianFluent: Gaussian Simulation for Dynamic Scenes with Mixed Materialscited by 7
- 2026MOSIV: Multi-Object System Identification from Videoscited by 6
- 2026MotionPhysics: Learnable Motion Distillation for Text-Guided Simulationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
- 2026PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D Composition
- 2026PhyScensis: Physics-Augmented LLM Agents for Complex Physical Scene Arrangement
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite
- 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception
- 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulation
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
- 2026PhysAgent: Reflective Agentic Physics Control for Physically Plausible Video Generation