ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video
Not on the map. Why?
Abstract (arXiv)
Reconstructing non-rigid objects with physical plausibility remains a significant challenge. Existing approaches leverage differentiable rendering for per-scene optimization, recovering geometry and dynamics but requiring expensive tuning or manual annotation, which limits practicality and generalizability. To address this, we propose ReconPhys, the first feedforward framework that jointly learns physical attribute estimation and 3D Gaussian Splatting reconstruction from a single monocular video. Our method employs a dual-branch architecture trained via a self-supervised strategy, eliminating the need for ground-truth physics labels. Given a video sequence, ReconPhys simultaneously infers geometry, appearance, and physical attributes. Experiments on a large-scale synthetic dataset demonstrate superior performance: our method achieves 21.64 PSNR in future prediction compared to 13.27 by state-of-the-art optimization baselines, while reducing Chamfer Distance from 0.349 to 0.004. Crucially, ReconPhys enables fast inference (<1 second) versus hours required by existing methods, facilitating rapid generation of simulation-ready assets for robotics and graphics.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 40 of its 45 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
40 of 45 references.
References · 40
- 2017Attention Is All You Needcited by 60,361
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
28 more
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
- 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 97
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
- 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generationcited by 69
- 2020Neural Deformation Graphs for Globally-consistent Non-rigid Reconstructioncited by 67
- 2022Learning Multi-Object Dynamics with Compositional Neural Radiance Fieldscited by 63
- 2021DiffPD: Differentiable Projective Dynamicscited by 62
- 2023Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstructioncited by 61
- 2023Learning Neural Constitutive Laws From Motion Observations for Generalizable PDE Dynamicscited by 57
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modelingcited by 43
- 2023Flow supervision for Deformable NeRFcited by 42
- 2023CoGS: Controllable Gaussian Splattingcited by 32
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modelingcited by 29
- 2025HumanDreamer-X: Photorealistic Single-image Human Avatars Reconstruction via Gaussian Restorationcited by 13
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearchcited by 11
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026MatPhys: Learning Material-Aware Physics Parameters for Deformable Object Simulation from Videoscited by 1
- 2026Future Rendering neq Future Surface: A Benchmark and Dataset for Dynamic Surface Reconstruction Beyond the Observed Windowcited by 0
- 2026KnockGS:interaction-Grounded Calibrationof Physical Gaussian Representationscited by 0
- 2026KnockGS:interaction-Grounded Calibrationof Physical Gaussian Representations27 Aug 2026
- 2026Future Rendering neq Future Surface: A Benchmark and Dataset for Dynamic Surface Reconstruction Beyond the Observed Window23 Jul 2026
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch15 Jul 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026MatPhys: Learning Material-Aware Physics Parameters for Deformable Object Simulation from Videos19 May 2026