mlsanityData to 14 Oct 2026

ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video

arXiv 2604.07882 ↗First posted 9 Apr 2026cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Reconstructing non-rigid objects with physical plausibility remains a significant challenge. Existing approaches leverage differentiable rendering for per-scene optimization, recovering geometry and dynamics but requiring expensive tuning or manual annotation, which limits practicality and generalizability. To address this, we propose ReconPhys, the first feedforward framework that jointly learns physical attribute estimation and 3D Gaussian Splatting reconstruction from a single monocular video. Our method employs a dual-branch architecture trained via a self-supervised strategy, eliminating the need for ground-truth physics labels. Given a video sequence, ReconPhys simultaneously infers geometry, appearance, and physical attributes. Experiments on a large-scale synthetic dataset demonstrate superior performance: our method achieves 21.64 PSNR in future prediction compared to 13.27 by state-of-the-art optimization baselines, while reducing Chamfer Distance from 0.349 to 0.004. Crucially, ReconPhys enables fast inference (<1 second) versus hours required by existing methods, facilitating rapid generation of simulation-ready assets for robotics and graphics.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 40 of its 45 references that are in the map. First posted on arXiv 9 Apr 2026.

Builds on

40 of 45 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Segment Anythingcited by 8,234
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  6. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  7. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  8. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  9. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  10. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  11. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  12. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
28 more
  1. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  2. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  4. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
  5. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  6. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  7. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  8. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  9. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
  10. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  11. 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
  12. 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
  13. 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
  14. 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 97
  15. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
  16. 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
  17. 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generationcited by 69
  18. 2020Neural Deformation Graphs for Globally-consistent Non-rigid Reconstructioncited by 67
  19. 2022Learning Multi-Object Dynamics with Compositional Neural Radiance Fieldscited by 63
  20. 2021DiffPD: Differentiable Projective Dynamicscited by 62
  21. 2023Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstructioncited by 61
  22. 2023Learning Neural Constitutive Laws From Motion Observations for Generalizable PDE Dynamicscited by 57
  23. 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modelingcited by 43
  24. 2023Flow supervision for Deformable NeRFcited by 42
  25. 2023CoGS: Controllable Gaussian Splattingcited by 32
  26. 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
  27. 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modelingcited by 29
  28. 2025HumanDreamer-X: Photorealistic Single-image Human Avatars Reconstruction via Gaussian Restorationcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.