mlsanityData to 14 Oct 2026

Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Camera

arXiv 2206.15258 ↗First posted 30 Jun 2022cs.CV cs.GRcited by 57

Not on the map. Why?

Abstract (arXiv)

We propose Neural-DynamicReconstruction (NDR), a template-free method to recover high-fidelity geometry and motions of a dynamic scene from a monocular RGB-D camera. In NDR, we adopt the neural implicit function for surface representation and rendering such that the captured color and depth can be fully utilized to jointly optimize the surface and deformations. To represent and constrain the non-rigid deformations, we propose a novel neural invertible deforming network such that the cycle consistency between arbitrary two frames is automatically satisfied. Considering that the surface topology of dynamic scene might change over time, we employ a topology-aware strategy to construct the topology-variant correspondence for the fused frames. NDR also further refines the camera poses in a global optimization manner. Experiments on public datasets and our collected dataset demonstrate that NDR outperforms existing monocular dynamic reconstruction methods.

Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). Builds on 40 of its 76 references that are in the map. First posted on arXiv 30 Jun 2022.

Builds on

40 of 76 references.

References · 40

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2018Neural Ordinary Differential Equationscited by 3,779
  3. 2016Density estimation using Real NVPcited by 2,042
  4. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  6. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  7. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  8. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
  9. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
  10. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  11. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  12. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
28 more
  1. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
  2. 2018Invertible Residual Networkscited by 365
  3. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  4. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  5. 2021Neural RGB-D Surface Reconstructioncited by 313
  6. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
  7. 2019Learning Correspondence from the Cycle-Consistency of Timecited by 269
  8. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  9. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  10. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
  11. 2021Neural Head Avatars from Monocular RGB Videoscited by 213
  12. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
  13. 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 181
  14. 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
  15. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  16. 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 137
  17. 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
  18. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 116
  19. 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
  20. 2019DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Datacited by 77
  21. 2016VolumeDeform: Real-time Volumetric Non-rigid Reconstructioncited by 75
  22. 2020Fast and Robust Iterative Closest Pointcited by 67
  23. 2022CaDeX: Learning Canonical Deformation Coordinate Space for Dynamic Surface Representation via Neural Homeomorphismcited by 57
  24. 2020Neural Non-Rigid Trackingcited by 49
  25. 2019Deep Non-Rigid Structure from Motioncited by 38
  26. 2020ShapeFlow: Learnable Deformations Among 3D Shapescited by 28
  27. 2022OcclusionFusion: Occlusion-aware Motion Estimation for Real-time Dynamic 3D Reconstructioncited by 27
  28. 2021To The Point: Correspondence-driven monocular 3D category reconstructioncited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 25; 2024: 19; 2025: 9; 2026: 2.

57 papers.

Sort:

By area:

  1. 2023Tracking Everything Everywhere All at Oncecited by 193
  2. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 173
  3. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  4. 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
  5. 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 70
  6. 2023EndoSurf: Neural Surface Reconstruction of Deformable Tissues with Stereo Endoscope Videoscited by 69
  7. 2022NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactionscited by 68
  8. 2023Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstructioncited by 61
  9. 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
  10. 2024Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian Splattingcited by 49
  11. 2023Flow supervision for Deformable NeRFcited by 42
  12. 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 39
38 more
  1. 2024Vidu4D: Single Generated Video to High-Fidelity 4D Reconstruction with Dynamic Gaussian Surfelscited by 38
  2. 2023Relightable and Animatable Neural Avatar from Sparse-View Videocited by 28
  3. 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videoscited by 28
  4. 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
  5. 2023ResFields: Residual Neural Fields for Spatiotemporal Signalscited by 27
  6. 2023Instant-NVR: Instant Neural Volumetric Rendering for Human-object Interactions from Monocular RGBD Streamcited by 23
  7. 2023Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesiscited by 20
  8. 2023NViST: In the Wild New View Synthesis from a Single Image with Transformerscited by 19
  9. 20254DTAM: Non-Rigid Tracking and Mapping via Dynamic Surface Gaussianscited by 13
  10. 2023SceNeRFlow: Time-Consistent Reconstruction of General Dynamic Scenescited by 11
  11. 2023MV-DeepSDF: Implicit Modeling with Multi-Sweep Point Clouds for 3D Vehicle Reconstruction in Autonomous Drivingcited by 11
  12. 2025TRACE: Learning 3D Gaussian Physical Dynamics from Multi-view Videoscited by 11
  13. 2023Root Pose Decomposition Towards Generic Non-rigid 3D Reconstruction with Monocular Videoscited by 8
  14. 20243D LiDAR Mapping in Dynamic Environments Using a 4D Implicit Neural Representationcited by 8
  15. 2025DASH: 4D Hash Encoding with Self-Supervised Decomposition for Real-Time Dynamic Scene Renderingcited by 8
  16. 2024UrbanGS: Semantic-Guided Gaussian Splatting for Urban Scene Reconstructioncited by 7
  17. 2024High-Quality Mesh Blendshape Generation from Face Videos via Neural Inverse Renderingcited by 6
  18. 2024Space-time 2D Gaussian Splatting for Accurate Surface Reconstruction under Complex Dynamic Scenescited by 6
  19. 20233D Video Loops from Asynchronous Inputcited by 5
  20. 2023TiAVox: Time-aware Attenuation Voxels for Sparse-view 4D DSA Reconstructioncited by 5
  21. 2024Implicit-ARAP: Efficient Handle-Guided Neural Field Deformation via Local Patch Meshingcited by 5
  22. 20244DRecons: 4D Neural Implicit Deformable Objects Reconstruction from a single RGB-D Camera with Geometrical and Topological Regularizationscited by 5
  23. 2024Invertible Neural Warp for NeRFcited by 5
  24. 2024Adaptive and Temporally Consistent Gaussian Surfels for Multi-view Dynamic Reconstructioncited by 5
  25. 2025Video4DGen: Enhancing Video and 4D Generation through Mutual Optimizationcited by 5
  26. 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Fieldcited by 5
  27. 2023Factored Neural Representation for Scene Understandingcited by 4
  28. 2023L0-Sampler: An L0 Model Guided Volume Sampling for NeRFcited by 4
  29. 2023DynamicSurf: Dynamic Neural RGB-D Surface Reconstruction with an Optimizable Feature Gridcited by 4
  30. 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
  31. 2023Retargeting Visual Data with Deformation Fieldscited by 3
  32. 2025UnIRe: Unsupervised Instance Decomposition for Dynamic Urban Scene Reconstructioncited by 3
  33. 2023MorpheuS: Neural Dynamic 360deg Surface Reconstruction from Monocular RGB-D Videocited by 2
  34. 2024TFS-NeRF: Template-Free NeRF for Semantic 3D Reconstruction of Dynamic Scenecited by 2
  35. 2023Invertible Neural Skinningcited by 1
  36. 2023Weakly-Supervised 3D Reconstruction of Clothed Humans via Normal Mapscited by 1
  37. 2024SPARE: Symmetrized Point-to-Plane Distance for Robust Non-Rigid 3D Registrationcited by 1
  38. 2025Capturing Head Avatar with Hand Contacts from a Monocular Videocited by 1

50 most cited of 57 All 57 (JSON)