GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstruction
Not on the map. Why?
Abstract (arXiv)
We present GO-Surf, a direct feature grid optimization method for accurate and fast surface reconstruction from RGB-D sequences. We model the underlying scene with a learned hierarchical feature voxel grid that encapsulates multi-level geometric and appearance local information. Feature vectors are directly optimized such that after being tri-linearly interpolated, decoded by two shallow MLPs into signed distance and radiance values, and rendered via surface volume rendering, the discrepancy between synthesized and observed RGB/depth values is minimized. Our supervision signals -- RGB, depth and approximate SDF -- can be obtained directly from input images without any need for fusion or post-processing. We formulate a novel SDF gradient regularization term that encourages surface smoothness and hole filling while maintaining high frequency details. GO-Surf can optimize sequences of 1-2K frames in 15-45 minutes, a speedup of ×60 over NeuralRGB-D, the most related approach based on an MLP representation, while maintaining on par performance on standard benchmarks. Project page: https://jingwenwang95.github.io/gosurf/
Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). Builds on 33 of its 41 references that are in the map. First posted on arXiv 29 Jun 2022.
Builds on
33 of 41 references.
References · 33
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
21 more
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Convolutional Occupancy Networkscited by 760
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 411
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
- 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 107
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
- 2022NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstructioncited by 99
- 2022ReLU Fields: The Little Non-linearity That Couldcited by 87
- 2020RoutedFusion: Learning Real-time Depth Map Fusioncited by 52
- 2021VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusioncited by 38
Built on by
Citing papers per year: 2022: 7; 2023: 18; 2024: 23; 2025: 10; 2026: 3.
61 papers.
Sort:
By area:
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2022Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstructioncited by 92
- 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
- 2023ENVIDR: Implicit Differentiable Renderer with Neural Environment Lightingcited by 63
- 2023PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigmcited by 56
- 2022Ponder: Point Cloud Pre-training via Neural Renderingcited by 50
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 46
38 more
- 2022SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural Representationscited by 44
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistencycited by 42
- 2023Multi-Modal Neural Radiance Field for Monocular Dense SLAM with a Light-Weight ToF Sensorcited by 30
- 2024SPA: 3D Spatial-Awareness Enables Effective Embodied Representationcited by 28
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observationscited by 27
- 2022PIXEL: Physics-Informed Cell Representations for Fast and Accurate PDE Solverscited by 22
- 2023Mirror-NeRF: Learning Neural Radiance Fields for Mirrors with Whitted-Style Ray Tracingcited by 22
- 2023NViST: In the Wild New View Synthesis from a Single Image with Transformerscited by 19
- 2024MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstructioncited by 18
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
- 2023MuSHRoom: Multi-Sensor Hybrid Room Dataset for Joint 3D Reconstruction and Novel View Synthesiscited by 12
- 2025NeRFPrior: Learning Neural Radiance Field as a Prior for Indoor Scene Reconstructioncited by 12
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priorscited by 11
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representationcited by 11
- 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphonescited by 10
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectivescited by 9
- 2023O2-Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Modelcited by 8
- 2025VTGaussian-SLAM: RGBD SLAM for Large Scale Scenes with Splatting View-Tied 3D Gaussianscited by 8
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-mapscited by 7
- 2024OpenOcc: Open Vocabulary 3D Scene Reconstruction via Occupancy Representationcited by 6
- 2024NC-SDF: Enhancing Indoor Scene Reconstruction Using Neural SDFs with View-Dependent Normal Compensationcited by 5
- 20233D Reconstruction with Generalizable Neural Fields using Scene Priorscited by 4
- 2023DynamicSurf: Dynamic Neural RGB-D Surface Reconstruction with an Optimizable Feature Gridcited by 4
- 2024CombiNeRF: A Combination of Regularization Techniques for Few-Shot Neural Radiance Field View Synthesiscited by 4
- 2025Learning 3D Scene Analogies with Neural Contextual Scene Mapscited by 4
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussianscited by 4
- 2023Dynamic Voxel Grid Optimization for High-Fidelity RGB-D Supervised Surface Reconstructioncited by 3
- 2023Indoor Scene Reconstruction with Fine-Grained Details Using Hybrid Representation and Normal Prior Enhancementcited by 3
- 2024Improving Neural Surface Reconstruction with Feature Priors from Multi-View Imagecited by 3
- 2023MorpheuS: Neural Dynamic 360deg Surface Reconstruction from Monocular RGB-D Videocited by 2
- 2024Behind the Veil: Enhanced Indoor 3D Scene Reconstruction with Occluded Surfaces Completioncited by 2
- 2024Distributed NeRF Learning for Collaborative Multi-Robot Perceptioncited by 2
- 2025RemixFusion: Residual-based Mixed Representation for Large-scale Online RGB-D Reconstructioncited by 2
- 2023InFusionSurf: Refining Neural RGB-D Surface Reconstruction Using Per-Frame Intrinsic Refinement and TSDF Fusion Prior Learningcited by 1
- 20243D Reconstruction and New View Synthesis of Indoor Environments based on a Dual Neural Radiance Fieldcited by 1
- 2024Stable Surface Regularization for Fast Few-Shot NeRFcited by 1
- 2024nu-DBA: Neural Implicit Dense Bundle Adjustment Enables Image-Only Driving Scene Reconstructioncited by 1
- 2024Category-level Neural Field for Reconstruction of Partially Observed Objects in Indoor Environmentcited by 1
50 most cited of 61 All 61 (JSON)
- 2026HIGS: Hierarchical Implicit Grids for Joint Geometric and Semantic Scene Understanding29 Sep 2026
- 2026Learning Structural Latent Points for Efficient Visual Representations in Robotic Manipulation20 May 2026
- 2026SGAD-SLAM: Splatting Gaussians at Adjusted Depth for Better Radiance Fields in RGBD SLAM22 Mar 2026
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussians29 Oct 2025
- 2025Leveraging 2D Priors and SDF Guidance for Dynamic Urban Scene Rendering15 Oct 2025
- 2025PreSem-Surf: RGB-D Surface Reconstruction with Progressive Semantic Modeling and SG-MLP Pre-Rendering Mechanism17 Aug 2025
- 2025RemixFusion: Residual-based Mixed Representation for Large-scale Online RGB-D Reconstruction23 Jul 2025
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representation23 Jun 2025
- 2025VTGaussian-SLAM: RGBD SLAM for Large Scale Scenes with Splatting View-Tied 3D Gaussians3 Jun 2025
- 2025FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representations28 Apr 2025
- 2025NeRFPrior: Learning Neural Radiance Field as a Prior for Indoor Scene Reconstruction24 Mar 2025
- 2025Learning 3D Scene Analogies with Neural Contextual Scene Maps20 Mar 2025
38 more
- 2025LiLMaps: Learnable Implicit Language Maps6 Jan 2025
- 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphones28 Nov 2024
- 2024SPA: 3D Spatial-Awareness Enables Effective Embodied Representation10 Oct 2024
- 2024Distributed NeRF Learning for Collaborative Multi-Robot Perception30 Sep 2024
- 2024Improving Neural Surface Reconstruction with Feature Priors from Multi-View Image4 Aug 2024
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priors23 Jul 2024
- 2024Category-level Neural Field for Reconstruction of Partially Observed Objects in Indoor Environment12 Jun 2024
- 2024NC-SDF: Enhancing Indoor Scene Reconstruction Using Neural SDFs with View-Dependent Normal Compensation1 May 2024
- 2024nu-DBA: Neural Implicit Dense Bundle Adjustment Enables Image-Only Driving Scene Reconstruction29 Apr 2024
- 2024HVOFusion: Incremental Mesh Reconstruction Using Hybrid Voxel Octree27 Apr 2024
- 2024LGSDF: Continual Global Learning of Signed Distance Fields Aided by Local Updating8 Apr 2024
- 2024Behind the Veil: Enhanced Indoor 3D Scene Reconstruction with Occluded Surfaces Completion3 Apr 2024
- 2024Stable Surface Regularization for Fast Few-Shot NeRF29 Mar 2024
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshing26 Mar 2024
- 2024MUTE-SLAM: Real-Time Neural SLAM with Multiple Tri-Plane Hash Representations26 Mar 2024
- 2024DeepMIF: Deep Monotonic Implicit Fields for Large-Scale LiDAR 3D Mapping26 Mar 2024
- 2024CombiNeRF: A Combination of Regularization Techniques for Few-Shot Neural Radiance Field View Synthesis21 Mar 2024
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-maps19 Mar 2024
- 2024OpenOcc: Open Vocabulary 3D Scene Reconstruction via Occupancy Representation18 Mar 2024
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observations29 Feb 2024
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closures14 Feb 2024
- 2024MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstruction6 Feb 2024
- 20243D Reconstruction and New View Synthesis of Indoor Environments based on a Dual Neural Radiance Field26 Jan 2024
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency17 Jan 2024
- 2023NViST: In the Wild New View Synthesis from a Single Image with Transformers13 Dec 2023
- 2023MorpheuS: Neural Dynamic 360deg Surface Reconstruction from Monocular RGB-D Video1 Dec 2023
- 2023DynamicSurf: Dynamic Neural RGB-D Surface Reconstruction with an Optimizable Feature Grid14 Nov 2023
- 2023MuSHRoom: Multi-Sensor Hybrid Room Dataset for Joint 3D Reconstruction and Novel View Synthesis5 Nov 2023
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priors17 Oct 2023
- 2023PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm12 Oct 2023
- 20233D Reconstruction with Generalizable Neural Fields using Scene Priors26 Sep 2023
- 2023Indoor Scene Reconstruction with Fine-Grained Details Using Hybrid Representation and Normal Prior Enhancement14 Sep 2023
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstruction5 Sep 2023
- 2023Multi-Modal Neural Radiance Field for Monocular Dense SLAM with a Light-Weight ToF Sensor28 Aug 2023
- 2023O2-Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Model18 Aug 2023
- 2023Mirror-NeRF: Learning Neural Radiance Fields for Mirrors with Whitted-Style Ray Tracing7 Aug 2023
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAM27 Apr 2023
- 2023Dynamic Voxel Grid Optimization for High-Fidelity RGB-D Supervised Surface Reconstruction12 Apr 2023
50 newest of 61 All 61 (JSON)
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2022Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstructioncited by 92
- 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
- 2023ENVIDR: Implicit Differentiable Renderer with Neural Environment Lightingcited by 63
- 2023PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigmcited by 56
- 2022Ponder: Point Cloud Pre-training via Neural Renderingcited by 50
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 46
12 most cited of 60 All 60 (JSON)
- 2026HIGS: Hierarchical Implicit Grids for Joint Geometric and Semantic Scene Understanding29 Sep 2026
- 2026Learning Structural Latent Points for Efficient Visual Representations in Robotic Manipulation20 May 2026
- 2026SGAD-SLAM: Splatting Gaussians at Adjusted Depth for Better Radiance Fields in RGBD SLAM22 Mar 2026
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussians29 Oct 2025
- 2025Leveraging 2D Priors and SDF Guidance for Dynamic Urban Scene Rendering15 Oct 2025
- 2025PreSem-Surf: RGB-D Surface Reconstruction with Progressive Semantic Modeling and SG-MLP Pre-Rendering Mechanism17 Aug 2025
- 2025RemixFusion: Residual-based Mixed Representation for Large-scale Online RGB-D Reconstruction23 Jul 2025
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representation23 Jun 2025
- 2025VTGaussian-SLAM: RGBD SLAM for Large Scale Scenes with Splatting View-Tied 3D Gaussians3 Jun 2025
- 2025FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representations28 Apr 2025
- 2025NeRFPrior: Learning Neural Radiance Field as a Prior for Indoor Scene Reconstruction24 Mar 2025
- 2025Learning 3D Scene Analogies with Neural Contextual Scene Maps20 Mar 2025
12 newest of 60 All 60 (JSON)