Vox-Surf: Voxel-based Implicit Surface Representation
Not on the map. Why?
Abstract (arXiv)
Virtual content creation and interaction play an important role in modern 3D applications such as AR and VR. Recovering detailed 3D models from real scenes can significantly expand the scope of its applications and has been studied for decades in the computer vision and computer graphics community. We propose Vox-Surf, a voxel-based implicit surface representation. Our Vox-Surf divides the space into finite bounded voxels. Each voxel stores geometry and appearance information in its corner vertices. Vox-Surf is suitable for almost any scenario thanks to sparsity inherited from voxel representation and can be easily trained from multiple view images. We leverage the progressive training procedure to extract important voxels gradually for further optimization so that only valid voxels are preserved, which greatly reduces the number of sampling points and increases rendering speed.The fine voxels can also be considered as the bounding volume for collision detection.The experiments show that Vox-Surf representation can learn delicate surface details and accurate color with less memory and faster rendering speed than other methods.We also show that Vox-Surf can be more practical in scene editing and AR applications.
Key facts. Cited by 49 papers in the map (data through 14 Oct 2026). Builds on 30 of its 44 references that are in the map. First posted on arXiv 21 Aug 2022.
Builds on
30 of 44 references.
References · 30
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2020Neural Sparse Voxel Fieldscited by 959
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
18 more
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2016Direct Sparse Odometrycited by 485
- 2017Neural 3D Mesh Renderercited by 437
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2021Urban Radiance Fieldscited by 263
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
- 2019Pix2Vox: Context-aware 3D Reconstruction from Single and Multi-view Imagescited by 164
- 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 137
- 2017Learning Efficient Point Cloud Generation for Dense 3D Object Reconstructioncited by 133
- 2022Neural 3D Reconstruction in the Wildcited by 79
Built on by
Citing papers per year: 2022: 1; 2023: 16; 2024: 15; 2025: 14; 2026: 3.
49 papers.
Sort:
By area:
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 184
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 138
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 43
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 33
- 2023CP-SLAM: Collaborative Neural Point-based SLAM Systemcited by 32
- 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstructioncited by 24
37 more
- 2023Mirror-NeRF: Learning Neural Radiance Fields for Mirrors with Whitted-Style Ray Tracingcited by 22
- 2024NIS-SLAM: Neural Implicit Semantic RGB-D SLAM for 3D Consistent Scene Understandingcited by 19
- 2023ECNR: Efficient Compressive Neural Representation of Time-Varying Volumetric Datasetscited by 17
- 2025PanoGS: Gaussian-based Panoptic Segmentation for 3D Open Vocabulary Scene Understandingcited by 16
- 2025TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priorscited by 14
- 2023GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Cloudscited by 11
- 2024ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstructioncited by 11
- 2024MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Stepcited by 11
- 2023RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environmentscited by 9
- 2024O2V-Mapping: Online Open-Vocabulary Mapping with Neural Implicit Representationcited by 9
- 2023FaceDNeRF: Semantics-Driven Face Reconstruction, Prompt Editing and Relighting with Diffusion Modelscited by 7
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-mapscited by 7
- 2024OmniSDF: Scene Reconstruction using Omnidirectional Signed Distance Functions and Adaptive Binoctreescited by 6
- 2024Sur2f: A Hybrid Representation for High-Quality and Efficient Surface Reconstruction from Multi-view Imagescited by 5
- 2025NeuraLoc: Visual Localization in Neural Implicit Map with Dual Complementary Featurescited by 5
- 2023InstantAvatar: Efficient 3D Head Reconstruction via Surface Renderingcited by 4
- 2024PSDF: Prior-Driven Neural Implicit Surface Learning for Multi-view Reconstructioncited by 4
- 2025SP-SLAM: Neural Real-Time Dense SLAM With Scene Priorscited by 4
- 2025Car-GS: Addressing Reflective and Transparent Surface Challenges in 3D Car Reconstructioncited by 4
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussianscited by 4
- 2023PG-NeuS: Robust and Efficient Point Guidance for Multi-View Neural Surface Reconstructioncited by 3
- 2024GBR: Generative Bundle Refinement for High-fidelity Gaussian Splatting with Enhanced Mesh Reconstructioncited by 3
- 2025Thermoxels: a voxel-based method to generate simulation-ready 3D thermal modelscited by 3
- 2026OnlinePG: Online Open-Vocabulary Panoptic Mapping with 3D Gaussian Splattingcited by 2
- 2025NeRFlex: Resource-aware Real-time High-quality Rendering of Complex Scenes on Mobile Devicescited by 1
- 2025FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representationscited by 1
- 2025Geometric Prior-Guided Neural Implicit Surface Reconstruction in the Wildcited by 1
- 2025Camera Pose Refinement via 3D Gaussian Splattingcited by 1
- 2026Advancing Structured Priors for Sparse-Voxel Surface Reconstructioncited by 1
- 2024LGSDF: Continual Global Learning of Signed Distance Fields Aided by Local Updatingcited by 0
- 2024DF-SLAM: Dictionary Factors Representation for High-Fidelity Neural Implicit Dense Visual SLAM Systemcited by 0
- 2024VoxNeuS: Enhancing Voxel-Based Neural Surface Reconstruction via Gradient Interpolationcited by 0
- 2024A Comparative Study of Neural Surface Reconstruction for Scientific Visualizationcited by 0
- 2025Accurate and Complete Surface Reconstruction from 3D Gaussians via Direct SDF Learningcited by 0
- 2025GS-2M: Material-aware Gaussian Splatting for High-fidelity Mesh Reconstructioncited by 0
- 2025CUS-GS: A Compact Unified Structured Gaussian Splatting Framework for Multimodal Scene Representationcited by 0
- 2026Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimizationcited by 0
- 2026Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimization11 Aug 2026
- 2026OnlinePG: Online Open-Vocabulary Panoptic Mapping with 3D Gaussian Splatting19 Mar 2026
- 2026Advancing Structured Priors for Sparse-Voxel Surface Reconstruction25 Jan 2026
- 2025CUS-GS: A Compact Unified Structured Gaussian Splatting Framework for Multimodal Scene Representation22 Nov 2025
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussians29 Oct 2025
- 2025GS-2M: Material-aware Gaussian Splatting for High-fidelity Mesh Reconstruction26 Sep 2025
- 2025Accurate and Complete Surface Reconstruction from 3D Gaussians via Direct SDF Learning9 Sep 2025
- 2025Camera Pose Refinement via 3D Gaussian Splatting25 Aug 2025
- 2025Geometric Prior-Guided Neural Implicit Surface Reconstruction in the Wild12 May 2025
- 2025FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representations28 Apr 2025
- 2025TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priors17 Apr 2025
- 2025Thermoxels: a voxel-based method to generate simulation-ready 3D thermal models6 Apr 2025
37 more
- 2025NeRFlex: Resource-aware Real-time High-quality Rendering of Complex Scenes on Mobile Devices4 Apr 2025
- 2025PanoGS: Gaussian-based Panoptic Segmentation for 3D Open Vocabulary Scene Understanding23 Mar 2025
- 2025NeuraLoc: Visual Localization in Neural Implicit Map with Dual Complementary Features8 Mar 2025
- 2025Car-GS: Addressing Reflective and Transparent Surface Challenges in 3D Car Reconstruction19 Jan 2025
- 2025SP-SLAM: Neural Real-Time Dense SLAM With Scene Priors11 Jan 2025
- 2024GBR: Generative Bundle Refinement for High-fidelity Gaussian Splatting with Enhanced Mesh Reconstruction8 Dec 2024
- 2024MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Step2 Nov 2024
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Reality21 Sep 2024
- 2024ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstruction22 Aug 2024
- 2024A Comparative Study of Neural Surface Reconstruction for Scientific Visualization30 Jul 2024
- 2024NIS-SLAM: Neural Implicit Semantic RGB-D SLAM for 3D Consistent Scene Understanding30 Jul 2024
- 2024VoxNeuS: Enhancing Voxel-Based Neural Surface Reconstruction via Gradient Interpolation11 Jun 2024
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction10 Jun 2024
- 2024DF-SLAM: Dictionary Factors Representation for High-Fidelity Neural Implicit Dense Visual SLAM System27 Apr 2024
- 2024O2V-Mapping: Online Open-Vocabulary Mapping with Neural Implicit Representation10 Apr 2024
- 2024LGSDF: Continual Global Learning of Signed Distance Fields Aided by Local Updating8 Apr 2024
- 2024OmniSDF: Scene Reconstruction using Omnidirectional Signed Distance Functions and Adaptive Binoctrees31 Mar 2024
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-maps19 Mar 2024
- 2024PSDF: Prior-Driven Neural Implicit Surface Learning for Multi-view Reconstruction23 Jan 2024
- 2024Sur2f: A Hybrid Representation for High-Quality and Efficient Surface Reconstruction from Multi-view Images8 Jan 2024
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance1 Dec 2023
- 2023CP-SLAM: Collaborative Neural Point-based SLAM System14 Nov 2023
- 2023RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments23 Oct 2023
- 2023PG-NeuS: Robust and Efficient Point Guidance for Multi-View Neural Surface Reconstruction12 Oct 2023
- 2023ECNR: Efficient Compressive Neural Representation of Time-Varying Volumetric Datasets2 Oct 2023
- 2023GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Clouds25 Aug 2023
- 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstruction17 Aug 2023
- 2023InstantAvatar: Efficient 3D Head Reconstruction via Surface Rendering9 Aug 2023
- 2023Mirror-NeRF: Learning Neural Radiance Fields for Mirrors with Whitted-Style Ray Tracing7 Aug 2023
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Views8 Jun 2023
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstruction5 Jun 2023
- 2023FaceDNeRF: Semantics-Driven Face Reconstruction, Prompt Editing and Relighting with Diffusion Models1 Jun 2023
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images27 May 2023
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAM27 Apr 2023
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field23 Mar 2023
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Images21 Mar 2023
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation28 Oct 2022
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 184
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 138
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 43
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 33
- 2023CP-SLAM: Collaborative Neural Point-based SLAM Systemcited by 32
- 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstructioncited by 24
12 most cited of 48 All 48 (JSON)
- 2026Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimization11 Aug 2026
- 2026OnlinePG: Online Open-Vocabulary Panoptic Mapping with 3D Gaussian Splatting19 Mar 2026
- 2026Advancing Structured Priors for Sparse-Voxel Surface Reconstruction25 Jan 2026
- 2025CUS-GS: A Compact Unified Structured Gaussian Splatting Framework for Multimodal Scene Representation22 Nov 2025
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussians29 Oct 2025
- 2025GS-2M: Material-aware Gaussian Splatting for High-fidelity Mesh Reconstruction26 Sep 2025
- 2025Accurate and Complete Surface Reconstruction from 3D Gaussians via Direct SDF Learning9 Sep 2025
- 2025Camera Pose Refinement via 3D Gaussian Splatting25 Aug 2025
- 2025Geometric Prior-Guided Neural Implicit Surface Reconstruction in the Wild12 May 2025
- 2025FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representations28 Apr 2025
- 2025TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priors17 Apr 2025
- 2025Thermoxels: a voxel-based method to generate simulation-ready 3D thermal models6 Apr 2025
12 newest of 48 All 48 (JSON)