Hierarchical Surface Prediction for 3D Object Reconstruction
Not on the map. Why?
Abstract (arXiv)
Recently, Convolutional Neural Networks have shown promising results for 3D geometry prediction. They can make predictions from very little input data such as a single color image. A major limitation of such approaches is that they only predict a coarse resolution voxel grid, which does not capture the surface of the objects well. We propose a general framework, called hierarchical surface prediction (HSP), which facilitates prediction of high resolution voxel grids. The main insight is that it is sufficient to predict high resolution voxels around the predicted surfaces. The exterior and interior of the objects can be represented with coarse resolution voxels. Our approach is not dependent on a specific input type. We show results for geometry prediction from color images, depth images and shape completion from partial voxel grids. Our analysis shows that our high resolution predictions are more accurate than low resolution predictions.
Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 24; 2023: 25; 2024: 8; 2025: 3; 2026: 2.
89 papers.
Sort:
By area:
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2022POCO: Point Convolution for Surface Reconstructioncited by 91
- 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
- 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
38 more
- 2021SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networkscited by 59
- 2021Neural Fields as Learnable Kernels for 3D Reconstructioncited by 58
- 2021Neural Marching Cubescited by 50
- 20213D Shape Generation with Grid-based Implicit Functionscited by 48
- 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queriescited by 48
- 2022GIFS: Neural Implicit Function for General Shape Representationcited by 45
- 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
- 2021Octree Transformer: Autoregressive 3D Shape Generation on Hierarchically Structured Sequencescited by 38
- 2023Point-Cloud Completion with Pretrained Text-to-image Diffusion Modelscited by 37
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2021Learning Parallel Dense Correspondence from Spatio-Temporal Descriptors for Efficient and Robust 4D Reconstructioncited by 31
- 2022Shape, Pose, and Appearance from a Single Image via Bootstrapped Radiance Field Inversioncited by 30
- 2023Gaussian Splatting with NeRF-based Color and Opacitycited by 30
- 2021RetrievalFuse: Neural 3D Scene Reconstruction with a Databasecited by 28
- 2022SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminatorscited by 26
- 2022Pre-train, Self-train, Distill: A simple recipe for Supersizing 3D Reconstructioncited by 26
- 2021OctField: Hierarchical Implicit Functions for 3D Modelingcited by 25
- 2022Pixel2Mesh++: 3D Mesh Generation and Refinement from Multi-View Imagescited by 21
- 2022ALTO: Alternating Latent Topologies for Implicit 3D Reconstructioncited by 21
- 20213DIAS: 3D Shape Reconstruction with Implicit Algebraic Surfacescited by 17
- 2021NeeDrop: Self-supervised Shape Representation from Sparse Point Clouds using Needle Droppingcited by 16
- 2023Neural Vector Fields: Implicit Representation by Explicit Learningcited by 16
- 2021StrobeNet: Category-Level Multiview Reconstruction of Articulated Objectscited by 14
- 2021NeuralBlox: Real-Time Neural Representation Fusion for Robust Volumetric Mappingcited by 14
- 2022Primitive-based Shape Abstraction via Nonparametric Bayesian Inferencecited by 14
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2021AIR-Nets: An Attention-Based Framework for Locally Conditioned Implicit Representationscited by 13
- 2023ShaDDR: Interactive Example-Based Geometry and Texture Generation via 3D Shape Detailization and Differentiable Renderingcited by 13
- 2022Points2NeRF: Generating Neural Radiance Fields from 3D point cloudcited by 11
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Imagecited by 11
- 2023Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use casescited by 10
- 2024Pixel to Elevation: Learning to Predict Elevation Maps at Long Range using Images for Autonomous Offroad Navigationcited by 10
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentscited by 10
- 2023SCoDA: Domain Adaptive Shape Completion for Real Scanscited by 9
- 2024Planner3D: LLM-enhanced graph prior meets 3D indoor scene explicit regularizationcited by 9
- 2023Implicit Shape and Appearance Priors for Few-Shot Full Head Reconstructioncited by 8
- 2021LightSAL: Lightweight Sign Agnostic Learning for Implicit Surface Representationcited by 7
- 2021What's Behind the Couch? Directed Ray Distance Functions (DRDF) for 3D Scene Reconstructioncited by 7
50 most cited of 89 All 89 (JSON)
- 2026LoST: Level of Semantics Tokenization for 3D Shapes18 Mar 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2025GLVD: Guided Learned Vertex Descent7 Oct 2025
- 2025MARS: Mesh AutoRegressive Model for 3D Shape Detailization17 Feb 2025
- 2025Autoregressive Generation of Static and Growing Trees7 Feb 2025
- 2024GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representation23 Oct 2024
- 2024Underground Mapping and Localization Based on Ground-Penetrating Radar24 Sep 2024
- 2024Planner3D: LLM-enhanced graph prior meets 3D indoor scene explicit regularization19 Mar 2024
- 2024Pushing Auto-regressive Models for 3D Shape Generation at Capacity and Scalability19 Feb 2024
- 2024LISR: Learning Linear 3D Implicit Surface Representation Using Compactly Supported Radial Basis Functions11 Feb 2024
- 2024Oriented-grid Encoder for 3D Implicit Representations9 Feb 2024
- 2024HyperPlanes: Hypernetwork Approach to Rapid NeRF Adaptation2 Feb 2024
38 more
- 2024Pixel to Elevation: Learning to Predict Elevation Maps at Long Range using Images for Autonomous Offroad Navigation30 Jan 2024
- 2023Gaussian Splatting with NeRF-based Color and Opacity21 Dec 2023
- 2023LASA: Instance Reconstruction from Real Scans using A Large-scale Aligned Shape Annotation Dataset19 Dec 2023
- 2023SLS4D: Sparse Latent Space for 4D Novel View Synthesis15 Dec 2023
- 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queries6 Dec 2023
- 2023Two-stage Synthetic Supervising and Multi-view Consistency Self-supervising based Animal 3D Reconstruction by Single Image22 Nov 2023
- 2023Implicit Shape and Appearance Priors for Few-Shot Full Head Reconstruction12 Oct 2023
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Image22 Sep 2023
- 2023Neural Vector Fields: Generalizing Distance Vector Fields by Codebooks and Zero-Curl Regularization4 Sep 2023
- 2023Deep Learning for Visual Localization and Mapping: A Survey27 Aug 2023
- 2023Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use cases14 Aug 2023
- 20233D Semantic Subspace Traverser: Empowering 3D Generative Model with Shape Editing Capability26 Jul 2023
- 2023Adaptive Local Basis Functions for Shape Completion17 Jul 2023
- 2023Point-Cloud Completion with Pretrained Text-to-image Diffusion Models18 Jun 2023
- 2023NeuS-PIR: Learning Relightable Neural Surface using Pre-Integrated Rendering13 Jun 2023
- 2023ShaDDR: Interactive Example-Based Geometry and Texture Generation via 3D Shape Detailization and Differentiable Rendering8 Jun 2023
- 2023Neural Kernel Surface Reconstruction31 May 2023
- 2023Diffeomorphic Mesh Deformation via Efficient Optimal Transport for Cortical Surface Reconstruction27 May 2023
- 2023MultiPlaneNeRF: Neural Radiance Field with Non-Trainable Representation17 May 2023
- 2023SCoDA: Domain Adaptive Shape Completion for Real Scans20 Apr 2023
- 2023Learning Versatile 3D Shape Generation with Improved AR Models26 Mar 2023
- 2023NeRFlame: FLAME-based conditioning of NeRF for 3D face rendering10 Mar 2023
- 2023Neural Vector Fields: Implicit Representation by Explicit Learning8 Mar 2023
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methods6 Mar 2023
- 2023HyperNeRFGAN: Hypernetwork approach to 3D NeRF GAN27 Jan 2023
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan 2023
- 2022Learning Implicit Functions for Dense 3D Shape Correspondence of Generic Objects29 Dec 2022
- 2022ALTO: Alternating Latent Topologies for Implicit 3D Reconstruction8 Dec 2022
- 2022Shape, Pose, and Appearance from a Single Image via Bootstrapped Radiance Field Inversion21 Nov 2022
- 2022Deep Generative Models on 3D Representations: A Survey27 Oct 2022
- 2022Wheel Impact Test by Deep Learning: Prediction of Location and Magnitude of Maximum Stress3 Oct 2022
- 20223D Neural Sculpting (3DNS): Editing Neural Signed Distance Functions28 Sep 2022
- 2022Occupancy Planes for Single-view RGB-D Human Reconstruction4 Aug 2022
- 2022TreeSketchNet: From Sketch To 3D Tree Parameters Generation25 Jul 2022
- 2022Recovering Detail in 3D Shapes Using Disparity Maps1 Jul 2022
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes10 Jun 2022
- 2022CorticalFlow: A Diffeomorphic Mesh Deformation Module for Cortical Surface Reconstruction6 Jun 2022
- 2022Points2NeRF: Generating Neural Radiance Fields from 3D point cloud2 Jun 2022
50 newest of 89 All 89 (JSON)
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2022POCO: Point Convolution for Surface Reconstructioncited by 91
- 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
- 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
- 2021SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networkscited by 59
12 most cited of 86 All 86 (JSON)
- 2026LoST: Level of Semantics Tokenization for 3D Shapes18 Mar 2026
- 2025GLVD: Guided Learned Vertex Descent7 Oct 2025
- 2025MARS: Mesh AutoRegressive Model for 3D Shape Detailization17 Feb 2025
- 2025Autoregressive Generation of Static and Growing Trees7 Feb 2025
- 2024GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representation23 Oct 2024
- 2024Underground Mapping and Localization Based on Ground-Penetrating Radar24 Sep 2024
- 2024Planner3D: LLM-enhanced graph prior meets 3D indoor scene explicit regularization19 Mar 2024
- 2024Pushing Auto-regressive Models for 3D Shape Generation at Capacity and Scalability19 Feb 2024
- 2024LISR: Learning Linear 3D Implicit Surface Representation Using Compactly Supported Radial Basis Functions11 Feb 2024
- 2024Oriented-grid Encoder for 3D Implicit Representations9 Feb 2024
- 2024HyperPlanes: Hypernetwork Approach to Rapid NeRF Adaptation2 Feb 2024
- 2024Pixel to Elevation: Learning to Predict Elevation Maps at Long Range using Images for Autonomous Offroad Navigation30 Jan 2024
12 newest of 86 All 86 (JSON)