Local Implicit Grid Representations for 3D Scenes
Not on the map. Why?
Abstract (arXiv)
Shape priors learned from data are commonly used to reconstruct 3D objects from partial or noisy data. Yet no such shape priors are available for indoor scenes, since typical 3D autoencoders cannot handle their scale, complexity, or diversity. In this paper, we introduce Local Implicit Grid Representations, a new 3D shape representation designed for scalability and generality. The motivating idea is that most 3D surfaces share geometric details at some scale -- i.e., at a scale smaller than an entire object and larger than a small patch. We train an autoencoder to learn an embedding of local crops of 3D shapes at that size. Then, we use the decoder as a component in a shape optimization that solves for a set of latent codes on a regular grid of overlapping crops such that an interpolation of the decoded local shapes matches a partial or noisy observation. We demonstrate the value of this proposed approach for 3D surface reconstruction from sparse point observations, showing significantly better results than alternative approaches.
Key facts. Cited by 372 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 87; 2022: 100; 2023: 96; 2024: 59; 2025: 27; 2026: 3.
372 papers.
Sort:
By area:
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
- 2021Advances in Neural Renderingcited by 365
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
38 more
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
- 2021NeRV: Neural Representations for Videoscited by 255
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2021Neural Articulated Radiance Fieldcited by 196
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2021Shape As Points: A Differentiable Poisson Solvercited by 186
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 142
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
- 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
- 2021Local Texture Estimator for Implicit Representation Functioncited by 126
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2023NeRF-DS: Neural Radiance Fields for Dynamic Specular Objectscited by 110
- 2021Light Field Neural Renderingcited by 108
- 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 107
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2021Neural Lumigraph Renderingcited by 105
- 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 102
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 92
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2022POCO: Point Convolution for Surface Reconstructioncited by 91
- 2021The Power of Points for Modeling Humans in Clothingcited by 90
- 2021Generative Models as Distributions of Functionscited by 89
- 2022ReLU Fields: The Little Non-linearity That Couldcited by 87
- 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
- 2022GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimationcited by 86
- 2021Pointly-Supervised Instance Segmentationcited by 83
- 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
- 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 76
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 2022Neural Dual Contouringcited by 71
50 most cited of 372 All 372 (JSON)
- 2026OptimusMesh: Compact Autoregressive Mesh Generation from Point Clouds via Sparse Latent Pivots1 Oct 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2026Learning Positive-Incentive Point Sampling in Neural Implicit Fields for Object Pose Estimation23 Feb 2026
- 20253DProxyImg: Controllable 3D-Aware Animation Synthesis from Single Image via 2D-3D Aligned Proxy Embedding17 Dec 2025
- 2025Arbitrary-Resolution and Arbitrary-Scale Face Super-Resolution with Implicit Representation Networks20 Nov 2025
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025SBS: Enhancing Parameter-Efficiency of Neural Representations for Neural Networks via Spectral Bias Suppression9 Sep 2025
- 2025T-MLP: Tailed Multi-Layer Perceptron for Level-of-Detail Signal Representation26 Aug 2025
- 2025MeshSplat: Generalizable Sparse-View Surface Reconstruction via Gaussian Splatting25 Aug 2025
- 2025SurfR: Surface Reconstruction with Multi-scale Attention10 Jun 2025
- 2025Squeeze3D: Extreme Neural Compression with Latent Space Bridging9 Jun 2025
- 2025Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistency9 Jun 2025
38 more
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectives21 May 2025
- 2025NeuGen: Amplifying the 'Neural' in Neural Radiance Fields for Domain Generalization11 May 2025
- 2025Efficient Neural Video Representation with Temporally Coherent Modulation1 May 2025
- 2025Frequency-Integrated Transformer for Arbitrary-Scale Super-Resolution26 Apr 2025
- 2025Cross-Frequency Implicit Neural Representation with Self-Evolving Parameters15 Apr 2025
- 2025Exploring Kernel Transformations for Implicit Neural Representations7 Apr 2025
- 2025Bi-Grid Reconstruction for Image Anomaly Detection1 Apr 2025
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation31 Mar 2025
- 2025GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusion28 Mar 2025
- 2025ARC: Anchored Representation Clouds for High-Resolution INR Classification19 Mar 2025
- 2025Mixed-granularity Implicit Representation for Continuous Hyperspectral Compressive Reconstruction17 Mar 2025
- 2025Human-in-the-Loop Local Corrections of 3D Scene Layouts via Infilling14 Mar 2025
- 2025MetricGrids: Arbitrary Nonlinear Approximation with Elementary Metric Grids based Implicit Neural Representation13 Mar 2025
- 2025GaussianVideo: Efficient Video Representation and Compression by Gaussian Splatting6 Mar 2025
- 2025Towards Lossless Implicit Neural Representation via Bit Plane Decomposition28 Feb 2025
- 2025Adversarial Attacks in Weight-Space Classifiers27 Feb 2025
- 2025Implicit Neural Representations of Molecular Vector-Valued Functions15 Feb 2025
- 2025Procedural Generation of 3D Maize Plant Architecture from LIDAR Data21 Jan 2025
- 2024Toward Robust Neural Reconstruction from Sparse Point Sets20 Dec 2024
- 2024Implicit Neural Compression of Point Clouds11 Dec 2024
- 20243D-WAG: Hierarchical Wavelet-Guided Autoregressive Generation for High-Fidelity 3D Shapes28 Nov 2024
- 2024Multiscale Corrections by Continuous Super-Resolution12 Nov 2024
- 2024LoFi: Neural Local Fields for Scalable Image Reconstruction7 Nov 2024
- 2024MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Step2 Nov 2024
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors25 Oct 2024
- 2024Monge-Ampere Regularization for Learning Arbitrary Shapes from Point Clouds24 Oct 2024
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Set18 Oct 2024
- 2024Object Pose Estimation Using Implicit Representation For Transparent Objects17 Oct 2024
- 2024Towards Croppable Implicit Neural Representations28 Sep 2024
- 2024Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materials23 Sep 2024
- 2024BurstM: Deep Burst Multi-scale SR using Fourier Space with Optical Flow21 Sep 2024
- 2024Spectral-GS: Taming 3D Gaussian Splatting with Spectral Entropy19 Sep 2024
- 2024LT3SD: Latent Trees for 3D Scene Diffusion12 Sep 2024
- 2024A Latent Implicit 3D Shape Model for Multiple Levels of Detail10 Sep 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024Learning Local Pattern Modularization for Point Cloud Reconstruction from Unseen Classes26 Aug 2024
- 2024NeRF-US: Removing Ultrasound Imaging Artifacts from Neural Radiance Fields in the Wild13 Aug 2024
- 2024Towards the Spectral bias Alleviation by Normalizations in Coordinate Networks25 Jul 2024
50 newest of 372 All 372 (JSON)
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2024LT3SD: Latent Trees for 3D Scene Diffusioncited by 53
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusioncited by 23
- 2024Image Neural Field Diffusion Modelscited by 13
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentscited by 10
- 2025GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusioncited by 0
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2025GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusion28 Mar 2025
- 2024LT3SD: Latent Trees for 3D Scene Diffusion12 Sep 2024
- 2024Image Neural Field Diffusion Models11 Jun 2024
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusion10 Apr 2024
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan 2023
- 20223D Neural Field Generation using Triplane Diffusion30 Nov 2022
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
- 2021Advances in Neural Renderingcited by 365
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
- 2021NeRV: Neural Representations for Videoscited by 255
12 most cited of 363 All 363 (JSON)
- 2026OptimusMesh: Compact Autoregressive Mesh Generation from Point Clouds via Sparse Latent Pivots1 Oct 2026
- 2026Learning Positive-Incentive Point Sampling in Neural Implicit Fields for Object Pose Estimation23 Feb 2026
- 20253DProxyImg: Controllable 3D-Aware Animation Synthesis from Single Image via 2D-3D Aligned Proxy Embedding17 Dec 2025
- 2025Arbitrary-Resolution and Arbitrary-Scale Face Super-Resolution with Implicit Representation Networks20 Nov 2025
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025SBS: Enhancing Parameter-Efficiency of Neural Representations for Neural Networks via Spectral Bias Suppression9 Sep 2025
- 2025T-MLP: Tailed Multi-Layer Perceptron for Level-of-Detail Signal Representation26 Aug 2025
- 2025MeshSplat: Generalizable Sparse-View Surface Reconstruction via Gaussian Splatting25 Aug 2025
- 2025SurfR: Surface Reconstruction with Multi-scale Attention10 Jun 2025
- 2025Squeeze3D: Extreme Neural Compression with Latent Space Bridging9 Jun 2025
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectives21 May 2025
- 2025NeuGen: Amplifying the 'Neural' in Neural Radiance Fields for Domain Generalization11 May 2025
12 newest of 363 All 363 (JSON)