An Algorithm for the SE(3)-Transformation on Neural Implicit Maps for Remapping Functions
Not on the map. Why?
Abstract (arXiv)
Implicit representations are widely used for object reconstruction due to their efficiency and flexibility. In 2021, a novel structure named neural implicit map has been invented for incremental reconstruction. A neural implicit map alleviates the problem of inefficient memory cost of previous online 3D dense reconstruction while producing better quality. % However, the neural implicit map suffers the limitation that it does not support remapping as the frames of scans are encoded into a deep prior after generating the neural implicit map. This means, that neither this generation process is invertible, nor a deep prior is transformable. The non-remappable property makes it not possible to apply loop-closure techniques. % We present a neural implicit map based transformation algorithm to fill this gap. As our neural implicit map is transformable, our model supports remapping for this special map of latent features. % Experiments show that our remapping module is capable to well-transform neural implicit maps to new poses. Embedded into a SLAM framework, our mapping model is able to tackle the remapping of loop closures and demonstrates high-quality surface reconstruction. % Our implementation is available at githubfootnoteurlhttps://github.com/Jarrome/IMTMapping for the research community.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 17 Jun 2022.
Builds on
25 of 40 references.
References · 25
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2018Conditional Neural Processescited by 421
13 more
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 348
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 244
- 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 231
- 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 168
- 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
- 2020DI-Fusion: Online Implicit 3D Reconstruction with Deep Priorscited by 70
- 2021NeuralBlox: Real-Time Neural Representation Fusion for Robust Volumetric Mappingcited by 14
- 2020Self-supervised Point Set Local Descriptors for Point Cloud Registrationcited by 7
- 2022Indirect Point Cloud Registration: Aligning Distance Fields using a Pseudo Third Point Sescited by 3
Built on by
Citing papers per year: 2023: 3; 2024: 2.
5 papers.
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistencycited by 42
- 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstructioncited by 24
- 2023Uni-Fusion: Universal Continuous Mappingcited by 5
- 2024SceneFactory: A Workflow-centric and Unified Framework for Incremental Scene Modelingcited by 3
- 2023NSLF-OL: Online Learning of Neural Surface Light Fields alongside Real-time Incremental 3D Reconstructioncited by 2
- 2024SceneFactory: A Workflow-centric and Unified Framework for Incremental Scene Modeling13 May 2024
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency17 Jan 2024
- 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstruction17 Aug 2023
- 2023NSLF-OL: Online Learning of Neural Surface Light Fields alongside Real-time Incremental 3D Reconstruction29 Apr 2023
- 2023Uni-Fusion: Universal Continuous Mapping22 Mar 2023