Online Learning of a Probabilistic and Adaptive Scene Representation
Not on the map. Why?
Abstract (arXiv)
Constructing and maintaining a consistent scene model on-the-fly is the core task for online spatial perception, interpretation, and action. In this paper, we represent the scene with a Bayesian nonparametric mixture model, seamlessly describing per-point occupancy status with a continuous probability density function. Instead of following the conventional data fusion paradigm, we address the problem of online learning the process how sequential point cloud data are generated from the scene geometry. An incremental and parallel inference is performed to update the parameter space in real-time. We experimentally show that the proposed representation achieves state-of-the-art accuracy with promising efficiency. The consistent probabilistic formulation assures a generative model that is adaptive to different sensor characteristics, and the model complexity can be dynamically adjusted on-the-fly according to different data scales.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 73 references that are in the map. First posted on arXiv 31 Mar 2021.
Builds on
22 of 73 references.
References · 22
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Convolutional Occupancy Networkscited by 760
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2020A Neural Dirichlet Process Mixture Model for Task-Free Continual Learningcited by 133
- 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
- 2020RoutedFusion: Learning Real-time Depth Map Fusioncited by 52
- 2018FilterReg: Robust and Efficient Probabilistic Point-Set Registration using Gaussian Filter and Twist Parameterizationcited by 43
- 2018FutureMapping: The Computational Structure of Spatial AI Systemscited by 35
10 more
- 2020PointGMM: a Neural GMM Network for Point Cloudscited by 33
- 2018SurfelMeshing: Online Surfel-Based Mesh Reconstructioncited by 29
- 2016Joint Alignment of Multiple Point Sets with Batch and Incremental Expectation-Maximizationcited by 19
- 2018PSDF Fusion: Probabilistic Signed Distance Function for On-the-fly 3D Data Fusion and Scene Reconstructioncited by 13
- 2018An Efficient Volumetric Mesh Representation for Real-time Scene Reconstruction using Spatial Hashingcited by 7
- 2015Streaming, Distributed Variational Inference for Bayesian Nonparametricscited by 5
- 2020MRFMap: Online Probabilistic 3D Mapping using Forward Ray Sensor Modelscited by 4
- 2017Warped Gaussian Processes Occupancy Mapping with Uncertain Inputscited by 3
- 2019Direct Fitting of Gaussian Mixture Modelscited by 3
- 2018Cubic Range Error Model for Stereo Vision with Illuminatorscited by 1
Built on by
Citing papers per year: 2023: 1.
1 paper.