# Multiview point cloud registration with anisotropic and space-varying localization noise

arXiv: https://arxiv.org/abs/2201.00708 · HTML: https://mlsanity.com/paper/2201.00708/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 7 of its 49 references that are in the map.
- First posted on arXiv 3 Jan 2022.

## Builds on (most cited first, 7 of 7)

- [Deep Closest Point: Learning Representations for Point Cloud Registration](https://mlsanity.com/paper/1905.03304/) (2019)
- [PointNetLK: Robust & Efficient Point Cloud Registration using PointNet](https://mlsanity.com/paper/1903.05711/) (2019)
- [RPM-Net: Robust Point Matching using Learned Features](https://mlsanity.com/paper/2003.13479/) (2020)
- [OMNet: Learning Overlapping Mask for Partial-to-Partial Point Cloud Registration](https://mlsanity.com/paper/2103.00937/) (2021)
- [Joint Alignment of Multiple Point Sets with Batch and Incremental Expectation-Maximization](https://mlsanity.com/paper/1609.01466/) (2016)
- [Rigid and Articulated Point Registration with Expectation Conditional Maximization](https://mlsanity.com/paper/2012.05191/) (2020)
- [Registration of multi-view point sets under the perspective of expectation-maximization](https://mlsanity.com/paper/2002.07464/) (2020)

## Abstract (arXiv)

In this paper, we address the problem of registering multiple point clouds corrupted with high anisotropic localization noise. Our approach follows the widely used framework of Gaussian mixture model (GMM) reconstruction with an expectation-maximization (EM) algorithm. Existing methods are based on an implicit assumption of space-invariant isotropic Gaussian noise. However, this assumption is violated in practice in applications such as single molecule localization microscopy (SMLM). To address this issue, we propose to introduce an explicit localization noise model that decouples shape modeling with the GMM from noise handling. We design a stochastic EM algorithm that considers noise-free data as a latent variable, with closed-form solutions at each EM step. The first advantage of our approach is to handle space-variant and anisotropic Gaussian noise with arbitrary covariances. The second advantage is to leverage the explicit noise model to impose prior knowledge about the noise that may be available from physical sensors. We show on various simulated data that our noise handling strategy improves significantly the robustness to high levels of anisotropic noise. We also demonstrate the performance of our method on real SMLM data.