# HeLiMOS: A Dataset for Moving Object Segmentation in 3D Point Clouds From Heterogeneous LiDAR Sensors

arXiv: https://arxiv.org/abs/2408.06328 · HTML: https://mlsanity.com/paper/2408.06328/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 36 references that are in the map.
- First posted on arXiv 12 Aug 2024.

## Builds on (most cited first, 20 of 20)

- [nuScenes: A multimodal dataset for autonomous driving](https://mlsanity.com/paper/1903.11027/) (2019)
- [Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Dataset](https://mlsanity.com/paper/2104.10133/) (2021)
- [PandaSet: Advanced Sensor Suite Dataset for Autonomous Driving](https://mlsanity.com/paper/2112.12610/) (2021)
- [SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instances](https://mlsanity.com/paper/2002.09147/) (2020)
- [Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Data](https://mlsanity.com/paper/2105.08971/) (2021)
- [A Survey on Global LiDAR Localization: Challenges, Advances and Open Problems](https://mlsanity.com/paper/2302.07433/) (2023)
- [Receding Moving Object Segmentation in 3D LiDAR Data Using Sparse 4D Convolutions](https://mlsanity.com/paper/2206.04129/) (2022)
- [ERASOR: Egocentric Ratio of Pseudo Occupancy-based Dynamic Object Removal for Static 3D Point Cloud Map Building](https://mlsanity.com/paper/2103.04316/) (2021)
- [Efficient Spatial-Temporal Information Fusion for LiDAR-Based 3D Moving Object Segmentation](https://mlsanity.com/paper/2207.02201/) (2022)
- [WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecasting](https://mlsanity.com/paper/2304.03834/) (2023)
- [Automatic Labeling to Generate Training Data for Online LiDAR-based Moving Object Segmentation](https://mlsanity.com/paper/2201.04501/) (2022)
- [HeLiPR: Heterogeneous LiDAR Dataset for inter-LiDAR Place Recognition under Spatiotemporal Variations](https://mlsanity.com/paper/2309.14590/) (2023)
- [LIBRE: The Multiple 3D LiDAR Dataset](https://mlsanity.com/paper/2003.06129/) (2020)
- [MF-MOS: A Motion-Focused Model for Moving Object Segmentation](https://mlsanity.com/paper/2401.17023/) (2024)
- [InsMOS: Instance-Aware Moving Object Segmentation in LiDAR Data](https://mlsanity.com/paper/2303.03909/) (2023)
- [Building Volumetric Beliefs for Dynamic Environments Exploiting Map-Based Moving Object Segmentation](https://mlsanity.com/paper/2307.08314/) (2023)
- [Multi-Modal Lidar Dataset for Benchmarking General-Purpose Localization and Mapping Algorithms](https://mlsanity.com/paper/2203.03454/) (2022)
- [A Dynamic Points Removal Benchmark in Point Cloud Maps](https://mlsanity.com/paper/2307.07260/) (2023)
- [Teachers in concordance for pseudo-labeling of 3D sequential data](https://mlsanity.com/paper/2207.06079/) (2022)
- [TOSS: Real-time Tracking and Moving Object Segmentation for Static Scene Mapping](https://mlsanity.com/paper/2408.05453/) (2024)

## Built on by (most cited first, 5 of 5)

- [BUFFER-X: Towards Zero-Shot Point Cloud Registration in Diverse Scenes](https://mlsanity.com/paper/2503.07940/) (2025)
- [Toward Zero-Shot Point Cloud Registration Across Diverse Scales, Scenes, and Sensor Setups](https://mlsanity.com/paper/2601.02759/) (2026)
- [Moving Object Segmentation in Point Cloud Data using Hidden Markov Models](https://mlsanity.com/paper/2410.18638/) (2024)
- [Temporal Overlapping Prediction: A Self-supervised Pre-training Method for LiDAR Moving Object Segmentation](https://mlsanity.com/paper/2503.07167/) (2025)
- [AevaScenes: An FMCW LiDAR Dataset and Benchmark for Long-Range Perception](https://mlsanity.com/paper/2609.33230/) (2026)

## Abstract (arXiv)

Moving object segmentation (MOS) using a 3D light detection and ranging (LiDAR) sensor is crucial for scene understanding and identification of moving objects. Despite the availability of various types of 3D LiDAR sensors in the market, MOS research still predominantly focuses on 3D point clouds from mechanically spinning omnidirectional LiDAR sensors. Thus, we are, for example, lacking a dataset with MOS labels for point clouds from solid-state LiDAR sensors which have irregular scanning patterns. In this paper, we present a labeled dataset, called textitHeLiMOS, that enables to test MOS approaches on four heterogeneous LiDAR sensors, including two solid-state LiDAR sensors. Furthermore, we introduce a novel automatic labeling method to substantially reduce the labeling effort required from human annotators. To this end, our framework exploits an instance-aware static map building approach and tracking-based false label filtering. Finally, we provide experimental results regarding the performance of commonly used state-of-the-art MOS approaches on HeLiMOS that suggest a new direction for a sensor-agnostic MOS, which generally works regardless of the type of LiDAR sensors used to capture 3D point clouds. Our dataset is available at https://sites.google.com/view/helimos.