# LIC-Fusion 2.0: LiDAR-Inertial-Camera Odometry with Sliding-Window Plane-Feature Tracking

arXiv: https://arxiv.org/abs/2008.07196 · HTML: https://mlsanity.com/paper/2008.07196/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 Aug 2020.

## Built on by (most cited first, 12 of 12)

- [R3LIVE: A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping package](https://mlsanity.com/paper/2109.07982/) (2021)
- [FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry](https://mlsanity.com/paper/2408.14035/) (2024)
- [Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision](https://mlsanity.com/paper/2504.02477/) (2025)
- [SR-LIVO: LiDAR-Inertial-Visual Odometry and Mapping with Sweep Reconstruction](https://mlsanity.com/paper/2312.16800/) (2023)
- [AirIMU: Learning Uncertainty Propagation for Inertial Odometry](https://mlsanity.com/paper/2310.04874/) (2023)
- [LiDAR-3DGS: LiDAR Reinforced 3D Gaussian Splatting for Multimodal Radiance Field Rendering](https://mlsanity.com/paper/2409.16296/) (2024)
- [Edge Robotics: Edge-Computing-Accelerated Multi-Robot Simultaneous Localization and Mapping](https://mlsanity.com/paper/2112.13222/) (2021)
- [R3LIVE++: A Robust, Real-time, Radiance reconstruction package with a tightly-coupled LiDAR-Inertial-Visual state Estimator](https://mlsanity.com/paper/2209.03666/) (2022)
- [Tightly-Coupled LiDAR-Visual SLAM Based on Geometric Features for Mobile Agents](https://mlsanity.com/paper/2307.07763/) (2023)
- [A Simple Self-calibration Method for The Internal Time Synchronization of MEMS LiDAR](https://mlsanity.com/paper/2109.12506/) (2021)
- [LMBAO: A Landmark Map for Bundle Adjustment Odometry in LiDAR SLAM](https://mlsanity.com/paper/2209.08810/) (2022)
- [Structural Foundations of Nonlinear Systems with Unknown Inputs: The UID-Induced Normal Form and Minimal-Sensing Structure-from-Motion](https://mlsanity.com/paper/2610.05939/) (2026)

## Abstract (arXiv)

Multi-sensor fusion of multi-modal measurements from commodity inertial, visual and LiDAR sensors to provide robust and accurate 6DOF pose estimation holds great potential in robotics and beyond. In this paper, building upon our prior work (i.e., LIC-Fusion), we develop a sliding-window filter based LiDAR-Inertial-Camera odometry with online spatiotemporal calibration (i.e., LIC-Fusion 2.0), which introduces a novel sliding-window plane-feature tracking for efficiently processing 3D LiDAR point clouds. In particular, after motion compensation for LiDAR points by leveraging IMU data, low-curvature planar points are extracted and tracked across the sliding window. A novel outlier rejection criterion is proposed in the plane-feature tracking for high-quality data association. Only the tracked planar points belonging to the same plane will be used for plane initialization, which makes the plane extraction efficient and robust. Moreover, we perform the observability analysis for the LiDAR-IMU subsystem and report the degenerate cases for spatiotemporal calibration using plane features. While the estimation consistency and identified degenerate motions are validated in Monte-Carlo simulations, different real-world experiments are also conducted to show that the proposed LIC-Fusion 2.0 outperforms its predecessor and other state-of-the-art methods.
