# Multi-LVI-SAM: A Robust LiDAR-Visual-Inertial Odometry for Multiple Fisheye Cameras

arXiv: https://arxiv.org/abs/2509.05740 · HTML: https://mlsanity.com/paper/2509.05740/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 16 of its 33 references that are in the map.
- First posted on arXiv 6 Sep 2025.

## Builds on (most cited first, 16 of 16)

- [ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras](https://mlsanity.com/paper/1610.06475/) (2016)
- [VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator](https://mlsanity.com/paper/1708.03852/) (2017)
- [LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping](https://mlsanity.com/paper/2007.00258/) (2020)
- [FAST-LIO2: Fast Direct LiDAR-inertial Odometry](https://mlsanity.com/paper/2107.06829/) (2021)
- [R3LIVE: A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping package](https://mlsanity.com/paper/2109.07982/) (2021)
- [LVI-SAM: Tightly-coupled Lidar-Visual-Inertial Odometry via Smoothing and Mapping](https://mlsanity.com/paper/2104.10831/) (2021)
- [M2DGR: A Multi-sensor and Multi-scenario SLAM Dataset for Ground Robots](https://mlsanity.com/paper/2112.13659/) (2021)
- [FAST-LIVO: Fast and Tightly-coupled Sparse-Direct LiDAR-Inertial-Visual Odometry](https://mlsanity.com/paper/2203.00893/) (2022)
- [Hilti-Oxford Dataset: A Millimetre-Accurate Benchmark for Simultaneous Localization and Mapping](https://mlsanity.com/paper/2208.09825/) (2022)
- [Multi-Camera LiDAR Inertial Extension to the Newer College Dataset](https://mlsanity.com/paper/2112.08854/) (2021)
- [CamVox: A Low-cost and Accurate Lidar-assisted Visual SLAM System](https://mlsanity.com/paper/2011.11357/) (2020)
- [BAMF-SLAM: Bundle Adjusted Multi-Fisheye Visual-Inertial SLAM Using Recurrent Field Transforms](https://mlsanity.com/paper/2306.01173/) (2023)
- [MAVIS: Multi-Camera Augmented Visual-Inertial SLAM using SE2(3) Based Exact IMU Pre-integration](https://mlsanity.com/paper/2309.08142/) (2023)
- [Panoramic Direct LiDAR-assisted Visual Odometry](https://mlsanity.com/paper/2409.09287/) (2024)
- [LiVisSfM: Accurate and Robust Structure-from-Motion with LiDAR and Visual Cues](https://mlsanity.com/paper/2410.22213/) (2024)
- [MCVO: A Generic Visual Odometry for Arbitrarily Arranged Multi-Cameras](https://mlsanity.com/paper/2412.03146/) (2024)

## Abstract (arXiv)

We propose a multi-camera LiDAR-visual-inertial odometry framework, Multi-LVI-SAM, which fuses data from multiple fisheye cameras, LiDAR and inertial sensors for highly accurate and robust state estimation. To enable efficient and consistent integration of visual information from multiple fisheye cameras, we introduce a panoramic visual feature model that unifies multi-camera observations into a single representation. The panoramic model serves as a global geometric optimization framework that consolidates multi-view constraints, enabling seamless loop closure and global pose optimization, while simplifying system design by avoiding redundant handling of individual cameras. To address the triangulation inconsistency caused by the misalignment between each camera's frame and the panoramic model's frame, we propose an extrinsic compensation method. This method improves feature consistency across views and significantly reduces triangulation and optimization errors, leading to more accurate pose estimation. We integrate the panoramic visual feature model into a tightly coupled LiDAR-visual-inertial system based on a factor graph. Extensive experiments on public datasets demonstrate that the panoramic visual feature model enhances the quality and consistency of multi-camera constraints, resulting in higher accuracy and robustness than existing multi-camera LiDAR-visual-inertial systems.