# maplab: An Open Framework for Research in Visual-inertial Mapping and Localization

arXiv: https://arxiv.org/abs/1711.10250 · HTML: https://mlsanity.com/paper/1711.10250/

## Key facts

- Cited by 23 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 28 Nov 2017.

## Built on by (most cited first, 23 of 23)

- [Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image](https://mlsanity.com/paper/2204.04752/) (2022)
- [Deep Patch Visual SLAM](https://mlsanity.com/paper/2408.01654/) (2024)
- [RoadMap: A Light-Weight Semantic Map for Visual Localization towards Autonomous Driving](https://mlsanity.com/paper/2106.02527/) (2021)
- [FLSea: Underwater Visual-Inertial and Stereo-Vision Forward-Looking Datasets](https://mlsanity.com/paper/2302.12772/) (2023)
- [Satellite Image Based Cross-view Localization for Autonomous Vehicle](https://mlsanity.com/paper/2207.13506/) (2022)
- [The Hilti SLAM Challenge Dataset](https://mlsanity.com/paper/2109.11316/) (2021)
- [Benchmarking Egocentric Visual-Inertial SLAM at City Scale](https://mlsanity.com/paper/2509.26639/) (2025)
- [IMU Data Processing For Inertial Aided Navigation: A Recurrent Neural Network Based Approach](https://mlsanity.com/paper/2103.14286/) (2021)
- [ObVi-SLAM: Long-Term Object-Visual SLAM](https://mlsanity.com/paper/2309.15268/) (2023)
- [Multi-Session SLAM with Differentiable Wide-Baseline Pose Optimization](https://mlsanity.com/paper/2404.15263/) (2024)
- [Comparison of modern open-source visual SLAM approaches](https://mlsanity.com/paper/2108.01654/) (2021)
- [3D3L: Deep Learned 3D Keypoint Detection and Description for LiDARs](https://mlsanity.com/paper/2103.13808/) (2021)
- [NeRF-VIO: Map-Based Visual-Inertial Odometry with Initialization Leveraging Neural Radiance Fields](https://mlsanity.com/paper/2503.07952/) (2025)
- [Benchmarking Visual-Inertial Deep Multimodal Fusion for Relative Pose Regression and Odometry-aided Absolute Pose Regression](https://mlsanity.com/paper/2208.00919/) (2022)
- [A Collaborative Visual SLAM Framework for Service Robots](https://mlsanity.com/paper/2102.03228/) (2021)
- [Learning to Predict Repeatability of Interest Points](https://mlsanity.com/paper/2105.03578/) (2021)
- [Superquadric Object Representation for Optimization-based Semantic SLAM](https://mlsanity.com/paper/2109.09627/) (2021)
- [Why-So-Deep: Towards Boosting Previously Trained Models for Visual Place Recognition](https://mlsanity.com/paper/2201.03212/) (2022)
- [Enhancing Scene Coordinate Regression with Efficient Keypoint Detection and Sequential Information](https://mlsanity.com/paper/2412.06488/) (2024)
- [Holistic Fusion: Task- and Setup-Agnostic Robot Localization and State Estimation with Factor Graphs](https://mlsanity.com/paper/2504.06479/) (2025)
- [A Multiple-View Geometric Model for Specularity Prediction on General Curved Surfaces](https://mlsanity.com/paper/2108.09378/) (2021)
- [LT-Exosense: A Vision-centric Multi-session Mapping System for Lifelong Safe Navigation of Exoskeletons](https://mlsanity.com/paper/2510.22164/) (2025)
- [SG2Loc: Sequential Visual Localization on 3D Scene Graphs](https://mlsanity.com/paper/2606.11880/) (2026)

## Abstract (arXiv)

Robust and accurate visual-inertial estimation is crucial to many of today's challenges in robotics. Being able to localize against a prior map and obtain accurate and driftfree pose estimates can push the applicability of such systems even further. Most of the currently available solutions, however, either focus on a single session use-case, lack localization capabilities or an end-to-end pipeline. We believe that only a complete system, combining state-of-the-art algorithms, scalable multi-session mapping tools, and a flexible user interface, can become an efficient research platform. We therefore present maplab, an open, research-oriented visual-inertial mapping framework for processing and manipulating multi-session maps, written in C++. On the one hand, maplab can be seen as a ready-to-use visual-inertial mapping and localization system. On the other hand, maplab provides the research community with a collection of multisession mapping tools that include map merging, visual-inertial batch optimization, and loop closure. Furthermore, it includes an online frontend that can create visual-inertial maps and also track a global drift-free pose within a localization map. In this paper, we present the system architecture, five use-cases, and evaluations of the system on public datasets. The source code of maplab is freely available for the benefit of the robotics research community.
