# SVIn2: An Underwater SLAM System using Sonar, Visual, Inertial, and Depth Sensor

arXiv: https://arxiv.org/abs/1810.03200 · HTML: https://mlsanity.com/paper/1810.03200/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Oct 2018.

## Built on by (most cited first, 16 of 16)

- [Video ChatCaptioner: Towards Enriched Spatiotemporal Descriptions](https://mlsanity.com/paper/2304.04227/) (2023)
- [UDepth: Fast Monocular Depth Estimation for Visually-guided Underwater Robots](https://mlsanity.com/paper/2209.12358/) (2022)
- [Real-Time Dense 3D Mapping of Underwater Environments](https://mlsanity.com/paper/2304.02704/) (2023)
- [OceanSim: A GPU-Accelerated Underwater Robot Perception Simulation Framework](https://mlsanity.com/paper/2503.01074/) (2025)
- [High Definition, Inexpensive, Underwater Mapping](https://mlsanity.com/paper/2203.05640/) (2022)
- [CaveSeg: Deep Semantic Segmentation and Scene Parsing for Autonomous Underwater Cave Exploration](https://mlsanity.com/paper/2309.11038/) (2023)
- [Sonar-based Deep Learning in Underwater Robotics: Overview, Robustness and Challenges](https://mlsanity.com/paper/2412.11840/) (2024)
- [SM/VIO: Robust Underwater State Estimation Switching Between Model-based and Visual Inertial Odometry](https://mlsanity.com/paper/2304.01988/) (2023)
- [Performance Evaluation of 3D Keypoint Detectors and Descriptors on Coloured Point Clouds in Subsea Environments](https://mlsanity.com/paper/2209.12881/) (2022)
- [Tightly-coupled Visual-DVL-Inertial Odometry for Robot-based Ice-water Boundary Exploration](https://mlsanity.com/paper/2303.17005/) (2023)
- [Online Refractive Camera Model Calibration in Visual Inertial Odometry](https://mlsanity.com/paper/2409.12074/) (2024)
- [AQUA-SLAM: Tightly-Coupled Underwater Acoustic-Visual-Inertial SLAM with Sensor Calibration](https://mlsanity.com/paper/2503.11420/) (2025)
- [Enhancing Visual Inertial SLAM with Magnetic Measurements](https://mlsanity.com/paper/2409.09904/) (2024)
- [Underwater Monocular Metric Depth Estimation: Real-World Benchmarks and Synthetic Fine-Tuning with Vision Foundation Models](https://mlsanity.com/paper/2507.02148/) (2025)
- [Autonomous Underwater Cognitive System for Adaptive Navigation: A SLAM-Integrated Cognitive Architecture](https://mlsanity.com/paper/2511.11845/) (2025)
- [ReefMapGS: Enabling Large-Scale Underwater Reconstruction by Closing the Loop Between Multimodal SLAM and Gaussian Splatting](https://mlsanity.com/paper/2604.11992/) (2026)

## Abstract (arXiv)

This paper presents a novel tightly-coupled keyframe-based Simultaneous Localization and Mapping (SLAM) system with loop-closing and relocalization capabilities targeted for the underwater domain. Our previous work, SVIn, augmented the state-of-the-art visual-inertial state estimation package OKVIS to accommodate acoustic data from sonar in a non-linear optimization-based framework. This paper addresses drift and loss of localization -- one of the main problems affecting other packages in underwater domain -- by providing the following main contributions: a robust initialization method to refine scale using depth measurements, a fast preprocessing step to enhance the image quality, and a real-time loop-closing and relocalization method using bag of words. An additional contribution is the introduction of depth measurements from a pressure sensor to the tightly-coupled optimization formulation. Experimental results on datasets collected with a custom-made underwater sensor suite and an autonomous underwater vehicle from challenging underwater environments with poor visibility demonstrate performance never achieved before in terms of accuracy and robustness.
