MR-SLAM: Immersive Spatial Supervision for Multi-Robot Mapping via Mixed Reality
Not on the map. Why?
Abstract (arXiv)
Operating a multi-robot fleet for simultaneous localization and mapping (SLAM) in applications such as building inspection or warehouse-aisle monitoring requires the operator to maintain spatial awareness of each robot's position and mapping state, a task that scales poorly on conventional 2D interfaces. We present MR-SLAM, a mixed reality (MR) system in which an operator wearing a Meta Quest 3 headset teleoperates three simulated TurtleBot3 robots through a passthrough view with real-world occlusion, while spatially anchored dashboard panels report mapping progress in situ. Each robot runs an independent SLAM Toolbox instance whose occupancy grid is merged in real time on a Robot Operating System 2 (ROS 2) back end. Across five 9-minute evaluation sessions, the system delivered scans at 8.83 +/- 0.16 Hz, mapped 17.9 +/- 0.8 m^2 of merged occupancy, and reached 94.7 +/- 0.5% cross-instance occupancy consistency across robot pairs. An additional session recorded 6.3 ms median transform jitter and 26.7 m^2 coverage of a 41 m^2 grid. We position MR-SLAM as a reference implementation for combining passthrough mixed reality supervision with multi-robot SLAM on consumer hardware.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 49 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
18 of 49 references.
References · 18
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systemscited by 53
- 2019DOOR-SLAM: Distributed, Online, and Outlier Resilient SLAM for Robotic Teamscited by 28
- 2023Swarm-SLAM : Sparse Decentralized Collaborative Simultaneous Localization and Mapping Framework for Multi-Robot Systemscited by 21
- 2020LAMP: Large-Scale Autonomous Mapping and Positioning for Exploration of Perceptually-Degraded Subterranean Environmentscited by 19
- 2022Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfacescited by 19
- 2020Kimera-Multi: a System for Distributed Multi-Robot Metric-Semantic Simultaneous Localization and Mappingcited by 18
- 2021Towards Collaborative Simultaneous Localization and Mapping: a Survey of the Current Research Landscapecited by 15
- 2022LAMP 2.0: A Robust Multi-Robot SLAM System for Operation in Challenging Large-Scale Underground Environmentscited by 15
- 2013Estimating Uncertain Spatial Relationships in Roboticscited by 14
- 2021A Comparison of Modern General-Purpose Visual SLAM Approachescited by 10
6 more
- 2017Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displayscited by 6
- 2022Virtual, Augmented, and Mixed Reality for Human-Robot Interaction: A Survey and Virtual Design Element Taxonomycited by 5
- 2024How does Simulation-based Testing for Self-driving Cars match Human Perception?cited by 3
- 2024Spatial Assisted Human-Drone Collaborative Navigation and Interaction through Immersive Mixed Realitycited by 2
- 2025Bridging Research and Practice in Simulation-based Testing of Industrial Robot Navigation Systemscited by 1
- 2026Quest2ROS2: A ROS 2 Framework for Bi-manual VR Teleoperationcited by 1
Built on by
Not cited yet.