RoboAtlas: Contextual Active SLAM
Not on the map. Why?
Abstract (arXiv)
We present RoboAtlas, a contextual Active SLAM framework that adaptively balances geometric exploration and semantic reasoning using a scalable 3D semantic mapping system, OpenRoboVox. RoboAtlas integrates frontier exploration, global semantic-map reasoning, and egocentric VLM-based reasoning through a contextual multi-armed bandit that transitions from exploration to semantically guided navigation as scene understanding improves. We evaluate the system in simulation and on a Unitree Go2 robot in large-scale real-world environments exceeding 1800 m2 with approx. 30k mapped semantic instances, achieving a 100% task success rate. On the GOAT-Bench "Val Unseen" benchmark, RoboAtlas achieves state-of-the-art performance with highest reported success rate (SR) of 90.6%, using GPT-4o, improving over the strongest prior baseline by 17.8 percentage points in SR. Using the much smaller Qwen2.5-VL-7B model, it still achieves 88.8% SR, outperforming all baselines using GPT-4o in SR, and revealing the importance of the information gained by our semantic mapping framework over simply replacing the underlying foundation model. The results demonstrate that grounding foundation models with large-scale 3D semantic maps enables robust and efficient contextual Active SLAM.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 49 of its 62 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
49 of 62 references.
References · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 435
37 more
- 2022Visual Language Maps for Robot Navigationcited by 362
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 345
- 2017Embodied Question Answeringcited by 335
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
- 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIPcited by 199
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
- 2018Fusion++: Volumetric Object-Level SLAMcited by 97
- 2019PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Thingscited by 97
- 2018MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objectscited by 95
- 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
- 2023Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigationcited by 74
- 2024Explore until Confident: Efficient Exploration for Embodied Question Answeringcited by 74
- 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 73
- 2022A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontierscited by 62
- 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 53
- 2025Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigationcited by 50
- 2023Tokenize Anything via Promptingcited by 31
- 2024One Map to Find Them All: Real-time Open-Vocabulary Mapping for Zero-shot Multi-Object Navigationcited by 13
- 2025MSGNav: Unleashing the Power of Multi-modal 3D Scene Graph for Zero-Shot Embodied Navigationcited by 13
- 2026Explore with Long-term Memory: A Benchmark and Multimodal LLM-based Reinforcement Learning Framework for Embodied Explorationcited by 13
- 2023From the Desks of ROS Maintainers: A Survey of Modern & Capable Mobile Robotics Algorithms in the Robot Operating System 2cited by 10
- 2025Stairway to Success: An Online Floor-Aware Zero-Shot Object-Goal Navigation Framework via LLM-Driven Coarse-to-Fine Explorationcited by 10
- 2022POCD: Probabilistic Object-Level Change Detection and Volumetric Mapping in Semi-Static Scenescited by 9
- 2025DyNaVLM: Zero-Shot Vision-Language Navigation System with Dynamic Viewpoints and Self-Refining Graph Memorycited by 9
- 20243P-LLM: Probabilistic Path Planning using Large Language Model for Autonomous Robot Navigationcited by 8
- 2025OpenVox: Real-time Instance-level Open-vocabulary Probabilistic Voxel Representationcited by 8
- 2023POV-SLAM: Probabilistic Object-Aware Variational SLAM in Semi-Static Environmentscited by 6
- 2021SABER: Data-Driven Motion Planner for Autonomously Navigating Heterogeneous Robotscited by 4
- 2025NAMO-LLM: Efficient Navigation Among Movable Obstacles with Large Language Model Guidancecited by 4
- 2025ReEXplore: Improving MLLMs for Embodied Exploration with Contextualized Retrospective Experience Replaycited by 4
- 2017Algorithms for Routing of Unmanned Aerial Vehicles with Mobile Recharging Stationscited by 3
- 2025Handle Object Navigation as Weighted Traveling Repairman Problemcited by 3
- 2026HIMM: Human-Inspired Long-Term Memory Modeling for Embodied Exploration and Question Answeringcited by 3
- 2024Frontier-Based Exploration for Multi-Robot Rendezvous in Communication-Restricted Unknown Environmentscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Context-Aware Replanning with Pre-explored Semantic Map for Object Navigation
- 2025Where Did I Leave My Glasses? Open-Vocabulary Semantic Exploration in Real-World Semi-Static Environments
- 2026SuperMap: A Spatio-Temporal SLAM System for Visual-Language Navigation ↗
- 2023ConceptFusion: Open-set Multimodal 3D Mapping
- 2026CausalNav: A Long-term Embodied Navigation System for Autonomous Mobile Robots in Dynamic Outdoor Scenarios
- 2026WildOS: Open-Vocabulary Object Search in the Wild
- 2026LIEREx: Language-Image Embeddings for Robotic Exploration
- 2026Vision-Language Model Reasoning for Contextual Semantic Mapping in Intralogistics