SEA: Semantic Map Prediction for Active Exploration of Uncertain Areas
On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control
Abstract (arXiv)
In this paper, we propose SEA, a novel approach for active robot exploration through semantic map prediction and a reinforcement learning-based hierarchical exploration policy. Unlike existing learning-based methods that rely on one-step waypoint prediction, our approach enhances the agent's long-term environmental understanding to facilitate more efficient exploration. We propose an iterative prediction-exploration framework that explicitly predicts the missing areas of the map based on current observations. The difference between the actual accumulated map and the predicted global map is then used to guide exploration. Additionally, we design a novel reward mechanism that leverages reinforcement learning to update the long-term exploration strategies, enabling us to construct an accurate semantic map within limited steps. Experimental results demonstrate that our method significantly outperforms state-of-the-art exploration strategies, achieving superior coverage ares of the global map within the same time constraints.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 41 of its 52 references that are in the map. First posted on arXiv 22 Oct 2025.
Builds on
41 of 52 references.
References · 41
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
- 2018PCN: Point Completion Networkcited by 384
- 2020Learning to Explore using Active Neural SLAMcited by 316
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2020Neural Topological SLAM for Visual Navigationcited by 195
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
29 more
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2019Learning Exploration Policies for Navigationcited by 116
- 2019ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentationcited by 107
- 2020Occupancy Anticipation for Efficient Exploration and Navigationcited by 106
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
- 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 74
- 2020An Exploration of Embodied Visual Explorationcited by 58
- 2020Semantic MapNet: Building Allocentric Semantic Maps and Representations from Egocentric Viewscited by 58
- 2021Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networkscited by 52
- 2021Learning to Map for Active Semantic Goal Navigationcited by 50
- 2020FUEL: Fast UAV Exploration using Incremental Frontier Structure and Hierarchical Planningcited by 48
- 2020Semantic Curiosity for Active Visual Learningcited by 45
- 2020SSCNav: Confidence-Aware Semantic Scene Completion for Visual Semantic Navigationcited by 44
- 2019Robust and Efficient Quadrotor Trajectory Generation for Fast Autonomous Flightcited by 41
- 2023MACARONS: Mapping And Coverage Anticipation with RGB Online Self-Supervisioncited by 19
- 2016Look-ahead before you leap: end-to-end active recognition by forecasting the effect of motioncited by 18
- 2022Unbiased Directed Object Attention Graph for Object Navigationcited by 18
- 2023ARiADNE: A Reinforcement learning approach using Attention-based Deep Networks for Explorationcited by 18
- 2022Navigating to Objects in Unseen Environments by Distance Predictioncited by 16
- 2024DARE: Diffusion Policy for Autonomous Robot Explorationcited by 12
- 2025GLEAM: Learning Generalizable Exploration Policy for Active Mapping in Complex 3D Indoor Scenescited by 11
- 2021Focus on Impact: Indoor Exploration with Intrinsic Motivationcited by 9
- 2023PredRecon: A Prediction-boosted Planning Framework for Fast and High-quality Autonomous Aerial Reconstructioncited by 8
- 2023Autonomous Exploration and Mapping for Mobile Robots via Cumulative Curriculum Reinforcement Learningcited by 5
- 2023Heuristic-based Incremental Probabilistic Roadmap for Efficient UAV Exploration in Dynamic Environmentscited by 3
- 2021Graph Convolutional Memory using Topological Priorscited by 2
- 2022Lightweight Object-level Topological Semantic Mapping and Long-term Global Localization based on Graph Matchingcited by 2
- 2021Learning to Explore by Reinforcement over High-Level Optionscited by 1
- 2021Symmetry-aware Neural Architecture for Embodied Visual Navigationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025MA-SLAM: Active SLAM in Large-Scale Unknown Environment using Map Aware Deep Reinforcement Learning
- 2025HEADER: Hierarchical Robot Exploration via Attention-Based Deep Reinforcement Learning with Expert-Guided Reward
- 2025MapExRL: Human-Inspired Indoor Exploration with Predicted Environment Context and Reinforcement Learning
- 2026All Roads Lead to Rome: Flow-driven Multi-Anchor Exploration for Open-Environment Active 3D Mapping ↗
- 2025GET: Goal-directed Exploration and Targeting for Large-Scale Unknown Environments
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Information
- 2025Deep Active Inference with Diffusion Policy and Multiple Timescale World Model for Real-World Exploration and Navigation
- 2025Robust Robotic Exploration and Mapping Using Generative Occupancy Map Synthesis