Semantic OcTree Mapping and Shannon Mutual Information Computation for Robot Exploration
Not on the map. Why?
Abstract (arXiv)
Autonomous robot operation in unstructured and unknown environments requires efficient techniques for mapping and exploration using streaming range and visual observations. Information-based exploration techniques, such as Cauchy-Schwarz quadratic mutual information (CSQMI) and fast Shannon mutual information (FSMI), have successfully achieved active binary occupancy mapping with range measurements. However, as we envision robots performing complex tasks specified with semantically meaningful concepts, it is necessary to capture semantics in the measurements, map representation, and exploration objective. This work presents Semantic octree mapping and Shannon Mutual Information (SSMI) computation for robot exploration. We develop a Bayesian multi-class mapping algorithm based on an octree data structure, where each voxel maintains a categorical distribution over semantic classes. We derive a closed-form efficiently-computable lower bound of the Shannon mutual information between a multi-class octomap and a set of range-category measurements using semantic run-length encoding of the sensor rays. The bound allows rapid evaluation of many potential robot trajectories for autonomous exploration and mapping. We compare our method against state-of-the-art exploration techniques and apply it in a variety of simulated and real-world experiments.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Dec 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 6; 2025: 3; 2026: 3.
14 papers.
Sort:
By area:
- 2024Learning Generalizable Feature Fields for Mobile Manipulationcited by 31
- 2024SPINE: Online Semantic Planning for Missions with Incomplete Natural Language Specifications in Unstructured Environmentscited by 16
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environmentscited by 11
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Informationcited by 9
- 2024Evidential Semantic Mapping in Off-road Environments with Uncertainty-aware Bayesian Kernel Inferencecited by 6
- 2025Understanding while Exploring: Semantics-driven Active Mappingcited by 5
- 2025Ella: Embodied Social Agents with Lifelong Memorycited by 4
- 2022Active Exploration based on Information Gain by Particle Filter for Efficient Spatial Concept Formationcited by 2
- 2023Interactive Semantic Map Representation for Skill-based Visual Object Navigationcited by 2
- 2024Uncertainty-aware Semantic Mapping in Off-road Environments with Dempster-Shafer Theory of Evidencecited by 2
- 2024Build Once, Monitor Continuously: Persistent Semantic Mapping via Autonomous Exploration and Open-Vocabulary Object Updatescited by 0
- 2026Belief Consistency Between Foundation-Model Evidence and Geometric Perception in Persistent Robotic Mapscited by 0
- 2026Multi-Scale Semantic Mapping in Urban Environments via Observation Calibration and Policy Dependence Regularization28 Sep 2026
- 2026SGE: Semantically-Guided Exploration for Unstructured Environments via Image-Space Waypoint Sampling29 Aug 2026
- 2026Belief Consistency Between Foundation-Model Evidence and Geometric Perception in Persistent Robotic Maps29 May 2026
- 2025Ella: Embodied Social Agents with Lifelong Memory30 Jun 2025
- 2025Understanding while Exploring: Semantics-driven Active Mapping30 May 2025
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environments14 May 2025
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Information22 Oct 2024
- 2024SPINE: Online Semantic Planning for Missions with Incomplete Natural Language Specifications in Unstructured Environments3 Oct 2024
- 2024Build Once, Monitor Continuously: Persistent Semantic Mapping via Autonomous Exploration and Open-Vocabulary Object Updates23 Sep 2024
- 2024Uncertainty-aware Semantic Mapping in Off-road Environments with Dempster-Shafer Theory of Evidence10 May 2024
- 2024Evidential Semantic Mapping in Off-road Environments with Uncertainty-aware Bayesian Kernel Inference21 Mar 2024
- 2024Learning Generalizable Feature Fields for Mobile Manipulation12 Mar 2024
- 2025Ella: Embodied Social Agents with Lifelong Memorycited by 4
- 2025Ella: Embodied Social Agents with Lifelong Memory30 Jun 2025
- 2024Learning Generalizable Feature Fields for Mobile Manipulationcited by 31
- 2024SPINE: Online Semantic Planning for Missions with Incomplete Natural Language Specifications in Unstructured Environmentscited by 16
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environmentscited by 11
- 2024Evidential Semantic Mapping in Off-road Environments with Uncertainty-aware Bayesian Kernel Inferencecited by 6
- 2025Understanding while Exploring: Semantics-driven Active Mappingcited by 5
- 2022Active Exploration based on Information Gain by Particle Filter for Efficient Spatial Concept Formationcited by 2
- 2023Interactive Semantic Map Representation for Skill-based Visual Object Navigationcited by 2
- 2024Uncertainty-aware Semantic Mapping in Off-road Environments with Dempster-Shafer Theory of Evidencecited by 2
- 2024Build Once, Monitor Continuously: Persistent Semantic Mapping via Autonomous Exploration and Open-Vocabulary Object Updatescited by 0
- 2026Belief Consistency Between Foundation-Model Evidence and Geometric Perception in Persistent Robotic Mapscited by 0
- 2026SGE: Semantically-Guided Exploration for Unstructured Environments via Image-Space Waypoint Samplingcited by 0
- 2026Multi-Scale Semantic Mapping in Urban Environments via Observation Calibration and Policy Dependence Regularizationcited by 0
- 2026Multi-Scale Semantic Mapping in Urban Environments via Observation Calibration and Policy Dependence Regularization28 Sep 2026
- 2026SGE: Semantically-Guided Exploration for Unstructured Environments via Image-Space Waypoint Sampling29 Aug 2026
- 2026Belief Consistency Between Foundation-Model Evidence and Geometric Perception in Persistent Robotic Maps29 May 2026
- 2025Understanding while Exploring: Semantics-driven Active Mapping30 May 2025
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environments14 May 2025
- 2024SPINE: Online Semantic Planning for Missions with Incomplete Natural Language Specifications in Unstructured Environments3 Oct 2024
- 2024Build Once, Monitor Continuously: Persistent Semantic Mapping via Autonomous Exploration and Open-Vocabulary Object Updates23 Sep 2024
- 2024Uncertainty-aware Semantic Mapping in Off-road Environments with Dempster-Shafer Theory of Evidence10 May 2024
- 2024Evidential Semantic Mapping in Off-road Environments with Uncertainty-aware Bayesian Kernel Inference21 Mar 2024
- 2024Learning Generalizable Feature Fields for Mobile Manipulation12 Mar 2024
- 2023Interactive Semantic Map Representation for Skill-based Visual Object Navigation7 Nov 2023
- 2022Active Exploration based on Information Gain by Particle Filter for Efficient Spatial Concept Formation20 Nov 2022