Uncertainty-Aware RL-Controlled Adaptive 3D Mapping
Not on the map. Why?
Abstract (arXiv)
Voxel-based volumetric mapping is fundamental to 3D reconstruction, yet fixed-resolution grids remain inherently inefficient - wasting memory in uniform regions and losing detail in complex ones. Existing adaptive methods, such as MAP-ADAPT, partially address this by varying resolution based on geometry and user-defined semantic class lists, but these heuristics require expert tuning, lack generalization to unseen objects, and provide no explicit mechanism to control memory usage. We propose an adaptive framework that refines voxels based on semantic entropy, which captures label uncertainty, together with geometric curvature and texture richness as scene complexity cues, yielding principled resolution allocation without reliance on semantic taxonomies. To make the accuracy-memory trade-off explicit and user-controlled, we further introduce a reinforcement learning agent that learns voxel subdivision policies under a user-specified target memory budget, replacing hand-tuned thresholds with a single intuitive control parameter. The resulting multi-resolution TSDF achieves higher geometric accuracy, better semantic consistency, and improved memory-accuracy trade-offs compared to MAP-ADAPT and fixed-resolution baselines on both synthetic and real-world datasets. Our code and models are available at https://github.com/alpayozkan/UnRL.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
19 of 33 references.
References · 19
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 465
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 366
- 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 184
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
- 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 163
- 2016Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planningcited by 150
7 more
- 2018Fusion++: Volumetric Object-Level SLAMcited by 98
- 2019PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Thingscited by 98
- 2019Volumetric Instance-Aware Semantic Mapping and 3D Object Discoverycited by 80
- 2021Panoptic Multi-TSDFs: a Flexible Representation for Online Multi-resolution Volumetric Mapping and Long-term Dynamic Scene Consistencycited by 39
- 2021Semantic OcTree Mapping and Shannon Mutual Information Computation for Robot Explorationcited by 16
- 2024Reinforcement Learning Meets Visual Odometrycited by 14
- 2024MAP-ADAPT: Real-Time Quality-Adaptive Semantic 3D Mapscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Uncertainty-Aware Diffusion Guided Refinement of 3D Scenes
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaverse
- 2025Perfecting Depth: Uncertainty-Aware Enhancement of Metric Depth
- 2026Robust Depth Super-Resolution via Adaptive Diffusion Sampling
- 2024Voxeland: Probabilistic Instance-Aware Semantic Mapping with Evidence-based Uncertainty Quantification
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering
- 2026DVD: Discrete Voxel Diffusion for 3D Generation and Editing
- 2024R2-Mesh: Reinforcement Learning Powered Mesh Reconstruction via Geometry and Appearance Refinement