Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planning
Not on the map. Why?
Abstract (arXiv)
Micro Aerial Vehicles (MAVs) that operate in unstructured, unexplored environments require fast and flexible local planning, which can replan when new parts of the map are explored. Trajectory optimization methods fulfill these needs, but require obstacle distance information, which can be given by Euclidean Signed Distance Fields (ESDFs). We propose a method to incrementally build ESDFs from Truncated Signed Distance Fields (TSDFs), a common implicit surface representation used in computer graphics and vision. TSDFs are fast to build and smooth out sensor noise over many observations, and are designed to produce surface meshes. Meshes allow human operators to get a better assessment of the robot's environment, and set high-level mission goals. We show that we can build TSDFs faster than Octomaps, and that it is more accurate to build ESDFs out of TSDFs than occupancy maps. Our complete system, called voxblox, will be available as open source and runs in real-time on a single CPU core. We validate our approach on-board an MAV, by using our system with a trajectory optimization local planner, entirely on-board and in real-time.
Key facts. Cited by 150 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 28; 2023: 27; 2024: 29; 2025: 27; 2026: 24.
150 papers.
Sort:
By area:
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 154
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2021Learning High-Speed Flight in the Wildcited by 128
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 109
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 66
- 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Fieldcited by 61
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splatscited by 60
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2022SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural Representationscited by 44
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistencycited by 42
38 more
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2023Active Neural Mappingcited by 31
- 2024Bootstrapping Reinforcement Learning with Imitation for Vision-Based Agile Flightcited by 31
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2022S-Graphs+: Real-time Localization and Mapping leveraging Hierarchical Representationscited by 28
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Reviewcited by 25
- 2023Resilient Legged Local Navigation: Learning to Traverse with Compromised Perception End-to-Endcited by 23
- 2024GSFusion: Online RGB-D Mapping Where Gaussian Splatting Meets TSDF Fusioncited by 20
- 2023UncLe-SLAM: Uncertainty Learning for Dense Neural SLAMcited by 19
- 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splattingcited by 18
- 2022FD-SLAM: 3-D Reconstruction Using Features and Dense Matchingcited by 17
- 2022N2M2: Learning Navigation for Arbitrary Mobile Manipulation Motions in Unseen and Dynamic Environmentscited by 16
- 2022Probabilistic Volumetric Fusion for Dense Monocular SLAMcited by 16
- 2021DPMPC-Planner: A real-time UAV trajectory planning framework for complex static environments with dynamic obstaclescited by 15
- 2021From SLAM to Situational Awareness: Challenges and Surveycited by 15
- 2023Contrastive Learning for Enhancing Robust Scene Transfer in Vision-based Agile Flightcited by 15
- 2021NeuralBlox: Real-Time Neural Representation Fusion for Robust Volumetric Mappingcited by 14
- 2022A Review on Viewpoints and Path-planning for UAV-based 3D Reconstructioncited by 14
- 2023Panoptic Mapping with Fruit Completion and Pose Estimation for Horticultural Robotscited by 14
- 2021A Real-Time Online Learning Framework for Joint 3D Reconstruction and Semantic Segmentation of Indoor Scenescited by 12
- 2022Neural Scene Representation for Locomotion on Structured Terraincited by 12
- 2021ASH: A Modern Framework for Parallel Spatial Hashing in 3D Perceptioncited by 11
- 2023ImMesh: An Immediate LiDAR Localization and Meshing Frameworkcited by 11
- 2023MEM: Multi-Modal Elevation Mapping for Robotics and Learningcited by 11
- 2023ConvBKI: Real-Time Probabilistic Semantic Mapping Network with Quantifiable Uncertaintycited by 11
- 2024DUFOMap: Efficient Dynamic Awareness Mappingcited by 11
- 2024Diffusion Models in 3D Vision: A Surveycited by 11
- 2022RGB-Only Reconstruction of Tabletop Scenes for Collision-Free Manipulator Controlcited by 10
- 2025PINGS: Gaussian Splatting Meets Distance Fields within a Point-Based Implicit Neural Mapcited by 10
- 2022Vision-aided UAV navigation and dynamic obstacle avoidance using gradient-based B-spline trajectory optimizationcited by 9
- 2022NBV-SC: Next Best View Planning based on Shape Completion for Fruit Mapping and Reconstructioncited by 9
- 2023EVI-SAM: Robust, Real-time, Tightly-coupled Event-Visual-Inertial State Estimation and 3D Dense Mappingcited by 9
- 2022Convolutional Bayesian Kernel Inference for 3D Semantic Mappingcited by 8
- 2023A Dynamic Points Removal Benchmark in Point Cloud Mapscited by 8
- 2025SG-Reg: Generalizable and Efficient Scene Graph Registrationcited by 8
- 2022SC-Explorer: Incremental 3D Scene Completion for Safe and Efficient Exploration Mapping and Planningcited by 7
- 2022City-scale Incremental Neural Mapping with Three-layer Sampling and Panoptic Representationcited by 7
- 2023Probabilistic Point Cloud Modeling via Self-Organizing Gaussian Mixture Modelscited by 7
50 most cited of 150 All 150 (JSON)
- 2026Visual Navigation Transformer with Pose Attention18 Sep 2026
- 2026Uncertainty-Aware RL-Controlled Adaptive 3D Mapping17 Sep 2026
- 2026Proximity3D: Shape from Capacitive Proximity on Sensing Manifold31 Aug 2026
- 2026SGE: Semantically-Guided Exploration for Unstructured Environments via Image-Space Waypoint Sampling29 Aug 2026
- 2026Accelerating Large-scale Bundle Adjustment for LiDAR Mapping via Parallel Computing14 Aug 2026
- 2026From Distances to Trajectories: Real-Time Signed Distance Function Mapping and Distance-Accelerated Motion Planning for UAVs21 Jul 2026
- 2026Learning Adaptive Safety Margins for Visual Navigation20 Jul 2026
- 2026Real-Time LiDAR Gaussian Splatting SLAM5 Jul 2026
- 2026Lightweight Safe Reinforcement Learning for End-to-End UAV Navigation2 Jul 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026Guided Diffusion with Distilled Vision-Language Reliability for Aerial Navigation11 Jun 2026
- 2026SkyShield: Occupancy as a Safety Interface for Low-Altitude UAV Autonomy30 May 2026
38 more
- 2026A Survey of Spatial Memory Representations for Efficient Robot Navigation13 Apr 2026
- 2026Incremental Semantics-Aided Meshing from LiDAR-Inertial Odometry and RGB Direct Label Transfer10 Apr 2026
- 2026G-EDF-Loc: 3D Continuous Gaussian Distance Field for Robust Gradient-Based 6DoF Localization6 Apr 2026
- 2026OVI-MAP:Open-Vocabulary Instance-Semantic Mapping27 Mar 2026
- 2026Toward Generalist Neural Motion Planners for Robotic Manipulators: Challenges and Opportunities25 Mar 2026
- 2026Memory Over Maps: 3D Object Localization Without Reconstruction20 Mar 2026
- 2026FlatLands: Generative Floormap Completion From a Single Egocentric View16 Mar 2026
- 2026BayesFusion-SDF: Probabilistic Signed Distance Fusion with View Planning on CPU23 Feb 2026
- 2026WildOS: Open-Vocabulary Object Search in the Wild22 Feb 2026
- 2026EUGens: Efficient, Unified, and General Dense Layers30 Jan 2026
- 2026OpenNavMap: Multi-Session Appearance-Based Topometric Mapping for Scalable Visual Navigation18 Jan 2026
- 2026Affostruction: 3D Affordance Grounding with Generative Reconstruction14 Jan 2026
- 2025XGrid-Mapping: Explicit Implicit Hybrid Grid Submaps for Efficient Incremental Neural LiDAR Mapping24 Dec 2025
- 2025ACE-SLAM: Scene Coordinate Regression for Neural Implicit Real-Time SLAM16 Dec 2025
- 2025SLIM-VDB: A Real-Time 3D Probabilistic Semantic Mapping Framework15 Dec 2025
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Models3 Dec 2025
- 2025Splatblox: Traversability-Aware Gaussian Splatting for Outdoor Robot Navigation23 Nov 2025
- 2025C2F-Space: Coarse-to-Fine Space Grounding for Spatial Instructions using Vision-Language Models19 Nov 2025
- 2025OREN: Octree Residual Network for Real-Time Euclidean Signed Distance Mapping21 Oct 2025
- 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM21 Sep 2025
- 2025DUViN: Diffusion-Based Underwater Visual Navigation via Knowledge-Transferred Depth Features3 Sep 2025
- 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splatting20 Aug 2025
- 2025Unified Linear Parametric Map Modeling and Perception-aware Trajectory Planning for Mobile Robotics12 Jul 2025
- 2025Object-X: Learning to Reconstruct Multi-Modal 3D Object Representations5 Jun 2025
- 2025Semantically-driven Deep Reinforcement Learning for Inspection Path Planning20 May 2025
- 2025A Survey of 3D Reconstruction with Event Cameras13 May 2025
- 2025SG-Reg: Generalizable and Efficient Scene Graph Registration20 Apr 2025
- 2025Learning Scene-Level Signed Directional Distance Function with Ellipsoidal Priors and Neural Residuals25 Mar 2025
- 2025GI-SLAM: Gaussian-Inertial SLAM24 Mar 2025
- 2025Splat-LOAM: Gaussian Splatting LiDAR Odometry and Mapping21 Mar 2025
- 2025ADAPT: An Autonomous Forklift for Construction Site Operation18 Mar 2025
- 2025Prof. Robot: Differentiable Robot Rendering Without Static and Self-Collisions14 Mar 2025
- 2025Neural Configuration-Space Barriers for Manipulation Planning and Control6 Mar 2025
- 2025EvidMTL: Evidential Multi-Task Learning for Uncertainty-Aware Semantic Surface Mapping from Monocular RGB Images6 Mar 2025
- 2025vS-Graphs: Tightly Coupling Visual SLAM and 3D Scene Graphs Exploiting Hierarchical Scene Understanding3 Mar 2025
- 2025PUGS: Perceptual Uncertainty for Grasp Selection in Underwater Environments13 Feb 2025
- 2025PINGS: Gaussian Splatting Meets Distance Fields within a Point-Based Implicit Neural Map9 Feb 2025
- 2025SiLVR: Scalable Lidar-Visual Radiance Field Reconstruction with Uncertainty Quantification4 Feb 2025
50 newest of 150 All 150 (JSON)
- 2024FM-Fusion: Instance-aware Semantic Mapping Boosted by Vision-Language Foundation Modelscited by 3
- 2026Memory Over Maps: 3D Object Localization Without Reconstructioncited by 1
- 2025C2F-Space: Coarse-to-Fine Space Grounding for Spatial Instructions using Vision-Language Modelscited by 0
- 2026Guided Diffusion with Distilled Vision-Language Reliability for Aerial Navigationcited by 0
- 2026Guided Diffusion with Distilled Vision-Language Reliability for Aerial Navigation11 Jun 2026
- 2026Memory Over Maps: 3D Object Localization Without Reconstruction20 Mar 2026
- 2025C2F-Space: Coarse-to-Fine Space Grounding for Spatial Instructions using Vision-Language Models19 Nov 2025
- 2024FM-Fusion: Instance-aware Semantic Mapping Boosted by Vision-Language Foundation Models7 Feb 2024
- 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splattingcited by 18
- 2024Diffusion Models in 3D Vision: A Surveycited by 11
- 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splatting20 Aug 2025
- 2024Diffusion Models in 3D Vision: A Survey7 Oct 2024
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 154
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2021Learning High-Speed Flight in the Wildcited by 128
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 109
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 66
- 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Fieldcited by 61
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splatscited by 60
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2022SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural Representationscited by 44
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistencycited by 42
12 most cited of 138 All 138 (JSON)
- 2026Visual Navigation Transformer with Pose Attention18 Sep 2026
- 2026Uncertainty-Aware RL-Controlled Adaptive 3D Mapping17 Sep 2026
- 2026Proximity3D: Shape from Capacitive Proximity on Sensing Manifold31 Aug 2026
- 2026SGE: Semantically-Guided Exploration for Unstructured Environments via Image-Space Waypoint Sampling29 Aug 2026
- 2026Accelerating Large-scale Bundle Adjustment for LiDAR Mapping via Parallel Computing14 Aug 2026
- 2026From Distances to Trajectories: Real-Time Signed Distance Function Mapping and Distance-Accelerated Motion Planning for UAVs21 Jul 2026
- 2026Learning Adaptive Safety Margins for Visual Navigation20 Jul 2026
- 2026Real-Time LiDAR Gaussian Splatting SLAM5 Jul 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026SkyShield: Occupancy as a Safety Interface for Low-Altitude UAV Autonomy30 May 2026
- 2026A Survey of Spatial Memory Representations for Efficient Robot Navigation13 Apr 2026
- 2026Incremental Semantics-Aided Meshing from LiDAR-Inertial Odometry and RGB Direct Label Transfer10 Apr 2026
12 newest of 138 All 138 (JSON)