NeBula: Quest for Robotic Autonomy in Challenging Environments; TEAM CoSTAR at the DARPA Subterranean Challenge
Not on the map. Why?
Abstract (arXiv)
This paper presents and discusses algorithms, hardware, and software architecture developed by the TEAM CoSTAR (Collaborative SubTerranean Autonomous Robots), competing in the DARPA Subterranean Challenge. Specifically, it presents the techniques utilized within the Tunnel (2019) and Urban (2020) competitions, where CoSTAR achieved 2nd and 1st place, respectively. We also discuss CoSTAR's demonstrations in Martian-analog surface and subsurface (lava tubes) exploration. The paper introduces our autonomy solution, referred to as NeBula (Networked Belief-aware Perceptual Autonomy). NeBula is an uncertainty-aware framework that aims at enabling resilient and modular autonomy solutions by performing reasoning and decision making in the belief space (space of probability distributions over the robot and world states). We discuss various components of the NeBula framework, including: (i) geometric and semantic environment mapping; (ii) a multi-modal positioning system; (iii) traversability analysis and local planning; (iv) global motion planning and exploration behavior; (i) risk-aware mission planning; (vi) networking and decentralized reasoning; and (vii) learning-enabled adaptation. We discuss the performance of NeBula on several robot types (e.g. wheeled, legged, flying), in various environments. We discuss the specific results and lessons learned from fielding this solution in the challenging courses of the DARPA Subterranean Challenge competition.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 38 of its 119 references that are in the map. First posted on arXiv 21 Mar 2021.
Builds on
38 of 119 references.
References · 38
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
- 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 185
- 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 181
- 2020MobileDets: Searching for Object Detection Architectures for Mobile Acceleratorscited by 55
- 2019Tightly Coupled 3D Lidar Inertial Odometry and Mappingcited by 34
- 2019DOOR-SLAM: Distributed, Online, and Outlier Resilient SLAM for Robotic Teamscited by 28
- 2021STEP: Stochastic Traversability Evaluation and Planning for Risk-Aware Off-road Navigationcited by 27
- 2019Bayesian Learning-Based Adaptive Control for Safety Critical Systemscited by 19
26 more
- 2020LAMP: Large-Scale Autonomous Mapping and Positioning for Exploration of Perceptually-Degraded Subterranean Environmentscited by 19
- 2020Autonomous Spot: Long-Range Autonomous Exploration of Extreme Environments with Legged Locomotioncited by 18
- 2020LOCUS: A Multi-Sensor Lidar-Centric Solution for High-Precision Odometry and 3D Mapping in Real-Timecited by 16
- 2020Deep Learning Tubes for Tube MPCcited by 14
- 2020Temporal Segmentation of Surgical Sub-tasks through Deep Learning with Multiple Data Sourcescited by 12
- 2021PLGRIM: Hierarchical Value Learning for Large-scale Exploration in Unknown Environmentscited by 12
- 2017Distributed Mapping with Privacy and Communication Constraints: Lightweight Algorithms and Object-based Modelscited by 11
- 2021DARE-SLAM: Degeneracy-Aware and Resilient Loop Closing in Perceptually-Degraded Environmentscited by 9
- 2020Towards Resilient Autonomous Navigation of Dronescited by 8
- 2019Mine Tunnel Exploration using Multiple Quadrupedal Robotscited by 7
- 2020Confidence-rich grid mappingcited by 7
- 2019Bi-directional Value Learning for Risk-aware Planning Under Uncertainty: Extended Versioncited by 6
- 2020Where to Map? Iterative Rover-Copter Path Planning for Mars Explorationcited by 6
- 2021LION: Lidar-Inertial Observability-Aware Navigator for Vision-Denied Environmentscited by 6
- 2014On the Covariance of ICP-based Scan-matching Techniquescited by 5
- 2019Contact Inertial Odometry: Collisions are your Friendscited by 5
- 2020Virtual Surfaces and Attitude Aware Planning and Behaviours for Negative Obstacle Navigationcited by 5
- 2018Path Planning and Navigation Inside Off-World Lava Tubes and Cavescited by 4
- 2021Autonomous Off-road Navigation over Extreme Terrains with Perceptually-challenging Conditionscited by 4
- 2020Shapeshifter: A Multi-Agent, Multi-Modal Robotic Platform for Exploration of Titancited by 3
- 2020Autonomous Hybrid Ground/Aerial Mobility in Unknown Environmentscited by 3
- 2020APF-PF: Probabilistic Depth Perception for 3D Reactive Obstacle Avoidancecited by 2
- 2020MSL-RAPTOR: A 6DoF Relative Pose Tracker for Onboard Robotic Perceptioncited by 2
- 2020The Shapeshifter: a Morphing, Multi-Agent,Multi-Modal Robotic Platform for the Exploration of Titan (preprint version)cited by 1
- 2020The Kinematics of Tracked Vehicles via the Power Dissipation Methodcited by 1
- 2021BAXTER: Bi-modal Aerial-Terrestrial Hybrid Vehicle for Long-endurance Versatile Mobility: Preprint Versioncited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 11; 2023: 4; 2024: 7; 2025: 3; 2026: 5.
32 papers.
Sort:
By area:
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systemscited by 53
- 2024DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Darkcited by 25
- 2022Probabilistic Volumetric Fusion for Dense Monocular SLAMcited by 16
- 2023Learning Risk-Aware Costmaps via Inverse Reinforcement Learning for Off-Road Navigationcited by 15
- 2022DeepMapping2: Self-Supervised Large-Scale LiDAR Map Optimizationcited by 14
- 2022Learning Robotic Navigation from Experience: Principles, Methods, and Recent Resultscited by 13
- 2021Learning Risk-aware Costmaps for Traversability in Challenging Environmentscited by 12
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environmentscited by 11
- 2022Sim-to-Real via Sim-to-Seg: End-to-end Off-road Autonomous Driving Without Real Datacited by 9
20 more
- 2022UAVs Beneath the Surface: Cooperative Autonomy for Subterranean Search and Rescue in DARPA SubTcited by 7
- 2023FRAME: Fast and Robust Autonomous 3D point cloud Map-merging for Egocentric multi-robot explorationcited by 6
- 2024RecNet: An Invertible Point Cloud Encoding through Range Image Embeddings for Multi-Robot Map Sharing and Reconstructioncited by 6
- 2024PhotoReg: Photometrically Registering 3D Gaussian Splatting Modelscited by 5
- 2024STAGE: Scalable and Traversability-Aware Graph based Exploration Planner for Dynamically Varying Environmentscited by 3
- 2024SayComply: Grounding Field Robotic Tasks in Operational Compliance through Retrieval-Based Language Modelscited by 3
- 2025Deploying Foundation Model-Enabled Air and Ground Robots in the Field: Challenges and Opportunitiescited by 3
- 2026WildOS: Open-Vocabulary Object Search in the Wildcited by 3
- 2022Copiloting Autonomous Multi-Robot Missions: A Game-inspired Supervisory Control Interfacecited by 1
- 2022Early Recall, Late Precision: Multi-Robot Semantic Object Mapping under Operational Constraints in Perceptually-Degraded Environmentscited by 1
- 2022Learning to Assess Danger from Movies for Cooperative Escape Planning in Hazardous Environmentscited by 1
- 2022Risk-aware Meta-level Decision Making for Exploration Under Uncertaintycited by 1
- 2022Virtual Reality via Object Pose Estimation and Active Learning: Realizing Telepresence Robots with Aerial Manipulation Capabilitiescited by 1
- 2023Multimodal Dataset from Harsh Sub-Terranean Environment with Aerosol Particles for Frontier Explorationcited by 1
- 2026Agent Mars: Multi-Agent Simulation for Multi-Planetary Life Exploration and Settlementcited by 1
- 2024Staircase Localization for Autonomous Exploration in Urban Environmentscited by 0
- 2025Olympus: A Jumping Quadruped for Planetary Exploration Utilizing Reinforcement Learning for In-Flight Attitude Controlcited by 0
- 2026Optimized Human-Robot Co-Dispatch Planning for Petro-Site Surveillance under Varying Criticalitiescited by 0
- 2026SPIRIT: Perceptive Shared Autonomy for Robust Robotic Manipulation under Deep Learning Uncertaintycited by 0
- 2026Physical Agentic AI: An Architecture for Orchestrating a Robot Crew with LLMscited by 0
- 2026Physical Agentic AI: An Architecture for Orchestrating a Robot Crew with LLMs23 Aug 2026
- 2026SPIRIT: Perceptive Shared Autonomy for Robust Robotic Manipulation under Deep Learning Uncertainty5 Mar 2026
- 2026WildOS: Open-Vocabulary Object Search in the Wild22 Feb 2026
- 2026Agent Mars: Multi-Agent Simulation for Multi-Planetary Life Exploration and Settlement9 Feb 2026
- 2026Optimized Human-Robot Co-Dispatch Planning for Petro-Site Surveillance under Varying Criticalities8 Feb 2026
- 2025Deploying Foundation Model-Enabled Air and Ground Robots in the Field: Challenges and Opportunities14 May 2025
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environments14 May 2025
- 2025Olympus: A Jumping Quadruped for Planetary Exploration Utilizing Reinforcement Learning for In-Flight Attitude Control5 Mar 2025
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Models21 Nov 2024
- 2024SayComply: Grounding Field Robotic Tasks in Operational Compliance through Retrieval-Based Language Models18 Nov 2024
- 2024PhotoReg: Photometrically Registering 3D Gaussian Splatting Models7 Oct 2024
- 2024Staircase Localization for Autonomous Exploration in Urban Environments26 Mar 2024
20 more
- 2024DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Dark16 Mar 2024
- 2024STAGE: Scalable and Traversability-Aware Graph based Exploration Planner for Dynamically Varying Environments4 Feb 2024
- 2024RecNet: An Invertible Point Cloud Encoding through Range Image Embeddings for Multi-Robot Map Sharing and Reconstruction3 Feb 2024
- 2023ViNT: A Foundation Model for Visual Navigation26 Jun 2023
- 2023Multimodal Dataset from Harsh Sub-Terranean Environment with Aerosol Particles for Frontier Exploration27 Apr 2023
- 2023Learning Risk-Aware Costmaps via Inverse Reinforcement Learning for Off-Road Navigation31 Jan 2023
- 2023FRAME: Fast and Robust Autonomous 3D point cloud Map-merging for Egocentric multi-robot exploration22 Jan 2023
- 2022Learning Robotic Navigation from Experience: Principles, Methods, and Recent Results13 Dec 2022
- 2022DeepMapping2: Self-Supervised Large-Scale LiDAR Map Optimization13 Dec 2022
- 2022Sim-to-Real via Sim-to-Seg: End-to-end Off-road Autonomous Driving Without Real Data25 Oct 2022
- 2022Virtual Reality via Object Pose Estimation and Active Learning: Realizing Telepresence Robots with Aerial Manipulation Capabilities18 Oct 2022
- 2022GNM: A General Navigation Model to Drive Any Robot7 Oct 2022
- 2022Probabilistic Volumetric Fusion for Dense Monocular SLAM3 Oct 2022
- 2022Risk-aware Meta-level Decision Making for Exploration Under Uncertainty12 Sep 2022
- 2022Learning to Assess Danger from Movies for Cooperative Escape Planning in Hazardous Environments27 Jul 2022
- 2022Early Recall, Late Precision: Multi-Robot Semantic Object Mapping under Operational Constraints in Perceptually-Degraded Environments21 Jun 2022
- 2022UAVs Beneath the Surface: Cooperative Autonomy for Subterranean Search and Rescue in DARPA SubT16 Jun 2022
- 2022Copiloting Autonomous Multi-Robot Missions: A Game-inspired Supervisory Control Interface13 Apr 2022
- 2021Learning Risk-aware Costmaps for Traversability in Challenging Environments25 Jul 2021
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systems28 Jun 2021
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systemscited by 53
- 2024DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Darkcited by 25
- 2022Probabilistic Volumetric Fusion for Dense Monocular SLAMcited by 16
- 2022DeepMapping2: Self-Supervised Large-Scale LiDAR Map Optimizationcited by 14
- 2022Learning Robotic Navigation from Experience: Principles, Methods, and Recent Resultscited by 13
- 2021Learning Risk-aware Costmaps for Traversability in Challenging Environmentscited by 12
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environmentscited by 11
- 2022UAVs Beneath the Surface: Cooperative Autonomy for Subterranean Search and Rescue in DARPA SubTcited by 7
- 2023FRAME: Fast and Robust Autonomous 3D point cloud Map-merging for Egocentric multi-robot explorationcited by 6
- 2024RecNet: An Invertible Point Cloud Encoding through Range Image Embeddings for Multi-Robot Map Sharing and Reconstructioncited by 6
12 most cited of 27 All 27 (JSON)
- 2026SPIRIT: Perceptive Shared Autonomy for Robust Robotic Manipulation under Deep Learning Uncertainty5 Mar 2026
- 2026WildOS: Open-Vocabulary Object Search in the Wild22 Feb 2026
- 2026Agent Mars: Multi-Agent Simulation for Multi-Planetary Life Exploration and Settlement9 Feb 2026
- 2026Optimized Human-Robot Co-Dispatch Planning for Petro-Site Surveillance under Varying Criticalities8 Feb 2026
- 2025Deploying Foundation Model-Enabled Air and Ground Robots in the Field: Challenges and Opportunities14 May 2025
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environments14 May 2025
- 2025Olympus: A Jumping Quadruped for Planetary Exploration Utilizing Reinforcement Learning for In-Flight Attitude Control5 Mar 2025
- 2024PhotoReg: Photometrically Registering 3D Gaussian Splatting Models7 Oct 2024
- 2024Staircase Localization for Autonomous Exploration in Urban Environments26 Mar 2024
- 2024DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Dark16 Mar 2024
- 2024STAGE: Scalable and Traversability-Aware Graph based Exploration Planner for Dynamically Varying Environments4 Feb 2024
- 2024RecNet: An Invertible Point Cloud Encoding through Range Image Embeddings for Multi-Robot Map Sharing and Reconstruction3 Feb 2024
12 newest of 27 All 27 (JSON)