BADGR: An Autonomous Self-Supervised Learning-Based Navigation System
Not on the map. Why?
Abstract (arXiv)
Mobile robot navigation is typically regarded as a geometric problem, in which the robot's objective is to perceive the geometry of the environment in order to plan collision-free paths towards a desired goal. However, a purely geometric view of the world can can be insufficient for many navigation problems. For example, a robot navigating based on geometry may avoid a field of tall grass because it believes it is untraversable, and will therefore fail to reach its desired goal. In this work, we investigate how to move beyond these purely geometric-based approaches using a method that learns about physical navigational affordances from experience. Our approach, which we call BADGR, is an end-to-end learning-based mobile robot navigation system that can be trained with self-supervised off-policy data gathered in real-world environments, without any simulation or human supervision. BADGR can navigate in real-world urban and off-road environments with geometrically distracting obstacles. It can also incorporate terrain preferences, generalize to novel environments, and continue to improve autonomously by gathering more data. Videos, code, and other supplemental material are available on our website https://sites.google.com/view/badgr
Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 2; 2021: 21; 2022: 20; 2023: 16; 2024: 17; 2025: 10; 2026: 11.
97 papers.
Sort:
By area:
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2022Prompting Decision Transformer for Few-Shot Policy Generalizationcited by 143
- 2023Large Language Models for Robotics: A Surveycited by 132
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2021Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformerscited by 71
- 2021Continual Learning for Real-World Autonomous Systems: Algorithms, Challenges and Frameworkscited by 56
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 55
- 2021GANav: Efficient Terrain Segmentation for Robot Navigation in Unstructured Outdoor Environmentscited by 51
- 2023Fast Traversability Estimation for Wild Visual Navigationcited by 41
- 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 40
- 2023Not Only Rewards But Also Constraints: Applications on Legged Robot Locomotioncited by 33
38 more
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robotscited by 32
- 2021Learning a State Representation and Navigation in Cluttered and Dynamic Environmentscited by 30
- 2021Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulationcited by 30
- 2022WayFAST: Navigation with Predictive Traversability in the Fieldcited by 30
- 2022How Does It Feel? Self-Supervised Costmap Learning for Off-Road Vehicle Traversabilitycited by 24
- 2021UMBRELLA: Uncertainty-Aware Model-Based Offline Reinforcement Learning Leveraging Planningcited by 23
- 2022Learning Visual Locomotion with Cross-Modal Supervisioncited by 23
- 2024RoadRunner -- Learning Traversability Estimation for Autonomous Off-road Drivingcited by 23
- 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigationcited by 23
- 2022ScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environmentscited by 21
- 2021Learned Visual Navigation for Under-Canopy Agricultural Robotscited by 18
- 2021Dealing with the Unknown: Pessimistic Offline Reinforcement Learningcited by 18
- 2023EVORA: Deep Evidential Traversability Learning for Risk-Aware Off-Road Autonomycited by 18
- 2020APPLD: Adaptive Planner Parameter Learning from Demonstrationcited by 17
- 2021Visual Representation Learning for Preference-Aware Path Planningcited by 17
- 2022Risk-Aware Off-Road Navigation via a Learned Speed Distribution Mapcited by 17
- 2022ExAug: Robot-Conditioned Navigation Policies via Geometric Experience Augmentationcited by 17
- 2022Proactive Anomaly Detection for Robot Navigation with Multi-Sensor Fusioncited by 15
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervisioncited by 15
- 2022Learning Robotic Navigation from Experience: Principles, Methods, and Recent Resultscited by 13
- 2022RCA: Ride Comfort-Aware Visual Navigation via Self-Supervised Learningcited by 10
- 2023STERLING: Self-Supervised Terrain Representation Learning from Unconstrained Robot Experiencecited by 10
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 10
- 2023Accountability in Offline Reinforcement Learning: Explaining Decisions with a Corpus of Examplescited by 9
- 2025CREStE: Scalable Mapless Navigation with Internet Scale Priors and Counterfactual Guidancecited by 9
- 2022Mars Terrain Segmentation with Less Labelscited by 7
- 2023Learning Terrain-Aware Kinodynamic Model for Autonomous Off-Road Rally Driving With Model Predictive Path Integral Controlcited by 7
- 2021Navigation-Oriented Scene Understanding for Robotic Autonomy: Learning to Segment Driveability in Egocentric Imagescited by 6
- 2021Towards Disturbance-Free Visual Mobile Manipulationcited by 6
- 2022Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigationcited by 6
- 2023Wait, That Feels Familiar: Learning to Extrapolate Human Preferences for Preference Aligned Path Planningcited by 6
- 2023Revisiting Bellman Errors for Offline Model Selectioncited by 5
- 2023Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perceptioncited by 5
- 2024Reusing Historical Trajectories in Natural Policy Gradient via Importance Sampling: Convergence and Convergence Ratecited by 5
- 2024RoadRunner M&M -- Learning Multi-range Multi-resolution Traversability Maps for Autonomous Off-road Navigationcited by 5
- 2021Dynamic Semantic Occupancy Mapping using 3D Scene Flow and Closed-Form Bayesian Inferencecited by 4
- 2022Exploring the Intersection between Neural Architecture Search and Continual Learningcited by 4
- 2022Energy-based Legged Robots Terrain Traversability Modeling via Deep Inverse Reinforcement Learningcited by 4
50 most cited of 97 All 97 (JSON)
- 2026FLINT: Fast Lightweight Inference for Traversability22 Sep 2026
- 2026GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failures31 Aug 2026
- 2026TravKAN: Fast and Interpretable Nonlinear Traversability Analysis with Kolmogorov-Arnold Networks3 Aug 2026
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation14 Jun 2026
- 2026Self-Supervised Online Robot-Agnostic Traversability Estimation for Open-World Environments27 May 2026
- 2026Trinity: Unifying Class-Agnostic Terrain and Semantic Segmentation for Unstructured Outdoor Environments by Leveraging Synthetic Data26 May 2026
- 2026Geometry-Guided Self-Supervision for Ultra-Fine-Grained Recognition with Limited Data21 Apr 2026
- 2026Divide-and-Conquer Approach to Holistic Cognition in High-Similarity Contexts with Limited Data21 Apr 2026
- 2026Your Vision-Language-Action Model Already Has Attention Heads For Path Deviation Detection14 Mar 2026
- 2026VORL-EXPLORE: A Hybrid Learning Planning Approach to Multi-Robot Exploration in Dynamic Environments9 Mar 2026
- 2026SuReNav: Superpixel Graph-based Constraint Relaxation for Navigation in Over-constrained Environments6 Feb 2026
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges4 Dec 2025
38 more
- 2025Synthetic vs. Real Training Data for Visual Navigation15 Sep 2025
- 2025Mars Traversability Prediction: A Multi-modal Self-supervised Approach for Costmap Generation14 Sep 2025
- 2025ZeST: an VLM-based Zero-Shot Traversability Navigation for Unknown Environments26 Aug 2025
- 2025Are Learning-Based Approaches Ready for Real-World Indoor Navigation? A Case for Imitation Learning5 Jul 2025
- 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigation14 Apr 2025
- 2025CREStE: Scalable Mapless Navigation with Internet Scale Priors and Counterfactual Guidance5 Mar 2025
- 2025Learning Autonomy: Off-Road Navigation Enhanced by Human Input26 Feb 2025
- 2025FusionForce: End-to-end Differentiable Neural-Symbolic Layer for Trajectory Prediction14 Feb 2025
- 2025Watch Your STEPP: Semantic Traversability Estimation using Pose Projected Features29 Jan 2025
- 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videos26 Nov 2024
- 2024Fed-EC: Bandwidth-Efficient Clustering-Based Federated Learning For Autonomous Visual Robot Navigation6 Nov 2024
- 2024PACER: Preference-conditioned All-terrain Costmap Generation30 Oct 2024
- 2024Words to Wheels: Vision-Based Autonomous Driving Understanding Human Language Instructions Using Foundation Models14 Oct 2024
- 2024SSL-NBV: A Self-Supervised-Learning-Based Next-Best-View algorithm for Efficient 3D Plant Reconstruction by a Robot2 Oct 2024
- 2024Development and Validation of Heparin Dosing Policies Using an Offline Reinforcement Learning Algorithm24 Sep 2024
- 2024Learning a Terrain- and Robot-Aware Dynamics Model for Autonomous Mobile Robot Navigation17 Sep 2024
- 2024RoadRunner M&M -- Learning Multi-range Multi-resolution Traversability Maps for Autonomous Off-road Navigation17 Sep 2024
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes7 Aug 2024
- 2024Learning Semantic Traversability with Egocentric Video and Automated Annotation Strategy5 Jun 2024
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robots3 May 2024
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervision10 Apr 2024
- 2024Constrained Robotic Navigation on Preferred Terrains Using LLMs and Speech Instruction: Exploiting the Power of Adverbs2 Apr 2024
- 2024Reusing Historical Trajectories in Natural Policy Gradient via Importance Sampling: Convergence and Convergence Rate1 Mar 2024
- 2024RoadRunner -- Learning Traversability Estimation for Autonomous Off-road Driving29 Feb 2024
- 2024CURE: Simulation-Augmented Auto-Tuning in Robotics8 Feb 2024
- 2024A GP-based Robust Motion Planning Framework for Agile Autonomous Robot Navigation and Recovery in Unknown Environments2 Feb 2024
- 2023Large Language Models for Robotics: A Survey13 Nov 2023
- 2023EVORA: Deep Evidential Traversability Learning for Risk-Aware Off-Road Autonomy10 Nov 2023
- 2023Accountability in Offline Reinforcement Learning: Explaining Decisions with a Corpus of Examples11 Oct 2023
- 2023STERLING: Self-Supervised Terrain Representation Learning from Unconstrained Robot Experience26 Sep 2023
- 2023Guided Cooperation in Hierarchical Reinforcement Learning via Model-based Rollout24 Sep 2023
- 2023Wait, That Feels Familiar: Learning to Extrapolate Human Preferences for Preference Aligned Path Planning18 Sep 2023
- 2023VAPOR: Legged Robot Navigation in Outdoor Vegetation Using Offline Reinforcement Learning14 Sep 2023
- 2023Not Only Rewards But Also Constraints: Applications on Legged Robot Locomotion24 Aug 2023
- 2023Avoidance Navigation Based on Offline Pre-Training Reinforcement Learning3 Aug 2023
- 2023Context-Conditional Navigation with a Learning-Based Terrain- and Robot-Aware Dynamics Model18 Jul 2023
- 2023Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perception26 Jun 2023
- 2023PlayBest: Professional Basketball Player Behavior Synthesis via Planning with Diffusion7 Jun 2023
50 newest of 97 All 97 (JSON)
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
- 2022Prompting Decision Transformer for Few-Shot Policy Generalizationcited by 143
- 2021UMBRELLA: Uncertainty-Aware Model-Based Offline Reinforcement Learning Leveraging Planningcited by 23
- 2021Dealing with the Unknown: Pessimistic Offline Reinforcement Learningcited by 18
- 2020APPLD: Adaptive Planner Parameter Learning from Demonstrationcited by 17
- 2023Accountability in Offline Reinforcement Learning: Explaining Decisions with a Corpus of Examplescited by 9
- 2023Revisiting Bellman Errors for Offline Model Selectioncited by 5
- 2022Energy-based Legged Robots Terrain Traversability Modeling via Deep Inverse Reinforcement Learningcited by 4
- 2022TD3 with Reverse KL Regularizer for Offline Reinforcement Learning from Mixed Datasetscited by 4
- 2023VAPOR: Legged Robot Navigation in Outdoor Vegetation Using Offline Reinforcement Learningcited by 1
- 2025Are Learning-Based Approaches Ready for Real-World Indoor Navigation? A Case for Imitation Learningcited by 0
- 2025Are Learning-Based Approaches Ready for Real-World Indoor Navigation? A Case for Imitation Learning5 Jul 2025
- 2023Accountability in Offline Reinforcement Learning: Explaining Decisions with a Corpus of Examples11 Oct 2023
- 2023VAPOR: Legged Robot Navigation in Outdoor Vegetation Using Offline Reinforcement Learning14 Sep 2023
- 2023Revisiting Bellman Errors for Offline Model Selection31 Jan 2023
- 2022TD3 with Reverse KL Regularizer for Offline Reinforcement Learning from Mixed Datasets5 Dec 2022
- 2022Energy-based Legged Robots Terrain Traversability Modeling via Deep Inverse Reinforcement Learning7 Jul 2022
- 2022Prompting Decision Transformer for Few-Shot Policy Generalization27 Jun 2022
- 2021UMBRELLA: Uncertainty-Aware Model-Based Offline Reinforcement Learning Leveraging Planning22 Nov 2021
- 2021Dealing with the Unknown: Pessimistic Offline Reinforcement Learning9 Nov 2021
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems4 May 2020
- 2020APPLD: Adaptive Planner Parameter Learning from Demonstration31 Mar 2020
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2023Large Language Models for Robotics: A Surveycited by 132
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2021Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformerscited by 71
- 2021Continual Learning for Real-World Autonomous Systems: Algorithms, Challenges and Frameworkscited by 56
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 55
- 2021GANav: Efficient Terrain Segmentation for Robot Navigation in Unstructured Outdoor Environmentscited by 51
- 2023Fast Traversability Estimation for Wild Visual Navigationcited by 41
- 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 40
- 2023Not Only Rewards But Also Constraints: Applications on Legged Robot Locomotioncited by 33
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robotscited by 32
- 2021Learning a State Representation and Navigation in Cluttered and Dynamic Environmentscited by 30
12 most cited of 79 All 79 (JSON)
- 2026FLINT: Fast Lightweight Inference for Traversability22 Sep 2026
- 2026GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failures31 Aug 2026
- 2026TravKAN: Fast and Interpretable Nonlinear Traversability Analysis with Kolmogorov-Arnold Networks3 Aug 2026
- 2026Self-Supervised Online Robot-Agnostic Traversability Estimation for Open-World Environments27 May 2026
- 2026Trinity: Unifying Class-Agnostic Terrain and Semantic Segmentation for Unstructured Outdoor Environments by Leveraging Synthetic Data26 May 2026
- 2026Geometry-Guided Self-Supervision for Ultra-Fine-Grained Recognition with Limited Data21 Apr 2026
- 2026Divide-and-Conquer Approach to Holistic Cognition in High-Similarity Contexts with Limited Data21 Apr 2026
- 2026VORL-EXPLORE: A Hybrid Learning Planning Approach to Multi-Robot Exploration in Dynamic Environments9 Mar 2026
- 2026SuReNav: Superpixel Graph-based Constraint Relaxation for Navigation in Over-constrained Environments6 Feb 2026
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges4 Dec 2025
- 2025Synthetic vs. Real Training Data for Visual Navigation15 Sep 2025
- 2025Mars Traversability Prediction: A Multi-modal Self-supervised Approach for Costmap Generation14 Sep 2025
12 newest of 79 All 79 (JSON)