Learning Ground Traversability from Simulations
Not on the map. Why?
Abstract (arXiv)
Mobile ground robots operating on unstructured terrain must predict which areas of the environment they are able to pass in order to plan feasible paths. We address traversability estimation as a heightmap classification problem: we build a convolutional neural network that, given an image representing the heightmap of a terrain patch, predicts whether the robot will be able to traverse such patch from left to right. The classifier is trained for a specific robot model (wheeled, tracked, legged, snake-like) using simulation data on procedurally generated training terrains; the trained classifier can be applied to unseen large heightmaps to yield oriented traversability maps, and then plan traversable paths. We extensively evaluate the approach in simulation on six real-world elevation datasets, and run a real-robot validation in one indoor and one outdoor environment.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 5; 2024: 5; 2025: 0; 2026: 3.
20 papers.
Sort:
By area:
- 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 131
- 2023Robot Parkour Learningcited by 115
- 2021Coupling Vision and Proprioception for Navigation of Legged Robotscited by 46
- 2023Fast Traversability Estimation for Wild Visual Navigationcited by 41
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robotscited by 32
- 2022Learning Visual Locomotion with Cross-Modal Supervisioncited by 23
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervisioncited by 15
- 2022RCA: Ride Comfort-Aware Visual Navigation via Self-Supervised Learningcited by 10
- 2024SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experiencecited by 10
- 2022Neural Scene Representation for Locomotion on Structured Terraincited by 8
- 2023Learning Terrain-Aware Kinodynamic Model for Autonomous Off-Road Rally Driving With Model Predictive Path Integral Controlcited by 7
- 2024Autonomous Driving in Unstructured Environments: How Far Have We Come?cited by 7
8 more
- 2021Deep Learning Traversability Estimator for Mobile Robots in Unstructured Environmentscited by 2
- 2023URA*: Uncertainty-aware Path Planning using Image-based Aerial-to-Ground Traversability Estimation for Off-road Environmentscited by 2
- 2022Learning multiobjective rough terrain traversabilitycited by 0
- 2023Walking = Traversable? : Traversability Prediction via Multiple Human Object Tracking under Occlusioncited by 0
- 2024FASTC: A Fast Attentional Framework for Semantic Traversability Classification Using Point Cloudcited by 0
- 2026Wild-Drive: Off-Road Scene Captioning and Path Planning via Robust Multi-modal Routing and Efficient Large Language Modelcited by 0
- 2026Trinity: Unifying Class-Agnostic Terrain and Semantic Segmentation for Unstructured Outdoor Environments by Leveraging Synthetic Datacited by 0
- 2026GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failurescited by 0
- 2026GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failures31 Aug 2026
- 2026Trinity: Unifying Class-Agnostic Terrain and Semantic Segmentation for Unstructured Outdoor Environments by Leveraging Synthetic Data26 May 2026
- 2026Wild-Drive: Off-Road Scene Captioning and Path Planning via Robust Multi-modal Routing and Efficient Large Language Model28 Feb 2026
- 2024Autonomous Driving in Unstructured Environments: How Far Have We Come?10 Oct 2024
- 2024SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experience20 Sep 2024
- 2024FASTC: A Fast Attentional Framework for Semantic Traversability Classification Using Point Cloud24 Jun 2024
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robots3 May 2024
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervision10 Apr 2024
- 2023Walking = Traversable? : Traversability Prediction via Multiple Human Object Tracking under Occlusion30 Sep 2023
- 2023URA*: Uncertainty-aware Path Planning using Image-based Aerial-to-Ground Traversability Estimation for Off-road Environments15 Sep 2023
- 2023Robot Parkour Learning11 Sep 2023
- 2023Fast Traversability Estimation for Wild Visual Navigation15 May 2023
8 more
- 2023Learning Terrain-Aware Kinodynamic Model for Autonomous Off-Road Rally Driving With Model Predictive Path Integral Control1 May 2023
- 2022Legged Locomotion in Challenging Terrains using Egocentric Vision14 Nov 2022
- 2022Learning Visual Locomotion with Cross-Modal Supervision7 Nov 2022
- 2022RCA: Ride Comfort-Aware Visual Navigation via Self-Supervised Learning29 Jul 2022
- 2022Neural Scene Representation for Locomotion on Structured Terrain16 Jun 2022
- 2022Learning multiobjective rough terrain traversability30 Mar 2022
- 2021Coupling Vision and Proprioception for Navigation of Legged Robots3 Dec 2021
- 2021Deep Learning Traversability Estimator for Mobile Robots in Unstructured Environments23 May 2021
- 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 131
- 2023Robot Parkour Learningcited by 115
- 2021Coupling Vision and Proprioception for Navigation of Legged Robotscited by 46
- 2023Fast Traversability Estimation for Wild Visual Navigationcited by 41
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robotscited by 32
- 2022Learning Visual Locomotion with Cross-Modal Supervisioncited by 23
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervisioncited by 15
- 2022RCA: Ride Comfort-Aware Visual Navigation via Self-Supervised Learningcited by 10
- 2024SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experiencecited by 10
- 2022Neural Scene Representation for Locomotion on Structured Terraincited by 8
- 2023Learning Terrain-Aware Kinodynamic Model for Autonomous Off-Road Rally Driving With Model Predictive Path Integral Controlcited by 7
- 2021Deep Learning Traversability Estimator for Mobile Robots in Unstructured Environmentscited by 2
12 most cited of 19 All 19 (JSON)
- 2026GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failures31 Aug 2026
- 2026Trinity: Unifying Class-Agnostic Terrain and Semantic Segmentation for Unstructured Outdoor Environments by Leveraging Synthetic Data26 May 2026
- 2026Wild-Drive: Off-Road Scene Captioning and Path Planning via Robust Multi-modal Routing and Efficient Large Language Model28 Feb 2026
- 2024SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experience20 Sep 2024
- 2024FASTC: A Fast Attentional Framework for Semantic Traversability Classification Using Point Cloud24 Jun 2024
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robots3 May 2024
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervision10 Apr 2024
- 2023Walking = Traversable? : Traversability Prediction via Multiple Human Object Tracking under Occlusion30 Sep 2023
- 2023URA*: Uncertainty-aware Path Planning using Image-based Aerial-to-Ground Traversability Estimation for Off-road Environments15 Sep 2023
- 2023Robot Parkour Learning11 Sep 2023
- 2023Fast Traversability Estimation for Wild Visual Navigation15 May 2023
- 2023Learning Terrain-Aware Kinodynamic Model for Autonomous Off-Road Rally Driving With Model Predictive Path Integral Control1 May 2023
12 newest of 19 All 19 (JSON)