Locomotion Policy Guided Traversability Learning using Volumetric Representations of Complex Environments
Not on the map. Why?
Abstract (arXiv)
Despite the progress in legged robotic locomotion, autonomous navigation in unknown environments remains an open problem. Ideally, the navigation system utilizes the full potential of the robots' locomotion capabilities while operating within safety limits under uncertainty. The robot must sense and analyze the traversability of the surrounding terrain, which depends on the hardware, locomotion control, and terrain properties. It may contain information about the risk, energy, or time consumption needed to traverse the terrain. To avoid hand-crafted traversability cost functions we propose to collect traversability information about the robot and locomotion policy by simulating the traversal over randomly generated terrains using a physics simulator. Thousand of robots are simulated in parallel controlled by the same locomotion policy used in reality to acquire 57 years of real-world locomotion experience equivalent. For deployment on the real robot, a sparse convolutional network is trained to predict the simulated traversability cost, which is tailored to the deployed locomotion policy, from an entirely geometric representation of the environment in the form of a 3D voxel-occupancy map. This representation avoids the need for commonly used elevation maps, which are error-prone in the presence of overhanging obstacles and multi-floor or low-ceiling scenarios. The effectiveness of the proposed traversability prediction network is demonstrated for path planning for the legged robot ANYmal in various indoor and natural environments.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Mar 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 11; 2024: 9; 2025: 5; 2026: 1.
28 papers.
Sort:
By area:
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robotscited by 48
- 2023Fast Traversability Estimation for Wild Visual Navigationcited by 44
- 2024RoadRunner -- Learning Traversability Estimation for Autonomous Off-road Drivingcited by 26
- 2023Resilient Legged Local Navigation: Learning to Traverse with Compromised Perception End-to-Endcited by 23
- 2022ScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environmentscited by 21
- 2023EVORA: Deep Evidential Traversability Learning for Risk-Aware Off-Road Autonomycited by 21
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervisioncited by 17
- 2023LiDAR-UDA: Self-ensembling Through Time for Unsupervised LiDAR Domain Adaptationcited by 14
- 2023Learning Risk-Aware Quadrupedal Locomotion using Distributional Reinforcement Learningcited by 14
- 2024Reinforcement Learning for Collision-free Flight Exploiting Deep Collision Encodingcited by 13
- 2023MEM: Multi-Modal Elevation Mapping for Robotics and Learningcited by 11
- 2023Contrastive Initial State Buffer for Reinforcement Learningcited by 8
16 more
- 2025VAMOS: A Hierarchical Vision-Language-Action Model for Capability-Modulated and Steerable Navigationcited by 7
- 2022Learning Semantics-Aware Locomotion Skills from Human Demonstrationcited by 5
- 2023Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perceptioncited by 5
- 2023Robust Visual Sim-to-Real Transfer for Robotic Manipulationcited by 5
- 2024Learning Semantic Traversability with Egocentric Video and Automated Annotation Strategycited by 5
- 2024RoadRunner M&M -- Learning Multi-range Multi-resolution Traversability Maps for Autonomous Off-road Navigationcited by 5
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worldscited by 4
- 2023Seeing-Eye Quadruped Navigation with Force Responsive Locomotion Controlcited by 3
- 2025ZeST: A VLM-based Zero-Shot Traversability Navigation for Unknown Environmentscited by 3
- 2025Anomalies by Synthesis: Anomaly Detection using Generative Diffusion Models for Off-Road Navigationcited by 2
- 2024TE-NeXt: A LiDAR-Based 3D Sparse Convolutional Network for Traversability Estimationcited by 1
- 2023METAVerse: Meta-Learning Traversability Cost Map for Off-Road Navigationcited by 0
- 2024ODTFormer: Efficient Obstacle Detection and Tracking with Stereo Cameras Based on Transformercited by 0
- 2025Learning Smooth State-Dependent Traversability from Dense Point Cloudscited by 0
- 2025ProTerrain: Probabilistic Physics-Informed Rough Terrain World Modelingcited by 0
- 2026GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failurescited by 0
- 2026GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failures31 Aug 2026
- 2025VAMOS: A Hierarchical Vision-Language-Action Model for Capability-Modulated and Steerable Navigation23 Oct 2025
- 2025ProTerrain: Probabilistic Physics-Informed Rough Terrain World Modeling22 Oct 2025
- 2025ZeST: A VLM-based Zero-Shot Traversability Navigation for Unknown Environments26 Aug 2025
- 2025Learning Smooth State-Dependent Traversability from Dense Point Clouds4 Jun 2025
- 2025Anomalies by Synthesis: Anomaly Detection using Generative Diffusion Models for Off-Road Navigation28 May 2025
- 2024RoadRunner M&M -- Learning Multi-range Multi-resolution Traversability Maps for Autonomous Off-road Navigation17 Sep 2024
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worlds24 Jun 2024
- 2024Learning Semantic Traversability with Egocentric Video and Automated Annotation Strategy5 Jun 2024
- 2024TE-NeXt: A LiDAR-Based 3D Sparse Convolutional Network for Traversability Estimation3 Jun 2024
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robots3 May 2024
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervision10 Apr 2024
16 more
- 2024ODTFormer: Efficient Obstacle Detection and Tracking with Stereo Cameras Based on Transformer21 Mar 2024
- 2024RoadRunner -- Learning Traversability Estimation for Autonomous Off-road Driving29 Feb 2024
- 2024Reinforcement Learning for Collision-free Flight Exploiting Deep Collision Encoding6 Feb 2024
- 2023EVORA: Deep Evidential Traversability Learning for Risk-Aware Off-Road Autonomy10 Nov 2023
- 2023Resilient Legged Local Navigation: Learning to Traverse with Compromised Perception End-to-End5 Oct 2023
- 2023MEM: Multi-Modal Elevation Mapping for Robotics and Learning28 Sep 2023
- 2023Learning Risk-Aware Quadrupedal Locomotion using Distributional Reinforcement Learning25 Sep 2023
- 2023LiDAR-UDA: Self-ensembling Through Time for Unsupervised LiDAR Domain Adaptation24 Sep 2023
- 2023Contrastive Initial State Buffer for Reinforcement Learning18 Sep 2023
- 2023Seeing-Eye Quadruped Navigation with Force Responsive Locomotion Control8 Sep 2023
- 2023Robust Visual Sim-to-Real Transfer for Robotic Manipulation28 Jul 2023
- 2023METAVerse: Meta-Learning Traversability Cost Map for Off-Road Navigation26 Jul 2023
- 2023Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perception26 Jun 2023
- 2023Fast Traversability Estimation for Wild Visual Navigation15 May 2023
- 2022ScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environments14 Sep 2022
- 2022Learning Semantics-Aware Locomotion Skills from Human Demonstration27 Jun 2022
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robotscited by 48
- 2023Fast Traversability Estimation for Wild Visual Navigationcited by 44
- 2023Resilient Legged Local Navigation: Learning to Traverse with Compromised Perception End-to-Endcited by 23
- 2022ScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environmentscited by 21
- 2023EVORA: Deep Evidential Traversability Learning for Risk-Aware Off-Road Autonomycited by 21
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervisioncited by 17
- 2023LiDAR-UDA: Self-ensembling Through Time for Unsupervised LiDAR Domain Adaptationcited by 14
- 2023Learning Risk-Aware Quadrupedal Locomotion using Distributional Reinforcement Learningcited by 14
- 2023MEM: Multi-Modal Elevation Mapping for Robotics and Learningcited by 11
- 2023Contrastive Initial State Buffer for Reinforcement Learningcited by 8
- 2022Learning Semantics-Aware Locomotion Skills from Human Demonstrationcited by 5
- 2023Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perceptioncited by 5
12 most cited of 23 All 23 (JSON)
- 2026GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failures31 Aug 2026
- 2025ZeST: A VLM-based Zero-Shot Traversability Navigation for Unknown Environments26 Aug 2025
- 2025Learning Smooth State-Dependent Traversability from Dense Point Clouds4 Jun 2025
- 2024RoadRunner M&M -- Learning Multi-range Multi-resolution Traversability Maps for Autonomous Off-road Navigation17 Sep 2024
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worlds24 Jun 2024
- 2024Learning Semantic Traversability with Egocentric Video and Automated Annotation Strategy5 Jun 2024
- 2024TE-NeXt: A LiDAR-Based 3D Sparse Convolutional Network for Traversability Estimation3 Jun 2024
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robots3 May 2024
- 2024Wild Visual Navigation: Fast Traversability Learning via Pre-Trained Models and Online Self-Supervision10 Apr 2024
- 2024ODTFormer: Efficient Obstacle Detection and Tracking with Stereo Cameras Based on Transformer21 Mar 2024
- 2023EVORA: Deep Evidential Traversability Learning for Risk-Aware Off-Road Autonomy10 Nov 2023
- 2023Resilient Legged Local Navigation: Learning to Traverse with Compromised Perception End-to-End5 Oct 2023
12 newest of 23 All 23 (JSON)