The GOOSE Dataset for Perception in Unstructured Environments
Not on the map. Why?
Abstract (arXiv)
The potential for deploying autonomous systems can be significantly increased by improving the perception and interpretation of the environment. However, the development of deep learning-based techniques for autonomous systems in unstructured outdoor environments poses challenges due to limited data availability for training and testing. To address this gap, we present the German Outdoor and Offroad Dataset (GOOSE), a comprehensive dataset specifically designed for unstructured outdoor environments. The GOOSE dataset incorporates 10 000 labeled pairs of images and point clouds, which are utilized to train a range of state-of-the-art segmentation models on both image and point cloud data. We open source the dataset, along with an ontology for unstructured terrain, as well as dataset standards and guidelines. This initiative aims to establish a common framework, enabling the seamless inclusion of existing datasets and a fast way to enhance the perception capabilities of various robots operating in unstructured environments. The dataset, pre-trained models for offroad perception, and additional documentation can be found at https://goose-dataset.de/.
Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 25 Oct 2023.
Builds on
17 of 35 references.
References · 17
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 423
- 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 389
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2020RELLIS-3D Dataset: Data, Benchmarks and Analysiscited by 119
- 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentationcited by 119
- 2022TartanDrive: A Large-Scale Dataset for Learning Off-Road Dynamics Modelscited by 49
- 2022PP-LiteSeg: A Superior Real-Time Semantic Segmentation Modelcited by 33
5 more
- 2022ORFD: A Dataset and Benchmark for Off-Road Freespace Detectioncited by 33
- 2021Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setupscited by 25
- 2021A Fine-Grained Dataset and its Efficient Semantic Segmentation for Unstructured Driving Scenarioscited by 18
- 2017Automatic Extrinsic Calibration for Lidar-Stereo Vehicle Sensor Setupscited by 17
- 2022LiDAR-as-Camera for End-to-End Drivingcited by 7
Built on by
Citing papers per year: 2024: 9; 2025: 12; 2026: 16.
37 papers.
Sort:
By area:
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigationcited by 36
- 2024Excavating in the Wild: The GOOSE-Ex Dataset for Semantic Segmentationcited by 13
- 2025Advancing Off-Road Autonomous Driving: The Large-Scale ORAD-3D Dataset and Comprehensive Benchmarkscited by 8
- 2024Autonomous Driving in Unstructured Environments: How Far Have We Come?cited by 7
- 2024Pixel-aligned RGB-NIR Stereo Imaging and Dataset for Robot Visioncited by 7
- 2024ROVER: A Multi-Season Dataset for Visual SLAMcited by 4
- 2024Survey on Datasets for Perception in Unstructured Outdoor Environmentscited by 3
- 2026From General Vision to Reliable Traversability Estimation: Adapting Vision Foundation Models for Unstructured Outdoor Environmentscited by 2
- 2024DIDLM: A SLAM Dataset for Difficult Scenarios Featuring Infrared, Depth Cameras, LIDAR, 4D Radar, and Others under Adverse Weather, Low Light Conditions, and Rough Roadscited by 1
- 2025Bench2FreeAD: A Benchmark for Vision-based End-to-end Navigation in Unstructured Robotic Environmentscited by 1
- 2025Technical Report for ICRA 2025 GOOSE 2D Semantic Segmentation Challenge: Leveraging Color Shift Correction, RoPE-Swin Backbone, and Quantile-based Label Denoising Strategy for Robust Outdoor Scene Understandingcited by 1
- 2025Technical Report for ICRA 2025 GOOSE 2D Semantic Segmentation Challenge: Boosting Off-Road Segmentation via Photometric Distortion and Exponential Moving Averagecited by 1
25 more
- 2025TOMD: A Trail-based Off-road Multimodal Dataset for Traversable Pathway Segmentation under Challenging Illumination Conditionscited by 1
- 2026How to Relieve Distribution Shifts in Semantic Segmentation for Off-Road Environmentscited by 1
- 2024Introducing a Class-Aware Metric for Monocular Depth Estimation: An Automotive Perspectivecited by 0
- 2024IRisPath: Enhancing Costmap for Off-Road Navigation with Robust IR-RGB Fusion for Improved Day and Night Traversabilitycited by 0
- 20243DTTNet: Multimodal Fusion-Based 3D Traversable Terrain Modeling for Off-Road Environmentscited by 0
- 2025Knowledge Distillation for Semantic Segmentation: A Label Space Unification Approachcited by 0
- 2025Technical Report for ICRA 2025 GOOSE 3D Semantic Segmentation Challenge: Adaptive Point Cloud Understanding for Heterogeneous Robotic Systemscited by 0
- 2025Robotics Under Construction: Challenges on Job Sitescited by 0
- 2025Diffusion-Based Image Augmentation for Semantic Segmentation in Outdoor Roboticscited by 0
- 2025SilvaScenes: Tree Detection and Species Classification from Under-Canopy Images in Natural Forestscited by 0
- 2025FORWARD: Dataset of a forwarder operating in rough terraincited by 0
- 2026A Cross-Scale Decoder with Token Refinement for Off-Road Semantic Segmentationcited by 0
- 2026Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmarkcited by 0
- 2026GOOSE-M2F: Adapting Mask2Former for High-Fidelity, Long-Tailed Fine-Grained Semantic Segmentation in Unstructured Outdoor Terraincited by 0
- 2026Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Leveraging DINOv3 for Robust Outdoor Scene Understanding in Field Roboticscited by 0
- 2026SAM3 Self-Distillation for Fine-Grained GOOSE 2D Semantic Segmentationcited by 0
- 2026Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Exploring Query-Based Segmentation and Increased Spatial Context for Outdoor Scene Understandingcited by 0
- 2026Technical Report for the ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Pretraining-Diverse Ensemble of Foundation Vision Encoders for Robust Outdoor Scene Understandingcited by 0
- 2026Evaluation of Vision-Language Models Across Diverse Coastal Environmentscited by 0
- 2026A Multi-Vehicle Dataset with Camera, LiDAR, and Radar Sensors and Scanned 3D Models for Custom Auto-Annotation using RTK-GNSScited by 0
- 2026Forward-Facing Near-Infrared Adds Little to Colour for Farm-Machinery Traversability: A Site-Disjoint Evaluation of Sensor-Dependent Spatial Leakagecited by 0
- 2026Which Terrain Is Better? Preference Learning with VLM Prototypes for Off-Road Traversability Rankingcited by 0
- 2026FounRef: Robust, Structure-Preserving, and Fast Metric Refinement of Frozen Monocular Foundation Priors with Sparse Anchorscited by 0
- 2026ProGuT: Label-Efficient Panoptic Segmentation for Forest Scenescited by 0
- 2026From Pixels to Executable Physics: Behavior-Grounded World Models for Embodied Action Consequence Predictioncited by 0
- 2026From Pixels to Executable Physics: Behavior-Grounded World Models for Embodied Action Consequence Prediction13 Oct 2026
- 2026ProGuT: Label-Efficient Panoptic Segmentation for Forest Scenes29 Sep 2026
- 2026FounRef: Robust, Structure-Preserving, and Fast Metric Refinement of Frozen Monocular Foundation Priors with Sparse Anchors24 Sep 2026
- 2026Which Terrain Is Better? Preference Learning with VLM Prototypes for Off-Road Traversability Ranking20 Sep 2026
- 2026A Multi-Vehicle Dataset with Camera, LiDAR, and Radar Sensors and Scanned 3D Models for Custom Auto-Annotation using RTK-GNSS11 Sep 2026
- 2026Evaluation of Vision-Language Models Across Diverse Coastal Environments9 Sep 2026
- 2026Forward-Facing Near-Infrared Adds Little to Colour for Farm-Machinery Traversability: A Site-Disjoint Evaluation of Sensor-Dependent Spatial Leakage7 Sep 2026
- 2026Technical Report for the ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Pretraining-Diverse Ensemble of Foundation Vision Encoders for Robust Outdoor Scene Understanding22 Jun 2026
- 2026Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Exploring Query-Based Segmentation and Increased Spatial Context for Outdoor Scene Understanding19 Jun 2026
- 2026SAM3 Self-Distillation for Fine-Grained GOOSE 2D Semantic Segmentation18 Jun 2026
- 2026Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Leveraging DINOv3 for Robust Outdoor Scene Understanding in Field Robotics17 Jun 2026
- 2026GOOSE-M2F: Adapting Mask2Former for High-Fidelity, Long-Tailed Fine-Grained Semantic Segmentation in Unstructured Outdoor Terrain14 Jun 2026
25 more
- 2026How to Relieve Distribution Shifts in Semantic Segmentation for Off-Road Environments28 May 2026
- 2026From General Vision to Reliable Traversability Estimation: Adapting Vision Foundation Models for Unstructured Outdoor Environments28 May 2026
- 2026Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmark30 Apr 2026
- 2026A Cross-Scale Decoder with Token Refinement for Off-Road Semantic Segmentation30 Mar 2026
- 2025FORWARD: Dataset of a forwarder operating in rough terrain21 Nov 2025
- 2025Advancing Off-Road Autonomous Driving: The Large-Scale ORAD-3D Dataset and Comprehensive Benchmarks18 Oct 2025
- 2025SilvaScenes: Tree Detection and Species Classification from Under-Canopy Images in Natural Forests10 Oct 2025
- 2025Diffusion-Based Image Augmentation for Semantic Segmentation in Outdoor Robotics30 Jun 2025
- 2025TOMD: A Trail-based Off-road Multimodal Dataset for Traversable Pathway Segmentation under Challenging Illumination Conditions24 Jun 2025
- 2025Robotics Under Construction: Challenges on Job Sites24 Jun 2025
- 2025Technical Report for ICRA 2025 GOOSE 3D Semantic Segmentation Challenge: Adaptive Point Cloud Understanding for Heterogeneous Robotic Systems8 Jun 2025
- 2025Technical Report for ICRA 2025 GOOSE 2D Semantic Segmentation Challenge: Boosting Off-Road Segmentation via Photometric Distortion and Exponential Moving Average17 May 2025
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigation15 May 2025
- 2025Technical Report for ICRA 2025 GOOSE 2D Semantic Segmentation Challenge: Leveraging Color Shift Correction, RoPE-Swin Backbone, and Quantile-based Label Denoising Strategy for Robust Outdoor Scene Understanding11 May 2025
- 2025Bench2FreeAD: A Benchmark for Vision-based End-to-end Navigation in Unstructured Robotic Environments15 Mar 2025
- 2025Knowledge Distillation for Semantic Segmentation: A Label Space Unification Approach26 Feb 2025
- 20243DTTNet: Multimodal Fusion-Based 3D Traversable Terrain Modeling for Off-Road Environments11 Dec 2024
- 2024IRisPath: Enhancing Costmap for Off-Road Navigation with Robust IR-RGB Fusion for Improved Day and Night Traversability4 Dec 2024
- 2024ROVER: A Multi-Season Dataset for Visual SLAM3 Dec 2024
- 2024Pixel-aligned RGB-NIR Stereo Imaging and Dataset for Robot Vision27 Nov 2024
- 2024Autonomous Driving in Unstructured Environments: How Far Have We Come?10 Oct 2024
- 2024Excavating in the Wild: The GOOSE-Ex Dataset for Semantic Segmentation27 Sep 2024
- 2024Introducing a Class-Aware Metric for Monocular Depth Estimation: An Automotive Perspective6 Sep 2024
- 2024Survey on Datasets for Perception in Unstructured Outdoor Environments29 Apr 2024
- 2024DIDLM: A SLAM Dataset for Difficult Scenarios Featuring Infrared, Depth Cameras, LIDAR, 4D Radar, and Others under Adverse Weather, Low Light Conditions, and Rough Roads15 Apr 2024
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigationcited by 36
- 2024Excavating in the Wild: The GOOSE-Ex Dataset for Semantic Segmentationcited by 13
- 2024Pixel-aligned RGB-NIR Stereo Imaging and Dataset for Robot Visioncited by 7
- 2024ROVER: A Multi-Season Dataset for Visual SLAMcited by 4
- 2024Survey on Datasets for Perception in Unstructured Outdoor Environmentscited by 3
- 2026From General Vision to Reliable Traversability Estimation: Adapting Vision Foundation Models for Unstructured Outdoor Environmentscited by 2
- 2024DIDLM: A SLAM Dataset for Difficult Scenarios Featuring Infrared, Depth Cameras, LIDAR, 4D Radar, and Others under Adverse Weather, Low Light Conditions, and Rough Roadscited by 1
- 2025Bench2FreeAD: A Benchmark for Vision-based End-to-end Navigation in Unstructured Robotic Environmentscited by 1
- 2025Technical Report for ICRA 2025 GOOSE 2D Semantic Segmentation Challenge: Leveraging Color Shift Correction, RoPE-Swin Backbone, and Quantile-based Label Denoising Strategy for Robust Outdoor Scene Understandingcited by 1
- 2025Technical Report for ICRA 2025 GOOSE 2D Semantic Segmentation Challenge: Boosting Off-Road Segmentation via Photometric Distortion and Exponential Moving Averagecited by 1
- 2025TOMD: A Trail-based Off-road Multimodal Dataset for Traversable Pathway Segmentation under Challenging Illumination Conditionscited by 1
- 2026How to Relieve Distribution Shifts in Semantic Segmentation for Off-Road Environmentscited by 1
12 most cited of 30 All 30 (JSON)
- 2026ProGuT: Label-Efficient Panoptic Segmentation for Forest Scenes29 Sep 2026
- 2026FounRef: Robust, Structure-Preserving, and Fast Metric Refinement of Frozen Monocular Foundation Priors with Sparse Anchors24 Sep 2026
- 2026Which Terrain Is Better? Preference Learning with VLM Prototypes for Off-Road Traversability Ranking20 Sep 2026
- 2026A Multi-Vehicle Dataset with Camera, LiDAR, and Radar Sensors and Scanned 3D Models for Custom Auto-Annotation using RTK-GNSS11 Sep 2026
- 2026Forward-Facing Near-Infrared Adds Little to Colour for Farm-Machinery Traversability: A Site-Disjoint Evaluation of Sensor-Dependent Spatial Leakage7 Sep 2026
- 2026Technical Report for the ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Pretraining-Diverse Ensemble of Foundation Vision Encoders for Robust Outdoor Scene Understanding22 Jun 2026
- 2026Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Exploring Query-Based Segmentation and Increased Spatial Context for Outdoor Scene Understanding19 Jun 2026
- 2026Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Leveraging DINOv3 for Robust Outdoor Scene Understanding in Field Robotics17 Jun 2026
- 2026GOOSE-M2F: Adapting Mask2Former for High-Fidelity, Long-Tailed Fine-Grained Semantic Segmentation in Unstructured Outdoor Terrain14 Jun 2026
- 2026How to Relieve Distribution Shifts in Semantic Segmentation for Off-Road Environments28 May 2026
- 2026From General Vision to Reliable Traversability Estimation: Adapting Vision Foundation Models for Unstructured Outdoor Environments28 May 2026
- 2026Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmark30 Apr 2026
12 newest of 30 All 30 (JSON)