OT-Drive: Out-of-Distribution Off-Road Traversable Area Segmentation via Optimal Transport
Not on the map. Why?
Abstract (arXiv)
Reliable traversable area segmentation in unstructured environments is critical for planning and decision-making in autonomous driving. However, existing data-driven approaches often suffer from degraded segmentation performance in out-of-distribution (OOD) scenarios, consequently impairing downstream driving tasks. To address this issue, we propose OT-Drive, an Optimal Transport--driven multi-modal fusion framework. The proposed method formulates RGB and surface normal fusion as a distribution transport problem. Specifically, we design a novel Scene Anchor Generator (SAG) to decompose scene information into the joint distribution of weather, time-of-day, and road type, thereby constructing semantic anchors that can generalize to unseen scenarios. Subsequently, we design an innovative Optimal Transport-based multi-modal fusion module (OT Fusion) to transport RGB and surface normal features onto the manifold defined by the semantic anchors, enabling robust traversable area segmentation under OOD scenarios. Experimental results demonstrate that our method achieves 95.16% mIoU on ORFD OOD scenarios, outperforming prior methods by 6.35%, and 89.79% mIoU on cross-dataset transfer tasks, surpassing baselines by 13.99%.These results indicate that the proposed model can attain strong OOD generalization with only limited training data, substantially enhancing its practicality and efficiency for real-world deployment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
28 of 45 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 381
- 2020SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detectioncited by 66
- 2021GANav: Efficient Terrain Segmentation for Robot Navigation in Unstructured Outdoor Environmentscited by 51
- 2022Patchwork++: Fast and Robust Ground Segmentation Solving Partial Under-Segmentation Using 3D Point Cloudcited by 47
- 2022ORFD: A Dataset and Benchmark for Off-Road Freespace Detectioncited by 33
- 2023TerrainNet: Visual Modeling of Complex Terrain for High-speed, Off-road Navigationcited by 30
- 2021Patchwork: Concentric Zone-based Region-wise Ground Segmentation with Ground Likelihood Estimation Using a 3D LiDAR Sensorcited by 29
- 2023A Simple Recipe for Language-guided Domain Generalized Segmentationcited by 28
- 2023Generalization by Adaptation: Diffusion-Based Domain Extension for Domain-Generalized Semantic Segmentationcited by 28
16 more
- 2023RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsingcited by 27
- 2023Texture Learning Domain Randomization for Domain Generalized Segmentationcited by 24
- 2025Mamba as a Bridge: Where Vision Foundation Models Meet Vision Language Models for Domain-Generalized Semantic Segmentationcited by 24
- 2021SNE-RoadSeg+: Rethinking Depth-Normal Translation and Deep Supervision for Freespace Detectioncited by 23
- 2022ScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environmentscited by 21
- 2024Textual Query-Driven Mask Transformer for Domain Generalized Segmentationcited by 21
- 2023D2NT: A High-Performing Depth-to-Normal Translatorcited by 10
- 2024Pixel to Elevation: Learning to Predict Elevation Maps at Long Range using Images for Autonomous Offroad Navigationcited by 10
- 2025Advancing Off-Road Autonomous Driving: The Large-Scale ORAD-3D Dataset and Comprehensive Benchmarkscited by 8
- 2023Contrastive Label Disambiguation for Self-Supervised Terrain Traversability Learning in Off-Road Environmentscited by 5
- 2024UFO: Uncertainty-aware LiDAR-image Fusion for Off-road Semantic Terrain Map Estimationcited by 5
- 2025ROD: RGB-Only Fast and Efficient Off-road Freespace Detectioncited by 5
- 2025Exploiting Domain Properties in Language-Driven Domain Generalization for Semantic Segmentationcited by 5
- 2023Adaptive-Mask Fusion Network for Segmentation of Drivable Road and Negative Obstacle With Untrustworthy Featurescited by 3
- 2024Collision-Aware Traversability Analysis for Autonomous Vehicles in the Context of Agricultural Roboticscited by 1
- 2025Leveraging Text-Driven Semantic Variation for Robust OOD Segmentationcited by 1
Built on by
Not cited yet.