LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation
Not on the map. Why?
Abstract (arXiv)
Road segmentation is a fundamental perception task for autonomous driving and mobile robotics, where both appearance and geometric cues must be processed under edge-computing constraints. Existing multi-modal approaches often improve accuracy with large encoders or expensive global interaction, which limits their use on embedded platforms. We present LiteViLNet, a lightweight RGB-geometry fusion network that combines a MobileNetV3 RGB encoder with a 0.12M-parameter depth-wise-separable geometry encoder. A multi-scale feature fusion module performs modality-specific enhancement, global-query cross-modal interaction, and adaptive gating, while a depth-wise large-kernel bridge enlarges the contextual support of the deepest representation with low overhead. The resulting U-Net-style decoder uses deep supervision only during training. On the KITTI Road benchmark, the 14.04M-parameter full model obtains 97.23±0.15% MaxF. On the held-out ORFD test set under the released OFF-Net evaluation protocol, the full model achieves 96.74±0.09% F-score and 93.68±0.18% IoU. On a Jetson Orin NX, model-only PyTorch FP16 inference reaches 22.18±0.21 FPS; a separate TensorRT FP16 measurement reaches 68.73±0.06 FPS on the Jetson. Camera-depth adaptations and perception-and-control demonstrations on three heterogeneous robot platforms further illustrate the portability of the dual-stream design.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
26 of 37 references.
References · 26
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2019Searching for MobileNetV3cited by 1,994
- 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2021Coordinate Attention for Efficient Mobile Network Designcited by 241
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 231
14 more
- 2018ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentationcited by 133
- 2022PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllerscited by 84
- 2020SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detectioncited by 66
- 2019Progressive LiDAR Adaptation for Road Detectioncited by 37
- 2022ORFD: A Dataset and Benchmark for Off-Road Freespace Detectioncited by 33
- 2023RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsingcited by 27
- 2022Fast Road Segmentation via Uncertainty-aware Symmetric Networkcited by 17
- 2025LOVON: Legged Open-Vocabulary Object Navigatorcited by 11
- 2024SNE-RoadSegV2: Advancing Heterogeneous Feature Fusion and Fallibility Awareness for Freespace Detectioncited by 8
- 2024CurbNet: Curb Detection Framework Based on LiDAR Point Cloud Segmentationcited by 5
- 2024TwinLiteNet+: An Enhanced Multi-Task Segmentation Model for Autonomous Drivingcited by 5
- 2025ROD: RGB-Only Fast and Efficient Off-road Freespace Detectioncited by 5
- 2026Annotation-Free Detection of Drivable Areas and Curbs Leveraging LiDAR Point Cloud Mapscited by 2
- 2024Annotation-Free Curb Detection Leveraging Altitude Difference Imagecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.