Lightweight Machine Learning-Driven Monocular Sidewalk Path Extraction for Embedded Micromobility Navigation
Not on the map. Why?
Abstract (arXiv)
Sidewalk-scale path extraction demands perception and planning that run reliably on compact, low-power hardware in cluttered, map-sparse environments. We present a monocular vision pipeline for sidewalk path extraction in micromobility systems that progresses through three design iterations, from a skeleton-graph baseline through distance-transform corridor planning to a lightweight image-space architecture, and provides a systematic comparison of five path-planning methods across both bird's-eye-view (BEV) and image-space domains. A compact SegFormer-B0 student model, trained with a semi-supervised teacher-student framework using OneFormer Swin-L pseudo-labels, achieves a hand-annotated IoU of 0.946 at 11.7 ms per frame, improving over the baseline checkpoint (IoU 0.758, 18.9 ms). In a controlled planner comparison on 32 hand-labeled frames, image-space midpoint planning achieves the lowest lateral center error (14.3 px) at 2.2 ms, a 421x speedup over BEV distance-transform planning (926.8 ms, 65.0 px center error), while maintaining comparable mask-path alignment (98.5% versus 98.6%). A full-video replay across six campus sequences (22,679 frames) confirms that the improved segmentation reduces temporal instability from 1.46% to 0.33% and increases template-path availability from 73.7% to 79.3%. We further show that BEV-only path extraction is fragile in monocular settings: in one profiled run, 99.3% of frames produced no valid BEV path. The final recommended architecture, image-space midpoint primary, image-space distance-transform fallback, and BEV reserved for visualization, runs the full perception-to-path stack in under 50 ms per frame on CPU, making it suitable for embedded pedestrian-speed micromobility systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 16 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
11 of 16 references.
References · 11
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2019Searching for MobileNetV3cited by 1,984
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
- 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 327
- 2023TwinLiteNet: An Efficient and Lightweight Model for Driveable Area and Lane Segmentation in Self-Driving Carscited by 13
- 2024Precise and Robust Sidewalk Detection: Leveraging Ensemble Learning to Surpass LLM Limitations in Urban Environmentscited by 3
- 2024Focus on BEV: Self-calibrated Cycle View Transformation for Monocular Birds-Eye-View Segmentationcited by 2
- 2025Diffusion-FS: Multimodal Free-Space Prediction via Diffusion for Autonomous Drivingcited by 2
- 2023Autonomous Navigation in Rows of Trees and High Crops with Deep Semantic Segmentationcited by 1
- 2025Path Planning using a One-shot-sampling Skeleton Mapcited by 1
Built on by
Not cited yet.