mlsanityData to 7 Oct 2026

Safety-oriented sidewalk and road segmentation for smartphone-based assistive navigation

arXiv 2607.21137 ↗First posted 23 Jul 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Independent sidewalk mobility is essential for blind and visually impaired pedestrians (BVIPs), yet smartphone-based assistive navigation requires perception models that distinguish walkable sidewalks from adjacent unsafe regions. This study presents a safety-oriented semantic segmentation framework for future mobile guidance. We introduce SENSATION-DS, a chest-height pedestrian-view dataset with 2,752 image-mask pairs and nine-class navigation-relevant taxonomy. External urban and sidewalk datasets were harmonized to this label space, and five segmentation architectures were evaluated using staged target-domain adaptation with mask-conditioned synthetic images and Segment Anything Model 2 (SAM2) pseudo-labels. Models were assessed using mean Intersection over Union (mIoU), road- and sidewalk-specific metrics, Road-as-Sidewalk Error Rate as a proxy false-safe measure, and Android Open Neural Network Exchange benchmarking. Synthetic augmentation generally improved segmentation accuracy, whereas SAM2 pseudo-labels more consistently reduced Road-as-Sidewalk errors. UPerNet-MobileNetV3 achieved the highest offline mIoU (0.715 +/- 0.006), while DeepLabV3Plus-MobileNetV3 achieved the lowest Road-as-Sidewalk Error Rate (0.079) and highest Android runtime at 512x384 (7.383 FPS). These results show that assistive sidewalk perception should be evaluated jointly by segmentation accuracy, proxy false-safe behavior, and smartphone deployment feasibility, while real-world benefit requires validation with BVIP users. This evaluation supports selecting models that balance accurate perception, conservative error behavior, and practical runtime.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 39 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

17 of 39 references.

References · 17

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  2. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  3. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  4. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  5. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  7. 2019Searching for MobileNetV3cited by 1,984
  8. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  9. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
  10. 2018Albumentations: fast and flexible image augmentationscited by 558
  11. 2018Pyramid Attention Network for Semantic Segmentationcited by 148
  12. 2022Semantic Image Synthesis via Diffusion Modelscited by 131
5 more
  1. 2024ROADWork: A Dataset and Benchmark for Learning to Recognize, Observe, Analyze and Drive Through Work Zonescited by 20
  2. 2020EXACT: A collaboration toolset for algorithm-aided annotation of images with annotation version controlcited by 16
  3. 2023SANPO: A Scene Understanding, Accessibility and Human Navigation Datasetcited by 10
  4. 2025Road Obstacle Video Segmentationcited by 2
  5. 2024Large-scale, Longitudinal, Hybrid Participatory Design Program to Create Navigation Technology for the Blindcited by 1

Built on by

Not cited yet.