An Affordable AI-Integrated Smart Cane for Multimodal Mobility Assistance of Visually Impaired Users
Not on the map. Why?
Abstract (arXiv)
Visual impairment affects over 2.2 billion people worldwide, yet conventional white canes cannot detect elevated hazards or provide semantic environmental context. Existing AI-assisted navigation systems typically rely on expensive hardware or cloud connectivity, limiting accessibility in resource-constrained settings. This paper presents an affordable (88 USD), fully offline AI-integrated smart cane designed for multimodal mobility assistance on an ultra-low-power Raspberry Pi Zero 2W. The system fuses RGB vision sensing with Time-of-Flight (ToF) distance estimation, pairing an INT8-quantized SSD MobileNet V1 model with distance-aware vibrotactile feedback and real-time audio alerts. To ensure operational robustness on constrained hardware, a multiprocessing architecture isolates sensor acquisition, neural inference, and haptic feedback into independent processes with fail-safe sensing support. Experimental evaluation across indoor mobility scenarios demonstrates a macro-averaged F1-score of 0.82 (precision: 0.85, recall: 0.81), a mean end-to-end latency of 330,ms, and a peak power draw of 2.8,W. A preliminary usability study with 12 participants (SUS: 78.5, NASA-TLX) demonstrated positive user perception and enhanced obstacle awareness. The proposed prototype validates the feasibility of deploying privacy-preserving, edge-native assistive intelligence for cost-sensitive mobility assistance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 31 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
8 of 31 references.
References · 8
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
- 2019Event-based Vision: A Surveycited by 1,016
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PISHYAR: A Socially Intelligent Smart Cane for Indoor Social Navigation and Multimodal Human-Robot Interaction for Visually Impaired People ↗
- 2025NaviSense: A Multimodal Assistive Mobile application for Object Retrieval by Persons with Visual Impairment
- 2025A Light and Smart Wearable Platform with Multimodal Foundation Model for Enhanced Spatial Reasoning in People with Blindness and Low Vision
- 2025OpenGuide: Assistive Object Retrieval in Indoor Spaces for Individuals with Visual Impairments ↗
- 2026OpenGlass: A Sensing-Computing Split Architecture for Local MLLM-Driven Real-Time Visual Assistance
- 2025Space-Aware Instruction Tuning: Dataset and Benchmark for Guide Dog Robots Assisting the Visually Impaired
- 2026Assisted Spatial Cognition Through Vision-Language Models
- 2024Guide-LLM: An Embodied LLM Agent and Text-Based Topological Map for Robotic Guidance of People with Visual Impairments