"We are at the mercy of others' opinion": Supporting Blind People in Recreational Window Shopping with AI-infused Technology
Not on the map. Why?
Abstract (arXiv)
Engaging in recreational activities in public spaces poses challenges for blind people, often involving dependency on sighted help. Window shopping is a key recreational activity that remains inaccessible. In this paper, we investigate the information needs, challenges, and current approaches blind people have to recreational window shopping to inform the design of existing wayfinding and navigation technology for supporting blind shoppers in exploration and serendipitous discovery. We conduct a formative study with a total of 18 blind participants that include both focus groups (N=8) and interviews for requirements analysis (N=10). We find that there is a desire for push notifications of promotional information and pull notifications about shops of interest such as the targeted audience of a brand. Information about obstacles and points-of-interest required customization depending on one's mobility aid as well as presence of a crowd, children, and wheelchair users. We translate these findings into specific information modalities and rendering in the context of two existing AI-infused assistive applications: NavCog (a turn-by-turn navigation app) and Cabot (a navigation robot).
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 9 of its 134 references that are in the map. First posted on arXiv 10 May 2024.
Builds on
9 of 134 references.
References · 9
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2020Captioning Images Taken by People Who Are Blindcited by 110
- 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 56
- 2021Computer Vision and Conflicting Values: Describing People with Automated Alt Textcited by 14
- 2023Understanding Visual Arts Experiences of Blind Peoplecited by 9
- 2024Towards Robotic Companions: Understanding Handler-Guide Dog Interactions for Informed Guide Dog Robot Designcited by 9
- 2022Data Representativeness in Accessibility Datasets: A Meta-Analysiscited by 6
- 2022ViNTER: Image Narrative Generation with Emotion-Arc-Aware Transformercited by 4
- 2021Accessing Passersby Proxemic Signals through a Head-Worn Camera: Opportunities and Limitations for the Blindcited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Towards Understanding the Use of MLLM-Enabled Applications for Visual Interpretation by Blind and Low Vision Peoplecited by 11
- 2026How Multimodal Large Language Models Support Access to Visual Information: A Diary Study With Blind and Low Vision Peoplecited by 3
- 2025More than One Step at a Time: Designing Procedural Feedback for Non-visual Makeup Routinescited by 2
- 2025ShelfAware: Real-Time Semantic Localization in Quasi-Static Environments with Low-Cost Sensorscited by 1
- 2026GIST: Multimodal Knowledge Extraction and Spatial Grounding via Intelligent Semantic Topologycited by 0
- 2026GIST: Multimodal Knowledge Extraction and Spatial Grounding via Intelligent Semantic Topology16 Apr 2026
- 2026How Multimodal Large Language Models Support Access to Visual Information: A Diary Study With Blind and Low Vision People13 Feb 2026
- 2025ShelfAware: Real-Time Semantic Localization in Quasi-Static Environments with Low-Cost Sensors9 Dec 2025
- 2025More than One Step at a Time: Designing Procedural Feedback for Non-visual Makeup Routines5 Jul 2025
- 2025Towards Understanding the Use of MLLM-Enabled Applications for Visual Interpretation by Blind and Low Vision People7 Mar 2025