# Understanding the Use of a Large Language Model-Powered Guide to Make Virtual Reality Accessible for Blind and Low Vision People

arXiv: https://arxiv.org/abs/2603.09964 · HTML: https://mlsanity.com/paper/2603.09964/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 13 of its 71 references that are in the map.
- First posted on arXiv 10 Mar 2026.

## Builds on (most cited first, 13 of 13)

- [Investigating Use Cases of AI-Powered Scene Description Applications for Blind and Low Vision People](https://mlsanity.com/paper/2403.15604/) (2024)
- [CloChat: Understanding How People Customize, Interact, and Experience Personas in Large Language Models](https://mlsanity.com/paper/2402.15265/) (2024)
- [Towards Understanding the Use of MLLM-Enabled Applications for Visual Interpretation by Blind and Low Vision People](https://mlsanity.com/paper/2503.05899/) (2025)
- [Towards Robotic Companions: Understanding Handler-Guide Dog Interactions for Informed Guide Dog Robot Design](https://mlsanity.com/paper/2402.06790/) (2024)
- [Different Types of Voice User Interface Failures May Cause Different Degrees of Frustration](https://mlsanity.com/paper/2002.03582/) (2020)
- ["It's Just Part of Me:" Understanding Avatar Diversity and Self-presentation of People with Disabilities in Social Virtual Reality](https://mlsanity.com/paper/2208.11170/) (2022)
- ["The Guide Has Your Back": Exploring How Sighted Guides Can Enhance Accessibility in Social Virtual Reality for Blind and Low Vision People](https://mlsanity.com/paper/2410.21659/) (2024)
- [Towards Inclusive Avatars: Disability Representation in Avatar Platforms](https://mlsanity.com/paper/2302.01880/) (2023)
- [Lessons Learned from Developing a Human-Centered Guide Dog Robot for Mobility Assistance](https://mlsanity.com/paper/2409.19778/) (2024)
- [An AI Guide to Enhance Accessibility of Social Virtual Reality for Blind People](https://mlsanity.com/paper/2410.14058/) (2024)
- [VRSight: An AI-Driven Scene Description System to Improve Virtual Reality Accessibility for Blind People](https://mlsanity.com/paper/2508.02958/) (2025)
- [VRBubble: Enhancing Peripheral Awareness of Avatars for People with Visual Impairments in Social Virtual Reality](https://mlsanity.com/paper/2208.11071/) (2022)
- [Accessible Nonverbal Cues to Support Conversations in VR for Blind and Low Vision People](https://mlsanity.com/paper/2410.21652/) (2024)

## Abstract (arXiv)

As social virtual reality (VR) grows more popular, addressing accessibility for blind and low vision (BLV) users is increasingly critical. Researchers have proposed an AI "sighted guide" to help users navigate VR and answer their questions, but it has not been studied with users. To address this gap, we developed a large language model (LLM)-powered guide and studied its use with 16 BLV participants in virtual environments with confederates posing as other users. We found that when alone, participants treated the guide as a tool, but treated it companionably around others, giving it nicknames, rationalizing its mistakes with its appearance, and encouraging confederate-guide interaction. Our work furthers understanding of guides as a versatile method for VR accessibility and presents design recommendations for future guides.