VIABench: A Comprehensive Video Benchmark Collected from Blind Individuals for Visual Impairment Assistance
Not on the map. Why?
Abstract (arXiv)
Visually impaired individuals (VIIs) encounter significant daily challenges due to limited access to visual information. Although Multimodal Large Language Models (MLLMs) have achieved impressive results on general vision and language tasks, their practical utility in real-world blind assistance still remains largely underexplored. To fill this gap, we introduce VIABench, a comprehensive video benchmark specifically designed to evaluate MLLMs in Visually Impaired Assistance scenarios using first-person videos recorded or shared by VIIs themselves. VIABench defines three core tasks, each targeting a distinct requirement in visual assistance. Proactive Reminder: Assesses the model's ability to interpret ongoing video content while proactively anticipating and verbally describing upcoming navigation-critical events; Visual Question Answering (VQA): Evaluates the model's capacity to answer user-posed questions about the environment or objects within the video; Vision-Guided Interaction: Tests context-aware reasoning to accomplish intentional interactions between user and environment. To ensure a robust and fair evaluation, we propose a rigorous benchmarking pipeline that supports both online (real-time) and offline settings. Our experiments demonstrate that current MLLMs still struggle to deliver comprehensive support for VIIs, especially in the Proactive Reminder task, which demands accurate anticipation and real-time responsiveness. We hope VIABench will drive future research toward developing customized MLLMs for real-world assistance, ultimately improving navigation and interaction experiences for visually impaired individuals. Code and data will be released at https://github.com/MCG-NJU/VIABench.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
31 of 38 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 858
19 more
- 2023VideoChat: Chat-Centric Video Understandingcited by 857
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
- 2025Kimi-VL Technical Reportcited by 388
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 225
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 186
- 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understandingcited by 182
- 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 144
- 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 142
- 2025StreamingVLM: Real-Time Understanding for Infinite Video Streamscited by 95
- 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understandingcited by 85
- 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
- 2024VIAssist: Adapting Multi-modal Large Language Models for Users with Visual Impairmentscited by 25
- 2025EgoBlind: Towards Egocentric Visual Assistance for the Blindcited by 21
- 2024WalkVLM:Aid Visually Impaired People Walking by Vision Language Modelcited by 13
- 2025GuideDog: A Real-World Egocentric Multimodal Dataset for Blind and Low-Vision Accessibility-Aware Guidancecited by 10
- 2024Video Question Answering for People with Visual Impairments Using an Egocentric 360-Degree Cameracited by 9
- 2019Street Crossing Aid Using Light-weight CNNs for the Visually Impairedcited by 2
- 2019LYTNet: A Convolutional Neural Network for Real-Time Pedestrian Traffic Lights and Zebra Crossing Recognition for the Visually Impairedcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology
- 2025"I Can See Forever!": Evaluating Real-time VideoLLMs for Assisting Individuals with Visual Impairments
- 2026How Multimodal Large Language Models Support Access to Visual Information: A Diary Study With Blind and Low Vision People
- 2025Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Users
- 2025VideoA11y: Method and Dataset for Accessible Video Description
- 2025Probing the Gaps in ChatGPT Live Video Chat for Real-World Assistance for People who are Blind or Visually Impaired
- 2026Exploring the Use of VLMs for Navigation Assistance for People with Blindness and Low Vision
- 2026FineBench: Benchmarking and Enhancing Vision-Language Models for Fine-grained Human Activity Understanding