mlsanityData to 14 Oct 2026

ViDscribe: Multimodal AI for Customizing Audio Description and Question Answering in Online Videos

arXiv 2603.14662 ↗First posted 15 Mar 2026cs.HCcited by 2

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

Advances in multimodal large language models enable automatic video narration and question answering (VQA), offering scalable alternatives to labor-intensive, human-authored audio descriptions (ADs) for blind and low vision (BLV) viewers. However, prior AI-driven AD systems rarely adapt to the diverse needs and preferences of BLV individuals across videos and are typically evaluated in controlled, single-session settings. We present ViDscribe, a web-based platform that integrates AI-generated ADs with six types of user customizations and a conversational VQA interface for YouTube videos. Through a longitudinal, in-the-wild study with eight BLV participants, we examine how users engage with customization and VQA features over time. Our results show sustained engagement with both features and that customized ADs improve effectiveness, enjoyment, and immersion compared to default ADs, highlighting the value of personalized, interactive video access for BLV users.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 15 Mar 2026.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ADCanvas: Accessible and Conversational Audio Description Authoring for Blind and Low Vision Creators
  2. 2025DescribePro: Collaborative Audio Description with Human-AI Interaction ↗
  3. 2024Audio Description Generation in the Era of LLMs and VLMs: A Review of Transferable Generative AI Technologies
  4. 2026Making Videos Accessible for Blind and Low Vision Users Using a Multimodal Agent Video Player
  5. 2026ADx3: A Collaborative Workflow for High-Quality Accessible Audio Description ↗
  6. 2025VideoA11y: Method and Dataset for Accessible Video Description
  7. 2026Toward Scalable Audio Description Quality Control: A Workflow for Evaluating Human and VLM Raters
  8. 2025Guiding Multimodal Large Language Models with Blind and Low Vision People Visual Questions for Proactive Visual Interpretations