CANVAS: Captioning Art with Narrative Visual-Audio AI Systems
Not on the map. Why?
Abstract (arXiv)
Visual art remains largely inaccessible to blind and low-vision (BLV) audiences due to brief or absent alt-text, which rarely conveys the sensory, spatial, or emotional qualities of an artwork. This study presents an automated workflow that generates multi-sensory art descriptions and synchronized audio narration using large language models and text-to-speech services. The system, orchestrated through Zapier, converts uploaded images into rich narrative captions without human intervention, enabling rapid, scalable production of accessible media. Quantitative evaluation across 50 artworks shows that AI-generated descriptions contain significantly higher lexical diversity, adjective density, and narrative detail than baseline captions, while maintaining comparable readability levels. Statistical tests (t-tests, ANOVA) confirm meaningful differences in richness and length, and the full pipeline produces text-plus-audio outputs in under 20 seconds per image at a cost below 0.05. Findings demonstrate that automated captioning can bridge gaps in museum and digital-collection accessibility, with implications for broader public engagement. Future work can incorporate user studies with BLV participants to assess comprehension, preference, and optimal levels of interpretive language.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 16 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
5 of 16 references.
References · 5
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
- 2016A Hierarchical Approach for Generating Descriptive Image Paragraphscited by 104
- 2016Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measurescited by 36
- 2023Improving Image Captioning Descriptiveness by Ranking and LLM-based Fusioncited by 21
- 2022Context Matters for Image Descriptions for Accessibility: Challenges for Referenceless Evaluation Metricscited by 18
Built on by
Not cited yet.