mlsanityData to 7 Oct 2026

AltGen: AI-Driven Alt Text Generation for Enhancing EPUB Accessibility

arXiv 2501.00113 ↗First posted 30 Dec 2024cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Digital accessibility is a cornerstone of inclusive content delivery, yet many EPUB files fail to meet fundamental accessibility standards, particularly in providing descriptive alt text for images. Alt text plays a critical role in enabling visually impaired users to understand visual content through assistive technologies. However, generating high-quality alt text at scale is a resource-intensive process, creating significant challenges for organizations aiming to ensure accessibility compliance. This paper introduces AltGen, a novel AI-driven pipeline designed to automate the generation of alt text for images in EPUB files. By integrating state-of-the-art generative models, including advanced transformer-based architectures, AltGen achieves contextually relevant and linguistically coherent alt text descriptions. The pipeline encompasses multiple stages, starting with data preprocessing to extract and prepare relevant content, followed by visual analysis using computer vision models such as CLIP and ViT. The extracted visual features are enriched with contextual information from surrounding text, enabling the fine-tuned language models to generate descriptive and accurate alt text. Validation of the generated output employs both quantitative metrics, such as cosine similarity and BLEU scores, and qualitative feedback from visually impaired users. Experimental results demonstrate the efficacy of AltGen across diverse datasets, achieving a 97.5% reduction in accessibility errors and high scores in similarity and linguistic fidelity metrics. User studies highlight the practical impact of AltGen, with participants reporting significant improvements in document usability and comprehension. Furthermore, comparative analyses reveal that AltGen outperforms existing approaches in terms of accuracy, relevance, and scalability.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 7 of its 25 references that are in the map. First posted on arXiv 30 Dec 2024.

Builds on

7 of 25 references.

References · 7

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Evaluation of Text Generation: A Surveycited by 275
  4. 2018A Comprehensive Survey of Deep Learning for Image Captioningcited by 213
  5. 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
  6. 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challengecited by 20
  7. 2021Computer Vision and Conflicting Values: Describing People with Automated Alt Textcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 9; 2026: 2.

11 papers.