AltGen: AI-Driven Alt Text Generation for Enhancing EPUB Accessibility
Not on the map. Why?
Abstract (arXiv)
Digital accessibility is a cornerstone of inclusive content delivery, yet many EPUB files fail to meet fundamental accessibility standards, particularly in providing descriptive alt text for images. Alt text plays a critical role in enabling visually impaired users to understand visual content through assistive technologies. However, generating high-quality alt text at scale is a resource-intensive process, creating significant challenges for organizations aiming to ensure accessibility compliance. This paper introduces AltGen, a novel AI-driven pipeline designed to automate the generation of alt text for images in EPUB files. By integrating state-of-the-art generative models, including advanced transformer-based architectures, AltGen achieves contextually relevant and linguistically coherent alt text descriptions. The pipeline encompasses multiple stages, starting with data preprocessing to extract and prepare relevant content, followed by visual analysis using computer vision models such as CLIP and ViT. The extracted visual features are enriched with contextual information from surrounding text, enabling the fine-tuned language models to generate descriptive and accurate alt text. Validation of the generated output employs both quantitative metrics, such as cosine similarity and BLEU scores, and qualitative feedback from visually impaired users. Experimental results demonstrate the efficacy of AltGen across diverse datasets, achieving a 97.5% reduction in accessibility errors and high scores in similarity and linguistic fidelity metrics. User studies highlight the practical impact of AltGen, with participants reporting significant improvements in document usability and comprehension. Furthermore, comparative analyses reveal that AltGen outperforms existing approaches in terms of accuracy, relevance, and scalability.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 7 of its 25 references that are in the map. First posted on arXiv 30 Dec 2024.
Builds on
7 of 25 references.
References · 7
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Evaluation of Text Generation: A Surveycited by 275
- 2018A Comprehensive Survey of Deep Learning for Image Captioningcited by 213
- 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
- 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challengecited by 20
- 2021Computer Vision and Conflicting Values: Describing People with Automated Alt Textcited by 14
Built on by
Citing papers per year: 2025: 9; 2026: 2.
11 papers.
- 2025Enhancing Intent Understanding for Ambiguous prompt: A Human-Machine Co-Adaption Strategycited by 16
- 2025SSH: Sparse Spectrum Adaptation via Discrete Hartley Transformationcited by 7
- 2025Research and Design on Intelligent Recognition of Unordered Targets for Robots Based on Reinforcement Learningcited by 6
- 2025Industrial Internet Robot Collaboration System and Edge Computing Optimizationcited by 2
- 2025Efficient Temporal Consistency in Diffusion-Based Video Editing with Adaptor Modules: A Theoretical Frameworkcited by 2
- 2025TDRI: Two-Phase Dialogue Refinement and Co-Adaptation for Interactive Image Generationcited by 1
- 2025Not All Visitors are Bilingual: A Measurement Study of the Multilingual Web from an Accessibility Perspectivecited by 1
- 2025Hierarchical Indexing with Knowledge Enrichment for Multilingual Video Corpus Retrievalcited by 1
- 2025MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projectioncited by 0
- 2026Active Imitation Learning for Thermal- and Kernel-Aware LFM Inference on 3D S-NUCA Many-Corescited by 0
- 2026TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learningcited by 0
- 2026TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learning14 Apr 2026
- 2026Active Imitation Learning for Thermal- and Kernel-Aware LFM Inference on 3D S-NUCA Many-Cores13 Apr 2026
- 2025Hierarchical Indexing with Knowledge Enrichment for Multilingual Video Corpus Retrieval10 Oct 2025
- 2025Not All Visitors are Bilingual: A Measurement Study of the Multilingual Web from an Accessibility Perspective25 Aug 2025
- 2025MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection29 May 2025
- 2025Efficient Temporal Consistency in Diffusion-Based Video Editing with Adaptor Modules: A Theoretical Framework22 Apr 2025
- 2025Industrial Internet Robot Collaboration System and Edge Computing Optimization3 Apr 2025
- 2025TDRI: Two-Phase Dialogue Refinement and Co-Adaptation for Interactive Image Generation22 Mar 2025
- 2025Research and Design on Intelligent Recognition of Unordered Targets for Robots Based on Reinforcement Learning10 Mar 2025
- 2025SSH: Sparse Spectrum Adaptation via Discrete Hartley Transformation8 Feb 2025
- 2025Enhancing Intent Understanding for Ambiguous prompt: A Human-Machine Co-Adaption Strategy25 Jan 2025