LLM Based Web Accessibility Repair: An Empirical Study of Detection, Remediation, and Cost
Not on the map. Why?
Abstract (arXiv)
Ensuring web accessibility at scale remains challenging because rule-based tools provide limited coverage while manual remediation is costly and error-prone. This paper evaluates large language model based agents, specifically Kimi K2.5, for automated accessibility detection and repair compared with rule-based approaches. For detection, the LLM achieves performance comparable to rule-based tools, with F1 around 0.65, strong semantic understanding with F1 of 0.83, but lower reliability for syntactic and layout-related violations. For remediation, LLM-generated fixes are syntactically valid in over 99.7 percent of cases and improve accessibility compliance in 80.2 percent of instances, reducing violations from 3.98 to 1.7 per file. However, fewer than 26 percent of cases are fully resolved, and about 30 percent of patches introduce structural changes. We also find that iterative agent-based refinement increases computational cost by 52 percent and API usage by 1.64 times without improving remediation outcomes. These findings indicate that while LLMs are effective for partial accessibility repair, they are insufficient for complete and reliable remediation. Scalable accessibility solutions require hybrid approaches that combine LLM capabilities with rule-based validation and constraint-aware correction mechanisms.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). First posted on arXiv 26 May 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026From Blind Edits to Verified Repair: Building Trustworthy User-Side LLM Agents for Web Accessibility
- 2025WebAccessVL: Violation-Aware VLM for Web Accessibility
- 2025From Code to Compliance: Assessing ChatGPT's Utility in Designing an Accessible Webpage -- A Case Study
- 2025Towards Scalable Web Accessibility Audit with MLLMs as Copilots
- 2025MATE: LLM-Powered Multi-Agent Translation Environment for Accessibility Applications
- 2024Automated Code Fix Suggestions for Accessibility Issues in Mobile Apps
- 2025LLM Agents for Automated Web Vulnerability Reproduction: Are We There Yet?
- 2025Beyond Pixels: Exploring DOM Downsampling for LLM-Based Web Agents