From Blind Edits to Verified Repair: Building Trustworthy User-Side LLM Agents for Web Accessibility
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Assistive agents that adapt web pages on the user's side, at the moment of browsing, could reach the accessibility failures that site authors leave unfixed, and large language models make such agents newly plausible. We contribute three building blocks toward that goal. The first is a complete, privacy-preserving browser agent: a Chrome extension that extracts a page's style sheets, condenses them to fit a local model's context window, asks the model for additive CSS addressing 18 metrics from WCAG and the W3C cognitive accessibility guidance, and injects the result reversibly into the live page. The second is a dual-condition protocol that measures harm as carefully as benefit, applied to six small open-weight models (7B to 14B) on ten violation-rich and ten highly accessible live sites. The diagnosis is sobering but precise: unverified generation improved and regressed pages at similar rates (24 improvements against 20 regressions across the 100 trials of the five models that produced injectable CSS), fixing typography while breaking perception-dependent properties. The third answers the diagnosis: a verified repair instrument pairing a trilingual seeded-violation benchmark with an audit-inject-verify loop that accepts a change only if violations strictly decrease, so regression on the automated checks is impossible by construction. In a real browser the instrument detects 57 of 57 seeded violations with no false positives and rejects 126 of 126 adversarially harmful candidates. All code, prompts, benchmark materials, aggregate data, and validation logs are released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 8 of its 31 references that are in the map. First posted on arXiv 26 Jul 2026.
Builds on
8 of 31 references.
References · 8
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2024Phi-4 Technical Reportcited by 675
- 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
- 2025CodeA11y: Making AI Coding Assistants Useful for Accessible Web Developmentcited by 8
- 2025AccessGuru: Leveraging LLMs to Detect and Correct Web Accessibility Violations in HTML Codecited by 4
- 2026Large Language Models for Web Accessibility: A Systematic Literature Reviewcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Agentic Web Accessibility Auditing: A Criterion-Specific Framework for Translating WCAG Requirements into Assessments
- 2026LLM Based Web Accessibility Repair: An Empirical Study of Detection, Remediation, and Cost
- 2026"Zooming In" on Agentic Web Browsers as Assistive Technologies: A Case Study with a Low-Vision Technology Expert
- 2025From Code to Compliance: Assessing ChatGPT's Utility in Designing an Accessible Webpage -- A Case Study
- 2025Towards Scalable Web Accessibility Audit with MLLMs as Copilots
- 2026Navigation Alone Is Not Enough: Evaluating Explanatory Assistive UI Agents
- 2025WebAccessVL: Violation-Aware VLM for Web Accessibility
- 2026Position: Assistive Agents Need Accessibility Alignment