WebAccessVL: Violation-Aware VLM for Web Accessibility
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
We present a vision-language model (VLM) that automatically edits website HTML to address violations of the Web Content Accessibility Guidelines 2 (WCAG2) while preserving the original design. We formulate this as a supervised image-conditioned program synthesis task, where the model learns to correct HTML given both the code and its visual rendering. We create WebAccessVL, a website dataset with manually corrected accessibility violations. We then propose a violation-conditioned VLM that further takes the detected violations' descriptions from a checker as input. This conditioning enables an iterative checker-in-the-loop refinement strategy at test time. We conduct extensive evaluation on both open API and open-weight models. Empirically, our method achieves 0.211 violations per website, a 96.0% reduction from the 5.34 violations in raw data and 87% better than GPT-5. A perceptual study also confirms that our edited websites better maintain the original visual appearance and content.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 51 references that are in the map. First posted on arXiv 19 Dec 2025.
Builds on
28 of 51 references.
Closest ancestors · 2
Same direction, newest first
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs28 Jun
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset14 Mar
Other references · 26
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Visual Instruction Tuningcited by 7,792
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024Qwen2 Technical Reportcited by 2,076
14 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 545
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
- 2015Neural Module Networkscited by 375
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 361
- 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 360
- 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 156
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 113
- 2023Stay on topic with Classifier-Free Guidancecited by 90
- 2023OtterHD: A High-Resolution Multi-modality Modelcited by 72
- 2024ACCESS: Prompt Engineering for Automated Web Accessibility Violation Correctionscited by 3
- 2024Automated Code Fix Suggestions for Accessibility Issues in Mobile Appscited by 2
- 2025From Code to Compliance: Assessing ChatGPT's Utility in Designing an Accessible Webpage -- A Case Studycited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LLM Based Web Accessibility Repair: An Empirical Study of Detection, Remediation, and Cost
- 2026Learning to Detect UI Principle Violations via Reinforcement Learning
- 2026Agentic Web Accessibility Auditing: A Criterion-Specific Framework for Translating WCAG Requirements into Assessments
- 2026From Blind Edits to Verified Repair: Building Trustworthy User-Side LLM Agents for Web Accessibility
- 2025Towards Scalable Web Accessibility Audit with MLLMs as Copilots
- 2025Benchmarking MLLM-based Web Understanding: Reasoning, Robustness and Safety
- 2026WebRISE: Requirement-Induced State Evaluation for MLLM-Generated Web Artifacts
- 2024IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web