mlsanityData to 7 Oct 2026

WebAccessVL: Violation-Aware VLM for Web Accessibility

arXiv 2602.03850 ↗First posted 19 Dec 2025cs.HC cs.AI cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

We present a vision-language model (VLM) that automatically edits website HTML to address violations of the Web Content Accessibility Guidelines 2 (WCAG2) while preserving the original design. We formulate this as a supervised image-conditioned program synthesis task, where the model learns to correct HTML given both the code and its visual rendering. We create WebAccessVL, a website dataset with manually corrected accessibility violations. We then propose a violation-conditioned VLM that further takes the detected violations' descriptions from a checker as input. This conditioning enables an iterative checker-in-the-loop refinement strategy at test time. We conduct extensive evaluation on both open API and open-weight models. Empirically, our method achieves 0.211 violations per website, a 96.0% reduction from the 5.34 violations in raw data and 87% better than GPT-5. A perceptual study also confirms that our edited websites better maintain the original visual appearance and content.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 51 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

28 of 51 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs28 Jun
  2. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset14 Mar

Other references · 26

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2023Visual Instruction Tuningcited by 7,792
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2024Qwen2.5 Technical Reportcited by 4,713
  8. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  11. 2025Qwen3-VL Technical Reportcited by 2,534
  12. 2024Qwen2 Technical Reportcited by 2,076
14 more
  1. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  2. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  3. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 545
  4. 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
  5. 2015Neural Module Networkscited by 375
  6. 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 361
  7. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 360
  8. 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 156
  9. 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 113
  10. 2023Stay on topic with Classifier-Free Guidancecited by 90
  11. 2023OtterHD: A High-Resolution Multi-modality Modelcited by 72
  12. 2024ACCESS: Prompt Engineering for Automated Web Accessibility Violation Correctionscited by 3
  13. 2024Automated Code Fix Suggestions for Accessibility Issues in Mobile Appscited by 2
  14. 2025From Code to Compliance: Assessing ChatGPT's Utility in Designing an Accessible Webpage -- A Case Studycited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LLM Based Web Accessibility Repair: An Empirical Study of Detection, Remediation, and Cost
  2. 2026Learning to Detect UI Principle Violations via Reinforcement Learning
  3. 2026Agentic Web Accessibility Auditing: A Criterion-Specific Framework for Translating WCAG Requirements into Assessments
  4. 2026From Blind Edits to Verified Repair: Building Trustworthy User-Side LLM Agents for Web Accessibility
  5. 2025Towards Scalable Web Accessibility Audit with MLLMs as Copilots
  6. 2025Benchmarking MLLM-based Web Understanding: Reasoning, Robustness and Safety
  7. 2026WebRISE: Requirement-Induced State Evaluation for MLLM-Generated Web Artifacts
  8. 2024IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web