mlsanityData to 14 Oct 2026

Finetuning LLMs for Automatic Form Interaction on Web-Browser in Selenium Testing Framework

arXiv 2511.15168 ↗First posted 19 Nov 2025cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Automated web application testing is a critical component of modern software development, with frameworks like Selenium widely adopted for validating functionality through browser automation. Among the essential aspects of such testing is the ability to interact with and validate web forms, a task that requires syntactically correct, executable scripts with high coverage of input fields. Despite its importance, this task remains underexplored in the context of large language models (LLMs), and no public benchmark or dataset exists to evaluate LLMs on form interaction generation systematically. This paper introduces a novel method for training LLMs to generate high-quality test cases in Selenium, specifically targeting form interaction testing. We curate both synthetic and human-annotated datasets for training and evaluation, covering diverse real-world forms and testing scenarios. We define clear metrics for syntax correctness, script executability, and input field coverage. Our empirical study demonstrates that our approach significantly outperforms strong baselines, including GPT-4o and other popular LLMs, across all evaluation metrics. Our work lays the groundwork for future research on LLM-based web testing and provides resources to support ongoing progress in this area.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 17 references that are in the map. First posted on arXiv 19 Nov 2025.

Builds on

12 of 17 references.

References · 12

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  5. 2023Qwen Technical Reportcited by 3,344
  6. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  7. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  8. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  9. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  10. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  11. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  12. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 353

Built on by

Not cited yet.