mlsanityData to 7 Oct 2026

Avenir-UX: Automated UX Evaluation via Simulated Human Web Interaction with GUI Grounding

arXiv 2604.09581 ↗First posted 25 Feb 2026cs.AI cs.CY cs.HCcited by 2

Not on the map. Why?

Abstract (arXiv)

Evaluating web usability typically requires time-consuming user studies and expert reviews, which often limits iteration speed during product development, especially for small teams and agile workflows. We present Avenir-UX, a user-experience evaluation agent that simulates user behavior on websites and produces standardized usability. Unlike traditional tools that rely on DOM parsing, Avenir-UX grounds actions and observations, enabling it to interact with real web pages end-to-end while maintaining a coherent trace of the user journey. Building on Avenir-Web, our system pairs this robust interaction with simulated user behavior profiles and a structured evaluation protocol that integrates the System Usability Scale (SUS), step-wise Single Ease Questions (SEQ), and concurrent Think Aloud. Subsequently, a comprehensive User Experience (UX) report will be generated. We discuss the architecture of Avenir-UX and illustrate how its multimodal grounding improves robustness for web-based interaction and UX evaluation scenarios, paving the way for a new era of continuous, scalable, and data-driven usability testing that empowers every developer to build web interfaces that are usable. Code is available at: https://github.com/Onflow-AI/Avenir-UX

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 7 of its 18 references that are in the map. First posted on arXiv 25 Feb 2026.

Builds on

7 of 18 references.

References · 7

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  3. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  4. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
  5. 2025AgentA/B: Automated and Scalable Web A/BTesting with Interactive LLM Agentscited by 19
  6. 2025MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfacescited by 11
  7. 2026Avenir-Web: Human-Experience-Imitating Multimodal Web Agents with Mixture of Grounding Expertscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.