Avenir-Web: Human-Experience-Imitating Multimodal Web Agents with Mixture of Grounding Experts
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Despite advances in multimodal large language models, autonomous web agents still struggle to reliably execute long-horizon tasks on complex and dynamic web interfaces. Existing agents often suffer from inaccurate element grounding, the absence of site-specific procedural knowledge, and unstable long-term task tracking and memory, particularly when operating over complex Document Object Model structures. To address these limitations, we introduce Avenir-Web, a web agent that achieves a new open-source state of the art on the Online-Mind2Web benchmark in real-world deployment. Avenir-Web leverages a Mixture of Grounding Experts, Experience-Imitation Planning for incorporating procedural priors, and a task-tracking checklist combined with adaptive memory to enable robust and seamless interaction across diverse user interface paradigms. We evaluate Avenir-Web on Online-Mind2Web, a rigorous benchmark of live and user-centered web tasks. Our results demonstrate that Avenir-Web significantly surpasses prior open-source agents and attains performance parity with top-tier proprietary models, thereby establishing a new open-source state of the art for reliable web agents on live websites.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 42 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
25 of 42 references.
Closest ancestors · 8
Same direction, newest first
- 2025Chain-of-Ground: Improving GUI Grounding via Iterative Reasoning and Reference Feedback1 Dec
- 2025textscGUI-Spotlight: Adaptive Iterative Focus Refinement for Enhanced GUI Visual Grounding5 Oct
- 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
- 2025ZonUI-3B: A Lightweight Vision-Language Model for Cross-Resolution GUI Grounding30 Jun
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
- 2024OmniParser for Pure Vision Based GUI Agent1 Aug
- 2023CogAgent: A Visual Language Model for GUI Agents14 Dec
- 2023GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation13 Nov
Other references · 17
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
- 2025An Illusion of Progress? Assessing the Current State of Web Agentscited by 165
- 2023Multimodal Web Navigation with Instruction-Finetuned Foundation Modelscited by 159
- 2024WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Explorationcited by 100
- 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environmentscited by 93
- 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agentscited by 88
- 2024Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systemscited by 79
5 more
- 2023From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfacescited by 67
- 2025DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoningcited by 29
- 2025Symbiotic Cooperation for Web Agents: Harnessing Complementary Strengths of Large and Small LLMscited by 24
- 2025Evolving in Tasks: Empowering the Multi-modality Large Language Model as the Computer Use Agentcited by 10
- 2025WebOperator: Action-Aware Tree Search for Autonomous Agents in Web Environmentcited by 10
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memorycited by 10
- 2026Avenir-UX: Automated UX Evaluation via Simulated Human Web Interaction with GUI Groundingcited by 2
- 2026WebRider: Persona-Conditioned Intent Controllers for Live-Web Assistancecited by 0
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agentscited by 0
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agents26 Aug 2026
- 2026WebRider: Persona-Conditioned Intent Controllers for Live-Web Assistance7 Aug 2026
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory14 May 2026
- 2026Avenir-UX: Automated UX Evaluation via Simulated Human Web Interaction with GUI Grounding25 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2024OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization
- 2024MMInA: Benchmarking Multihop Multimodal Internet Agents
- 2024AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations
- 2026CAP: A Scalable Benchmark for Evaluating Cross-Site Browser Agents with Complex Actions and Perception
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models
- 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
- 2026MolmoWeb: Open Visual Web Agent and Open Data for the Open Web
- 2025WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidance