mlsanityData to 7 Oct 2026

Avenir-Web: Human-Experience-Imitating Multimodal Web Agents with Mixture of Grounding Experts

arXiv 2602.02468 ↗First posted 2 Feb 2026cs.AI cs.CLcited by 4

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 1 more
Abstract (arXiv)

Despite advances in multimodal large language models, autonomous web agents still struggle to reliably execute long-horizon tasks on complex and dynamic web interfaces. Existing agents often suffer from inaccurate element grounding, the absence of site-specific procedural knowledge, and unstable long-term task tracking and memory, particularly when operating over complex Document Object Model structures. To address these limitations, we introduce Avenir-Web, a web agent that achieves a new open-source state of the art on the Online-Mind2Web benchmark in real-world deployment. Avenir-Web leverages a Mixture of Grounding Experts, Experience-Imitation Planning for incorporating procedural priors, and a task-tracking checklist combined with adaptive memory to enable robust and seamless interaction across diverse user interface paradigms. We evaluate Avenir-Web on Online-Mind2Web, a rigorous benchmark of live and user-centered web tasks. Our results demonstrate that Avenir-Web significantly surpasses prior open-source agents and attains performance parity with top-tier proprietary models, thereby establishing a new open-source state of the art for reliable web agents on live websites.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 42 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

25 of 42 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Chain-of-Ground: Improving GUI Grounding via Iterative Reasoning and Reference Feedback1 Dec
  2. 2025textscGUI-Spotlight: Adaptive Iterative Focus Refinement for Enhanced GUI Visual Grounding5 Oct
  3. 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
  4. 2025ZonUI-3B: A Lightweight Vision-Language Model for Cross-Resolution GUI Grounding30 Jun
  5. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
  6. 2024OmniParser for Pure Vision Based GUI Agent1 Aug
  7. 2023CogAgent: A Visual Language Model for GUI Agents14 Dec
  8. 2023GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation13 Nov

Other references · 17

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  4. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
  5. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
  6. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  7. 2025An Illusion of Progress? Assessing the Current State of Web Agentscited by 165
  8. 2023Multimodal Web Navigation with Instruction-Finetuned Foundation Modelscited by 159
  9. 2024WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Explorationcited by 100
  10. 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environmentscited by 93
  11. 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agentscited by 88
  12. 2024Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systemscited by 79
5 more
  1. 2023From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfacescited by 67
  2. 2025DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoningcited by 29
  3. 2025Symbiotic Cooperation for Web Agents: Harnessing Complementary Strengths of Large and Small LLMscited by 24
  4. 2025Evolving in Tasks: Empowering the Multi-modality Large Language Model as the Computer Use Agentcited by 10
  5. 2025WebOperator: Action-Aware Tree Search for Autonomous Agents in Web Environmentcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization
  2. 2024MMInA: Benchmarking Multihop Multimodal Internet Agents
  3. 2024AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations
  4. 2026CAP: A Scalable Benchmark for Evaluating Cross-Site Browser Agents with Complex Actions and Perception
  5. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models
  6. 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
  7. 2026MolmoWeb: Open Visual Web Agent and Open Data for the Open Web
  8. 2025WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidance