M2: Dual-Memory Augmentation for Long-Horizon Web Agents via Trajectory Summarization and Insight Retrieval
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) based agents have demonstrated remarkable potential in autonomous web navigation. However, handling long-horizon tasks remains a critical bottleneck. Prevailing strategies often rely heavily on extensive data collection and model training, yet still struggle with high computational costs and insufficient reasoning capabilities when facing complex, long-horizon scenarios. To address this, we propose M2, a training-free, memory-augmented framework designed to optimize context efficiency and decision-making robustness. Our approach incorporates a dual-tier memory mechanism that synergizes Dynamic Trajectory Summarization (Internal Memory) to compress verbose interaction history into concise state updates, and Insight Retrieval Augmentation (External Memory) to guide the agent with actionable guidelines retrieved from an offline insight bank. Extensive evaluations across WebVoyager and OnlineMind2Web demonstrate that M2 consistently surpasses baselines, yielding up to a 19.6% success rate increase and 58.7% token reduction for Qwen3-VL-32B, while proprietary models like Claude achieve accuracy gains up to 12.5% alongside significantly lower computational overhead.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 35 of its 44 references that are in the map. First posted on arXiv 28 Feb 2026.
Builds on
35 of 44 references.
Closest ancestors · 5
Same direction, newest first
- 2025History-Aware Reasoning for GUI Agents12 Nov
- 2025MGA: Memory-Driven GUI Agent for Observation-Centric Interaction28 Oct
- 2025PAL-UI: Planning with Active Look-back for Vision-Based GUI Agents1 Oct
- 2024VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought20 Jun
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models25 Jan
Other references · 30
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2024GPT-4o System Cardcited by 4,588
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 400
- 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 256
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 238
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 229
- 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 229
18 more
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
- 2025An Illusion of Progress? Assessing the Current State of Web Agentscited by 174
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 173
- 2025Memory OS of AI Agentcited by 150
- 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 130
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agentscited by 106
- 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 97
- 2025MemInsight: Autonomous Memory Augmentation for LLM Agentscited by 85
- 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
- 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agentscited by 84
- 2025Position: Episodic Memory is the Missing Piece for Long-Term LLM Agentscited by 36
- 2023WebVLN: Vision-and-Language Navigation on Websitescited by 19
- 2025MemEngine: A Unified and Modular Library for Developing Advanced Memory of LLM-based Agentscited by 17
- 2025ScaleTrack: Scaling and back-tracking Automated GUI Agentscited by 16
- 2025WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidancecited by 16
- 2025LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applicationscited by 14
- 2025Procedural Memory Is Not All You Need: Bridging Cognitive Gaps in LLM-Based Agentscited by 9
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2026Learning to Learn from Multimodal Experiencecited by 1
- 2026Signal-Driven Observation for Long-Horizon Web Agentscited by 0
- 2026RMSWeb: Reflection, Failure-Mode Mining, and Salvage-DS for Web Agent Reinforcement Learningcited by 0
- 2026RMSWeb: Reflection, Failure-Mode Mining, and Salvage-DS for Web Agent Reinforcement Learning31 Jul 2026
- 2026Signal-Driven Observation for Long-Horizon Web Agents4 Jun 2026
- 2026Learning to Learn from Multimodal Experience16 May 2026
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applications
- 2026Mem-π: Adaptive Memory through Learning When and What to Generate
- 2026MemGym: a Long-Horizon Memory Environment for LLM Agents
- 2026AMBER: Training Long-Horizon Web Agents through Append-Only Memory
- 2024On the Multi-turn Instruction Following for Conversational Web Agents
- 2025WebATLAS: An LLM Agent with Experience-Driven Memory and Action Simulation
- 2026MemWeaver: Weaving Hybrid Memories for Traceable Long-Horizon Agentic Reasoning
- 2026Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agents