mlsanityData to 7 Oct 2026

MEMENTO: Leveraging Web as a Learning Signal for Low-Data Domains

arXiv 2605.29795 ↗First posted 28 May 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Real-world tasks often lack large labeled datasets, motivating extensive work on learning in low-data regimes. Existing approaches such as few-shot prompting, instruction tuning, and synthetic data generation, continue to treat labeled or pseudo-labeled data as the primary learning signal. In contrast, human practitioners acquire expertise through repeated, self-directed interaction with the open web, progressively refining both domain knowledge and search strategies. We propose MEMENTO, a framework that treats the web as a learning signal rather than a stateless retrieval interface. MEMENTO operates at two levels: within each session, it conducts iterative web exploration via an Adaptive Exploration Tree (AET) that decomposes tasks into evolving questions and reflects on intermediate findings; across sessions, it accumulates experience through dual-channel memory, separating declarative knowledge (facts) from procedural knowledge (search strategies). This design enables agents to learn reusable research strategies and domain expertise from trajectories of web interaction without additional model training. We evaluate MEMENTO on three structurally distinct low-data domains: Sales Automation, Legal Outcome Prediction, and Subpopulation Opinion Prediction. Our empirical results show consistent improvement in performance over ReAct baselines (+25.6% on sales, +36.5% on legal research, and 29.6% TVD reduction on opinion prediction), demonstrating that the web can serve as a scalable learning source for acquiring task-specific expertise in data-scarce settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 41 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

28 of 41 references.

References · 28

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  9. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  10. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  11. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  12. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
16 more
  1. 2023Textbooks Are All You Needcited by 561
  2. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
  3. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  4. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 322
  5. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  6. 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
  7. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 220
  8. 2020A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarioscited by 170
  9. 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
  10. 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 150
  11. 2025Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinionscited by 64
  12. 2018Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulationcited by 61
  13. 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
  14. 2025WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidancecited by 15
  15. 2021JUSTICE: A Benchmark Dataset for Supreme Court's Judgment Predictioncited by 9
  16. 2026SE-Search: Self-Evolving Search Agent via Memory and Dense Rewardcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DRIVE: Modeling Skills at the Reasoning and Interaction Levels for Web Agents under Continual Learning
  2. 2025R2D2: Remembering, Replaying and Dynamic Decision Making with a Reflective Agentic Memory
  3. 2026WebChallenger: A Reliable and Efficient Generalist Web Agent
  4. 2026Beyond Domains: Reusing Web Skills via Transferable Interaction Patterns
  5. 2026Online Skill Learning for Web Agents via State-Grounded Dynamic Retrieval
  6. 2026EconSkills: Studying Skill Transfer and Retrieval for Web Agents on Live Economic Data
  7. 2026SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction
  8. 2026Memento-Skills: Let Agents Design Agents