mlsanityData to 14 Oct 2026

ALAS: Autonomous Learning Agent for Self-Updating Language Models

arXiv 2508.15805 ↗First posted 14 Aug 2025cs.CL cs.AI cs.LGcited by 6

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Large language models (LLMs) often have a fixed knowledge cutoff, limiting their accuracy on emerging information. We present ALAS (Autonomous Learning Agent System), a modular pipeline that continuously updates an LLM's knowledge with minimal human intervention. ALAS autonomously generates a learning curriculum for a target domain, retrieves up-to-date information from the web (with citations), distills this into question-answer training data, and fine-tunes the model through supervised fine-tuning (SFT) and direct preference optimization (DPO). It iteratively evaluates performance and revises the curriculum, enabling long-term continual learning. We demonstrate ALAS's ability to self-improve a model on rapidly evolving domains (e.g., new Python releases, latest security CVEs, academic trends), significantly boosting post-cutoff question answering accuracy (from 15% to 90% on average) without manual dataset curation. The system emphasizes modularity and reproducibility: each component (planning, retrieval, distillation, memory, fine-tuning) is interchangeable and built on standard APIs. We discuss comparative baselines (e.g., retrieval-augmented generation vs. fine-tuning) and show that ALAS achieves 90% accuracy on knowledge-updated queries with minimal engineering overhead. Finally, we outline limitations (cost, dependency on source quality) and future directions for autonomous lifelong learning in LLMs.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 12 references that are in the map. First posted on arXiv 14 Aug 2025.

Builds on

9 of 12 references.

References · 9

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  5. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  6. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  7. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  8. 2022Mass-Editing Memory in a Transformercited by 1,001
  9. 2025Self-Adapting Language Modelscited by 84

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolution
  2. 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle
  3. 2025The Self-Improvement Paradox: Can Language Models Bootstrap Reasoning Capabilities without External Scaffolding?
  4. 2023ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent
  5. 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphs
  6. 2022Large Language Models Can Self-Improve
  7. 2024LLMs Could Autonomously Learn Without External Supervision
  8. 2025Can Language Models Critique Themselves? Investigating Self-Feedback for Retrieval Augmented Generation at BioASQ 2025