ALAS: Autonomous Learning Agent for Self-Updating Language Models
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Large language models (LLMs) often have a fixed knowledge cutoff, limiting their accuracy on emerging information. We present ALAS (Autonomous Learning Agent System), a modular pipeline that continuously updates an LLM's knowledge with minimal human intervention. ALAS autonomously generates a learning curriculum for a target domain, retrieves up-to-date information from the web (with citations), distills this into question-answer training data, and fine-tunes the model through supervised fine-tuning (SFT) and direct preference optimization (DPO). It iteratively evaluates performance and revises the curriculum, enabling long-term continual learning. We demonstrate ALAS's ability to self-improve a model on rapidly evolving domains (e.g., new Python releases, latest security CVEs, academic trends), significantly boosting post-cutoff question answering accuracy (from 15% to 90% on average) without manual dataset curation. The system emphasizes modularity and reproducibility: each component (planning, retrieval, distillation, memory, fine-tuning) is interchangeable and built on standard APIs. We discuss comparative baselines (e.g., retrieval-augmented generation vs. fine-tuning) and show that ALAS achieves 90% accuracy on knowledge-updated queries with minimal engineering overhead. Finally, we outline limitations (cost, dependency on source quality) and future directions for autonomous lifelong learning in LLMs.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 12 references that are in the map. First posted on arXiv 14 Aug 2025.
Builds on
9 of 12 references.
References · 9
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2025Self-Adapting Language Modelscited by 84
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
- 2025LLM/Agent-as-Data-Analyst: A Surveycited by 16
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlookcited by 5
- 2026Towards AGI A Pragmatic Approach Towards Self Evolving Agentcited by 2
- 2026Phantom Gains: Auditing Self-Improvement Against a Measured Nullcited by 2
- 2026Autolearn: Learn by Surprise, Commit by Proofcited by 0
- 2026Phantom Gains: Auditing Self-Improvement Against a Measured Null20 Aug 2026
- 2026Autolearn: Learn by Surprise, Commit by Proof2 Apr 2026
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlook26 Mar 2026
- 2026Towards AGI A Pragmatic Approach Towards Self Evolving Agent15 Jan 2026
- 2025LLM/Agent-as-Data-Analyst: A Survey28 Sep 2025
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Survey2 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolution
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle
- 2025The Self-Improvement Paradox: Can Language Models Bootstrap Reasoning Capabilities without External Scaffolding?
- 2023ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent
- 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphs
- 2022Large Language Models Can Self-Improve
- 2024LLMs Could Autonomously Learn Without External Supervision
- 2025Can Language Models Critique Themselves? Investigating Self-Feedback for Retrieval Augmented Generation at BioASQ 2025