An LLM-Driven Closed-Loop Autonomous Learning Framework for Robots Facing Uncovered Tasks in Open Environments
Not on the map. Why?
Abstract (arXiv)
Autonomous robots operating in open environments need the ability to continuously handle tasks that are not covered by predefined local methods. However, existing approaches often rely on repeated large-language-model (LLM) interaction for uncovered tasks, and even successful executions or observed successful external behaviors are not always autonomously transformed into reusable local knowledge. In this paper, we propose an LLM-driven closed-loop autonomous learning framework for robots facing uncovered tasks in open environments. The proposed framework first retrieves the local method library to determine whether a reusable solution already exists for the current task or observed event. If no suitable method is found, it triggers an autonomous learning process in which the LLM serves as a high-level reasoning component for task analysis, candidate model selection, data collection planning, and execution or observation strategy organization. The robot then learns from both self-execution and active observation, performs quasi-real-time training and adjustment, and consolidates the validated result into the local method library for future reuse. Through this recurring closed-loop process, the robot gradually converts both execution-derived and observation-derived experience into reusable local capability while reducing future dependence on repeated external LLM interaction. Results show that the proposed framework reduces execution time and LLM dependence in both repeated-task self-execution and observation-driven settings, for example reducing the average total execution time from 7.7772s to 6.7779s and the average number of LLM calls per task from 1.0 to 0.2 in the repeated-task self-execution experiments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 12 references that are in the map. First posted on arXiv 24 Apr 2026.
Builds on
8 of 12 references.
References · 8
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 216
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 89
- 2024Learning from Massive Human Videos for Universal Humanoid Pose Controlcited by 29
- 2025A Survey of Continual Reinforcement Learningcited by 18
- 2024Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulationcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024InCoRo: In-Context Learning for Robotics Control with Feedback Loops
- 2023Interactive Planning Using Large Language Models for Partially Observable Robotics Tasks
- 2025Leveraging Pre-trained Large Language Models with Refined Prompting for Online Task and Motion Planning
- 2025AuDeRe: Automated Strategy Decision and Realization in Robot Planning and Control via LLMs
- 2026IndustrialVLA-Bench: A Traceable Multi-Axis Evaluation of Open Robot Policy Models
- 2026GAVEL: Graph World Models for Verified and Efficient Long-Horizon LLM Task Planning
- 2026Large-Language-Model-Guided State Estimation for Partially Observable Task and Motion Planning
- 2026Ro-SLM: Onboard Small Language Models for Robot Task Planning and Operation Code Generation