Kolb-Based Experiential Learning for Generalist Agents with Human-Level Kaggle Data Science Performance
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Human expertise emerges through iterative cycles of interaction, reflection, and internal model updating, which are central to cognitive theories such as Kolb's experiential learning and Vygotsky's zone of proximal development. In contrast, current AI systems, particularly LLM agents, rely on static pre-training or rigid workflows, lacking mechanisms for continual adaptation. Recent studies identified early cognitive traits in LLM agents (reflection, revision, and self-correction) suggesting foundational elements of human-like experiential learning. Thus the key question: Can we design LLM agents capable of structured, cognitively grounded learning similar to human processes? In response, we propose a computational framework of Kolb's learning cycle with Vygotsky's ZPD for autonomous agents. Our architecture separates extrinsic (environment interaction) and intrinsic (internal reflection/abstraction) functions, enabling cognitively grounded scaffolded learning, where the agent initially learns within structured environments, followed by open-ended generalisation. This approach empowers agents to master complex tasks ; domains that traditional fine-tuning or simple reflective methods could not tackle effectively. Its potential is powerfully demonstrated via direct comparison with humans in real-world Kaggle data science competitions. Learning fully automated data science code generation across 81 tasks, our system, Agent K, demonstrated the ability to perform the entire workflow autonomously, achieving an Elo-MMR score of 1694, beyond median score of the Kaggle Masters (the top 2% among 200,000 users) of our study. With 9 gold, 8 silver, and 12 bronze medals level performance - including 4 gold and 4 silver on prize-awarding competitions - Agent K is the 1st AI system to successfully integrate Kolb- and Vygotsky-inspired human cognitive learning, marking a major step toward generalist AI.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 33 of its 354 references that are in the map. First posted on arXiv 5 Nov 2024.
Builds on
33 of 354 references.
Closest ancestors · 2
Same direction, newest first
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
- 2023Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoning22 Dec
Other references · 31
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2023Mistral 7Bcited by 3,065
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
- 2022Towards Reasoning in Large Language Models: A Surveycited by 593
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
- 2022DS-1000: A Natural and Reliable Benchmark for Data Science Code Generationcited by 442
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
- 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
- 2024Tool Learning with Large Language Models: A Surveycited by 221
19 more
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
- 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 171
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Taskscited by 134
- 2021HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPOcited by 111
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 98
- 2019An Open Source AutoML Benchmarkcited by 85
- 2023PanGu-Coder2: Boosting Large Language Models for Code with Ranking Feedbackcited by 69
- 2023ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Codecited by 63
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
- 2024Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?cited by 55
- 2024LAMBDA: A Large Model Based Data Agentcited by 30
- 2024AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Modelscited by 29
- 2024ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoningcited by 27
- 2024CleanAgent: Automating Data Standardization with LLM-based Agentscited by 22
- 2023Why Can Large Language Models Generate Correct Chain-of-Thoughts?cited by 16
- 2023SEED: Domain-Specific Data Curation With Large Language Modelscited by 10
- 2020Mastering Rate based Curriculum Learningcited by 9
- 2021An Elo-like System for Massive Multiplayer Competitionscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 14; 2026: 7.
22 papers.
Sort:
By area:
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 119
- 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agentscited by 111
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
- 2025El Agente: An Autonomous Agent for Quantum Chemistrycited by 43
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 36
- 2024Aviary: training language agents on challenging scientific taskscited by 23
- 2025MLZero: A Multi-Agent System for End-to-end Machine Learning Automationcited by 22
- 2025Reinforcement Learning for Machine Learning Engineering Agentscited by 13
- 2025IMPROVE: Iterative Model Pipeline Refinement and Optimization Leveraging LLM Expertscited by 7
- 2025Optimizing Case-Based Reasoning System for Functional Test Script Generation with Large Language Modelscited by 7
- 2025BioDSA-1K: Benchmarking Data Science Agents for Biomedical Researchcited by 7
10 more
- 2025Memento 2: Learning by Stateful Reflective Memorycited by 5
- 2025Flow-of-Options: Diversified and Improved LLM Reasoning by Thinking Through Optionscited by 3
- 2026The Y-Combinator for LLMs: Solving Long-Context Rot with λ-Calculuscited by 3
- 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineeringcited by 3
- 2025Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planningcited by 1
- 2026AutoAdapt: An Automated Domain Adaptation Framework for LLMscited by 0
- 2026AgentGA: Evolving Code Solutions in Agent-Seed Spacecited by 0
- 2026Towards Persistent Case-Based Memory for Autonomous Data Science: A CBR-Augmented R&D-Agent with a Locally Deployable Small Language Modelcited by 0
- 2026The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modescited by 0
- 2026TraceML: An Empirical Analysis of Human-Agent Planning in Machine Learning Developmentcited by 0
- 2026TraceML: An Empirical Analysis of Human-Agent Planning in Machine Learning Development26 Aug 2026
- 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineering29 Jun 2026
- 2026The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes9 Jun 2026
- 2026Towards Persistent Case-Based Memory for Autonomous Data Science: A CBR-Augmented R&D-Agent with a Locally Deployable Small Language Model3 Jun 2026
- 2026AgentGA: Evolving Code Solutions in Agent-Seed Space16 Apr 2026
- 2026The Y-Combinator for LLMs: Solving Long-Context Rot with λ-Calculus20 Mar 2026
- 2026AutoAdapt: An Automated Domain Adaptation Framework for LLMs9 Mar 2026
- 2025Memento 2: Learning by Stateful Reflective Memory27 Dec 2025
- 2025Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planning25 Nov 2025
- 2025Reinforcement Learning for Machine Learning Engineering Agents1 Sep 2025
- 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMs22 Aug 2025
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?30 May 2025
10 more
- 2025BioDSA-1K: Benchmarking Data Science Agents for Biomedical Research22 May 2025
- 2025MLZero: A Multi-Agent System for End-to-end Machine Learning Automation20 May 2025
- 2025El Agente: An Autonomous Agent for Quantum Chemistry5 May 2025
- 2025Optimizing Case-Based Reasoning System for Functional Test Script Generation with Large Language Models26 Mar 2025
- 2025AgentRxiv: Towards Collaborative Autonomous Research23 Mar 2025
- 2025IMPROVE: Iterative Model Pipeline Refinement and Optimization Leveraging LLM Experts25 Feb 2025
- 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agents20 Feb 2025
- 2025Flow-of-Options: Diversified and Improved LLM Reasoning by Thinking Through Options18 Feb 2025
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan 2025
- 2024Aviary: training language agents on challenging scientific tasks30 Dec 2024
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 119
- 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agentscited by 111
- 2025El Agente: An Autonomous Agent for Quantum Chemistrycited by 43
- 2024Aviary: training language agents on challenging scientific taskscited by 23
- 2025MLZero: A Multi-Agent System for End-to-end Machine Learning Automationcited by 22
- 2025Reinforcement Learning for Machine Learning Engineering Agentscited by 13
- 2025BioDSA-1K: Benchmarking Data Science Agents for Biomedical Researchcited by 7
- 2025Memento 2: Learning by Stateful Reflective Memorycited by 5
- 2026Towards Persistent Case-Based Memory for Autonomous Data Science: A CBR-Augmented R&D-Agent with a Locally Deployable Small Language Modelcited by 0
- 2026TraceML: An Empirical Analysis of Human-Agent Planning in Machine Learning Developmentcited by 0
- 2026TraceML: An Empirical Analysis of Human-Agent Planning in Machine Learning Development26 Aug 2026
- 2026Towards Persistent Case-Based Memory for Autonomous Data Science: A CBR-Augmented R&D-Agent with a Locally Deployable Small Language Model3 Jun 2026
- 2025Memento 2: Learning by Stateful Reflective Memory27 Dec 2025
- 2025Reinforcement Learning for Machine Learning Engineering Agents1 Sep 2025
- 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMs22 Aug 2025
- 2025BioDSA-1K: Benchmarking Data Science Agents for Biomedical Research22 May 2025
- 2025MLZero: A Multi-Agent System for End-to-end Machine Learning Automation20 May 2025
- 2025El Agente: An Autonomous Agent for Quantum Chemistry5 May 2025
- 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agents20 Feb 2025
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan 2025
- 2024Aviary: training language agents on challenging scientific tasks30 Dec 2024
- 2025Optimizing Case-Based Reasoning System for Functional Test Script Generation with Large Language Modelscited by 7
- 2025Flow-of-Options: Diversified and Improved LLM Reasoning by Thinking Through Optionscited by 3
- 2026The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modescited by 0
- 2026The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes9 Jun 2026
- 2025Optimizing Case-Based Reasoning System for Functional Test Script Generation with Large Language Models26 Mar 2025
- 2025Flow-of-Options: Diversified and Improved LLM Reasoning by Thinking Through Options18 Feb 2025
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 36
- 2025IMPROVE: Iterative Model Pipeline Refinement and Optimization Leveraging LLM Expertscited by 7
- 2026The Y-Combinator for LLMs: Solving Long-Context Rot with λ-Calculuscited by 3
- 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineeringcited by 3
- 2025Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planningcited by 1
- 2026AutoAdapt: An Automated Domain Adaptation Framework for LLMscited by 0
- 2026AgentGA: Evolving Code Solutions in Agent-Seed Spacecited by 0
- 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineering29 Jun 2026
- 2026AgentGA: Evolving Code Solutions in Agent-Seed Space16 Apr 2026
- 2026The Y-Combinator for LLMs: Solving Long-Context Rot with λ-Calculus20 Mar 2026
- 2026AutoAdapt: An Automated Domain Adaptation Framework for LLMs9 Mar 2026
- 2025Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planning25 Nov 2025
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?30 May 2025
- 2025AgentRxiv: Towards Collaborative Autonomous Research23 Mar 2025
- 2025IMPROVE: Iterative Model Pipeline Refinement and Optimization Leveraging LLM Experts25 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2026Experiential Reflective Learning for Self-Improving LLM Agents
- 2025Building Self-Evolving Agents via Experience-Driven Lifelong Learning: A Framework and Benchmark
- 2026LatentGym: A Testbed For Cross-Task Experiential Learning With Controllable Latent Structure
- 2025Simulating Human-Like Learning Dynamics with LLM-Empowered Agents
- 2026Unified Context Evolution for LLM Agents
- 2023Experiential Co-Learning of Software-Developing Agents
- 2026ProPlay: Procedural World Models for Self-Evolving LLM Agents
- 2025LLM Agents Beyond Utility: An Open-Ended Perspective