mlsanityData to 7 Oct 2026

KUPAS MASTER: Distilling the Tacit Expertise of Master Practitioners into Agent-Ready Experience Corpora

arXiv 2609.37673 ↗First posted 29 Sep 2026cs.AI cs.CLcited by 0

New in LLM agents and tool use; no direction yet. LLM agents and tool use

Abstract (arXiv)

Experienced professionals know more than just facts and conclusions. They know which cues matter, why a judgment is reasonable, and which action to take. Routine work records often leave out this tacit knowledge, making it difficult for Large Language Model (LLM) agents to use professional experience effectively. We introduce KUPAS MASTER, an experience engineering platform built around nine-layer cognitive corpus construction. It turns heterogeneous work records and practitioner interviews into traceable, reusable experience corpora for agents. Six case elements preserve the task process: context, cues, judgment, action, boundaries, and outcomes. Nine-layer cognitive corpus construction organizes tacit experience along nine extraction dimensions and stores the resulting assets in six libraries: rules, constraints, best practices, negative examples, corner cases, and skills. Semantic alignment, individual experience distillation, organizational consolidation, and cross-review preserve source evidence, conditions of use, and unresolved disagreements. The platform packages these assets into callable skills with explicit inputs, steps, dependencies, and stopping conditions, connecting experience collection to task execution and evaluation feedback. Using authorized samples from 20 randomly selected practitioners, the platform processed 1,576 source files into 23,024 individual experience records and 13,113 organizational assets. The evaluation spans multiple professional domains. Under common task inputs and scoring criteria, the base model, raw corpus retrieval-augmented generation (RAG), and KUPAS MASTER agent scored 70.63, 79.75, and 89.58, respectively. The KUPAS MASTER agent improved on raw-corpus RAG in all seven scoring dimensions. The platform provides a practical path from individual tacit experience to organizational knowledge and agent capabilities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 60 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

39 of 60 references.

References · 39

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  7. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  8. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  9. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  10. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  11. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  12. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
27 more
  1. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  2. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  3. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  4. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  5. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  6. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  7. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  8. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  9. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  10. 2019Attention is not Explanationcited by 916
  11. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  12. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  13. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  14. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
  15. 2023Cognitive Architectures for Language Agentscited by 422
  16. 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
  17. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  18. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  19. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
  20. 2024Agent Workflow Memorycited by 342
  21. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 310
  22. 2023Evaluating Verifiability in Generative Search Enginescited by 297
  23. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
  24. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
  25. 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 100
  26. 2024RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generationcited by 59
  27. 2025AgentScope 1.0: A Developer-Centric Framework for Building Agentic Applicationscited by 16

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Anatomy to Smells: An Empirical Study of SKILL.md in Agent Skills
  2. 2026Not All Skills Help: Measuring and Repairing Agent Knowledge
  3. 2026Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?
  4. 2026HANDBOOK.md: A Benchmark for Long-Context Agentic Instruction Following
  5. 2026PRACTICE: From Experience to Expertise in Self-Evolving Embodied Agents
  6. 2026A Framework for Evaluating Agentic Skills at Scale
  7. 2026From Skill Text to Skill Structure: The Scheduling-Structural-Logical Representation for Agent Skills
  8. 2026From Raw Experience to Skill Consumption: A Systematic Study of Model-Generated Agent Skills