Automating SKILL.md Generation for Computer-Using Agents via Interaction Trajectory Mining
Not on the map. Why?
Abstract (arXiv)
Explicit skill libraries make computer-using agents easier to inspect, but it remains unclear whether such libraries can be mined from interaction data in a way that improves downstream policies. We study this question through a three-stage pipeline that segments GUI trajectories, clusters segments into candidate skills, and trains a skill-aware policy from the resulting annotations. The mined clusters are readable on the source benchmark: five of eight clusters have at least 0.95 purity against InteraSkill Workflows labels. However, readability does not imply transfer. GRPO improves IW skill-step accuracy only from 18.5% to 20.5%, leaves BrowseComp+ essentially unchanged, and underperforms trivial frequency priors on key source-domain metrics. We therefore present the method as a diagnostic study: trajectory mining can expose inspectable skill structure, but the current boundary detector, orderless segment representation, and offline reward model are insufficient for reliable cross-domain policy improvement.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 48 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
39 of 48 references.
References · 39
- 2020Supervised Contrastive Learningcited by 2,829
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 752
- 2018Data-Efficient Hierarchical Reinforcement Learningcited by 455
- 2016The Option-Critic Architecturecited by 448
- 2024Agent Workflow Memorycited by 383
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 337
27 more
- 2019Dynamics-Aware Unsupervised Discovery of Skillscited by 313
- 2016Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivationcited by 286
- 2016Variational Intrinsic Controlcited by 267
- 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 256
- 2024DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learningcited by 214
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
- 2020OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement Learningcited by 166
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
- 2025OpenCUA: Open Foundations for Computer-Use Agentscited by 160
- 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 130
- 2017Meta Learning Shared Hierarchiescited by 93
- 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learningcited by 61
- 2024VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thoughtcited by 55
- 2018Learning Actionable Representations with Goal-Conditioned Policiescited by 54
- 2024Proposer-Agent-Evaluator(PAE): Autonomous Skill Discovery For Foundation Model Internet Agentscited by 50
- 2019Hierarchical Reinforcement Learning with Advantage-Based Auxiliary Rewardscited by 40
- 2021The Information Geometry of Unsupervised Reinforcement Learningcited by 37
- 2018Learning Abstract Optionscited by 31
- 2025UltraCUA: A Foundation Model for Computer Use Agents with Hybrid Actioncited by 31
- 2024Selection of LLM Fine-Tuning Data based on Orthogonal Rulescited by 12
- 2025MedGUIDE: Benchmarking Clinical Decision-Making in Large Language Modelscited by 10
- 2026OpAgent: Operator Agent for Web Navigationcited by 8
- 2026Skills-Coach: A Self-Evolving Skill Optimizer via Training-Free GRPOcited by 8
- 2024Personalizing Prostate Cancer Education for Patients Using an EHR-Integrated LLM Agentcited by 7
- 2025Open-World Skill Discovery from Unsegmented Demonstrationscited by 7
- 2025Data-adaptive Safety Rules for Training Reward Modelscited by 6
- 2025MedPAIR: Measuring Physicians and AI Relevance Alignment in Medical Question Answeringcited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agents
- 2026SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generation
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents
- 2026HiSkill: Empowering LLM Agents with Hierarchical Skill Graphs
- 2026SkillHarness: Harnessing Safe Skills for Computer-Use Agents
- 2026SKT: Skill-Use Training at Scale via Verified Synthetic Data Generation
- 2026SkillRouter: Skill Routing for LLM Agents at Scale
- 2026M2-Miner: Multi-Agent Enhanced MCTS for Mobile GUI Agent Data Mining