AtomSearch: Evidence-Grounded Tree Search for Agent Skill Optimization
Not on the map. Why?
Abstract (arXiv)
Agent skills adapt frozen models through editable external instructions. Revising several rules at once makes changes difficult to inspect, while judging each local edit only by its immediate score can discard useful intermediate states. We introduce AtomSearch, which keeps revision actions local while using subsequent skill states to guide search. Contrastive atomic editing links each primitive rule edit to failed and successful executions, a behavioral hypothesis, and an intended scope. Skill-State Tree Search (STS) evaluates short edit compositions and selectively retains them as executable states that can be revisited and extended. Outcome memory supplies later proposals with observed repair and regression statistics. We evaluate AtomSearch across four tasks and five target models. With deepseek-v4-flash, it exceeds SkillOpt on three of four tasks, including a 9.68-percentage-point gain on LiveMathematicianBench, and SkillOpt's final skills contain 2.3-19.7 times as many characters. In 67% of completed searches, the best validation state passes through an ancestor that was not highest-scoring at its depth. These results show how local rule edits can support the exploration of useful revision paths and yield compact skills, with additional offline evaluations used to explore alternative states.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 42 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
31 of 42 references.
References · 31
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023Large Language Models as Optimizerscited by 864
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
19 more
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2024Automated Design of Agentic Systemscited by 407
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2024Agent Workflow Memorycited by 383
- 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 291
- 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 233
- 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 225
- 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 163
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 109
- 2024AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoningcited by 72
- 2026SkillReducer: Optimizing LLM Agent Skills for Token Efficiencycited by 33
- 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revisioncited by 30
- 2024ConstitutionalExperts: Training a Mixture of Principle-based Promptscited by 8
- 2026Bilevel Optimization of Agent Skills via Monte Carlo Tree Searchcited by 4
- 2026Progressive Agent Skill Generation via Reinforcement Learningcited by 2
- 2026Contrastive Reflection for Iterative Prompt Optimizationcited by 1
Built on by
Not cited yet.