mlsanityData to 14 Oct 2026

AtomSearch: Evidence-Grounded Tree Search for Agent Skill Optimization

arXiv 2610.19951 ↗First posted 14 Oct 2026cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Agent skills adapt frozen models through editable external instructions. Revising several rules at once makes changes difficult to inspect, while judging each local edit only by its immediate score can discard useful intermediate states. We introduce AtomSearch, which keeps revision actions local while using subsequent skill states to guide search. Contrastive atomic editing links each primitive rule edit to failed and successful executions, a behavioral hypothesis, and an intended scope. Skill-State Tree Search (STS) evaluates short edit compositions and selectively retains them as executable states that can be revisited and extended. Outcome memory supplies later proposals with observed repair and regression statistics. We evaluate AtomSearch across four tasks and five target models. With deepseek-v4-flash, it exceeds SkillOpt on three of four tasks, including a 9.68-percentage-point gain on LiveMathematicianBench, and SkillOpt's final skills contain 2.3-19.7 times as many characters. In 67% of completed searches, the best validation state passes through an ancestor that was not highest-scoring at its depth. These results show how local rule edits can support the exploration of useful revision paths and yield compact skills, with additional offline evaluations used to explore alternative states.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 42 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

31 of 42 references.

References · 31

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  3. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  5. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  6. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  7. 2023Large Language Models as Optimizerscited by 864
  8. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  9. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
  10. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
  11. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  12. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
19 more
  1. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  2. 2024Automated Design of Agentic Systemscited by 407
  3. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
  4. 2024Agent Workflow Memorycited by 383
  5. 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 291
  6. 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 233
  7. 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 225
  8. 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 163
  9. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
  10. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
  11. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111
  12. 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 109
  13. 2024AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoningcited by 72
  14. 2026SkillReducer: Optimizing LLM Agent Skills for Token Efficiencycited by 33
  15. 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revisioncited by 30
  16. 2024ConstitutionalExperts: Training a Mixture of Principle-based Promptscited by 8
  17. 2026Bilevel Optimization of Agent Skills via Monte Carlo Tree Searchcited by 4
  18. 2026Progressive Agent Skill Generation via Reinforcement Learningcited by 2
  19. 2026Contrastive Reflection for Iterative Prompt Optimizationcited by 1

Built on by

Not cited yet.