The Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
A self-evolving agent retires its bad skills by watching them fail, so what happens when the judge cannot see the failures? Skill retirement is the structural constraint that keeps a growing library from drifting below the no-skill baseline, but its guarantee assumes an unbiased reward, which is false for the LLM judges that reference-free tasks require. We show that a biased judge does not merely add noise; it silently switches off the curator. We make this precise with a corrupted-reward analysis, then a behavioral study on a reference-free report-writing testbed with a code-generation cross-check, injecting corruption on top of a deterministic reward to isolate the causal channel. Symmetric noise leaves retirement intact, but false-pass bias (failures slipping through as passes) disables contribution-based retirement past a sharp threshold (here a false-pass rate of 0.45) that no amount of data can cross. Separating genuine retirement from cap-eviction churn shows this mechanism failure is universal, holding across domains and failure rates and sparing only near-zero-false-pass, verifier-like graders. The downstream outcome, though, is regime-dependent: eval quality degrades only where the same corruption also starves skill synthesis, and otherwise holds steady, so the disabled curator is silent, surfacing in no aggregate metric. The contribution is a behavioral safety result, not a performance one. A cheap defect-injection audit then tells an operator, before deployment, which side of the threshold their judge occupies.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 31 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
28 of 31 references.
Closest ancestors · 4
Same direction, newest first
- 2026Closing the Feedback Loop: From Experience Extraction to Insight Governance in Verbal Reinforcement Learning16 Jun
- 2025CASCADE: Cumulative Agentic Skill Creation through Autonomous Development and Evolution29 Dec
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle17 Oct
- 2023ExpeL: LLM Agents Are Experiential Learners20 Aug
Other references · 24
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023Large Language Models are not Fair Evaluatorscited by 1,050
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
12 more
- 2024Agent Workflow Memorycited by 342
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 252
- 2024TextGrad: Automatic "Differentiation" via Textcited by 250
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
- 2024Large Language Models are Inconsistent and Biased Evaluatorscited by 146
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 105
- 2026SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolutioncited by 18
- 2026Dynamic Skill Lifecycle Management for Agentic Reinforcement Learningcited by 10
- 2026Library Drift: Diagnosing and Fixing a Silent Failure Mode in Self-Evolving LLM Skill Librariescited by 10
- 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectoriescited by 10
- 2026AutoPyVerifier: Learning Compact Executable Verifiers for Large Language Model Outputscited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents
- 2026Who Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM Agents
- 2026Not All Skills Help: Measuring and Repairing Agent Knowledge
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents
- 2026SkillSmith: Co-Evolving Skills and Tools for Self-Improving Agent Systems
- 2026Reward-Free Evolving Agents via Pairwise Validator
- 2026Coalition-Aware Skill Reliability for Self-Evolving Agents
- 2026A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents