Bayesian-Agent: Posterior-Guided Skill Evolution Across LLM Agent Harnesses
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
LLM agents increasingly rely on prompts, tools, memory, SOPs, skills, and harness feedback, yet current self-evolution pipelines often update these assets through heuristic reflection or raw success counts. Such updates are brittle when trajectories are sparse, expensive, and context-dependent. We introduce Bayesian-Agent, a native and cross-harness framework that treats reusable agent skills as Bayesian evidence objects. Bayesian-Agent records verified trajectories, maintains posterior beliefs over skill reliability and failure modes, and turns those beliefs into auditable skill actions and model-facing guardrails. This posterior view provides a finite-sample alternative to raw empirical-rate skill updates and frames prompt, context, and harness engineering as inference over the external decision environment. On RealFin-Bench, Bayesian skill evolution matches or improves the raw empirical-rate control and yields large gains on native runs. In the incremental mode, incremental repair improves SOP-Bench from 80% to 95%, Lifelong AgentBench from 90% to 100%, and RealFin-Bench from 45% to 65%. Backend and model-scaling ablations further show that posterior-guided repair can operate across BA native, MiniSWEAgent, and Claude Code, provided the harness produces verifiable task artifacts. The source code is available at https://github.com/DataArcTech/Bayesian-Agent.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 17 of its 32 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
17 of 32 references.
Closest ancestors · 1
Same direction, newest first
Other references · 16
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2018A Tutorial on Bayesian Optimizationcited by 734
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
4 more
- 2025LifelongAgentBench: Evaluating LLM Agents as Lifelong Learnerscited by 65
- 2025SOP-Agent: Empower General Purpose AI Agent with Domain-Specific SOPscited by 11
- 2026RealFin: How Well Do LLMs Reason About Finance When Users Leave Things Unsaid?cited by 9
- 2024BayesAgent: Bayesian Agentic Reasoning Under Uncertainty via Verbalized Probabilistic Graphical Modelingcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents
- 2026Hypothesis-Driven Skill Optimization for LLM Agents
- 2026TRACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agents
- 2026From Memory to Skills: Evidence-Grounded Co-Evolution Governance for Long-Horizon LLM Agents
- 2026Skill is Not One-Size-Fits-All: Model-Aware Skill Alignment for LLM Agents
- 2026SkillAudit: Ground-Truth-Free Skill Evolution via Paired Trajectory Auditing
- 2026SkillFocus: Evolving Agent Skills via Capability Decomposition
- 2026ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?