SI-Agent: An Agentic Framework for Feedback-Driven Generation and Tuning of Human-Readable System Instructions for Large Language Models
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
System Instructions (SIs), or system prompts, are pivotal for guiding Large Language Models (LLMs) but manual crafting is resource-intensive and often suboptimal. Existing automated methods frequently generate non-human-readable "soft prompts," sacrificing interpretability. This paper introduces SI-Agent, a novel agentic framework designed to automatically generate and iteratively refine human-readable SIs through a feedback-driven loop. SI-Agent employs three collaborating agents: an Instructor Agent, an Instruction Follower Agent (target LLM), and a Feedback/Reward Agent evaluating task performance and optionally SI readability. The framework utilizes iterative cycles where feedback guides the Instructor's refinement strategy (e.g., LLM-based editing, evolutionary algorithms). We detail the framework's architecture, agent roles, the iterative refinement process, and contrast it with existing methods. We present experimental results validating SI-Agent's effectiveness, focusing on metrics for task performance, SI readability, and efficiency. Our findings indicate that SI-Agent generates effective, readable SIs, offering a favorable trade-off between performance and interpretability compared to baselines. Potential implications include democratizing LLM customization and enhancing model transparency. Challenges related to computational cost and feedback reliability are acknowledged.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 18 of its 31 references that are in the map. First posted on arXiv 3 Jul 2025.
Builds on
18 of 31 references.
Closest ancestors · 3
Same direction, newest first
- 2024LLM Multi-Agent Systems: Challenges and Open Problems5 Feb
- 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug
Other references · 15
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2023Large Language Models as Optimizerscited by 864
- 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 689
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 366
- 2022Instruction Induction: From Few Examples to Natural Language Task Descriptionscited by 152
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Enhancing LLM Instruction Following: An Evaluation-Driven Multi-Agentic Workflow for Prompt Instructions Optimization
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs
- 2025AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios
- 2025AgentRefine: Enhancing Agent Generalization through Refinement Tuning
- 2025ZERA: Zero-init Instruction Evolving Refinement Agent -- From Zero Instructions to Structured Prompts via Principle-based Optimization
- 2026Prompt Codebooks: Discrete Compositional Optimization for Language Model Instruction Refinement
- 2025Dynamic System Instructions and Tool Exposure for Efficient Agentic LLMs
- 2025Instruction-Level Weight Shaping: A Framework for Self-Improving AI Agents