mlsanityData to 14 Oct 2026

SI-Agent: An Agentic Framework for Feedback-Driven Generation and Tuning of Human-Readable System Instructions for Large Language Models

arXiv 2507.03223 ↗First posted 3 Jul 2025cs.AI cs.LGcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

System Instructions (SIs), or system prompts, are pivotal for guiding Large Language Models (LLMs) but manual crafting is resource-intensive and often suboptimal. Existing automated methods frequently generate non-human-readable "soft prompts," sacrificing interpretability. This paper introduces SI-Agent, a novel agentic framework designed to automatically generate and iteratively refine human-readable SIs through a feedback-driven loop. SI-Agent employs three collaborating agents: an Instructor Agent, an Instruction Follower Agent (target LLM), and a Feedback/Reward Agent evaluating task performance and optionally SI readability. The framework utilizes iterative cycles where feedback guides the Instructor's refinement strategy (e.g., LLM-based editing, evolutionary algorithms). We detail the framework's architecture, agent roles, the iterative refinement process, and contrast it with existing methods. We present experimental results validating SI-Agent's effectiveness, focusing on metrics for task performance, SI readability, and efficiency. Our findings indicate that SI-Agent generates effective, readable SIs, offering a favorable trade-off between performance and interpretability compared to baselines. Potential implications include democratizing LLM customization and enhancing model transparency. Challenges related to computational cost and feedback reliability are acknowledged.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 18 of its 31 references that are in the map. First posted on arXiv 3 Jul 2025.

Builds on

18 of 31 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024LLM Multi-Agent Systems: Challenges and Open Problems5 Feb
  2. 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
  3. 2023A Survey on Large Language Model based Autonomous Agents22 Aug

Other references · 15

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  7. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  8. 2023Large Language Models as Optimizerscited by 864
  9. 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 689
  10. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  11. 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 366
  12. 2022Instruction Induction: From Few Examples to Natural Language Task Descriptionscited by 152
3 more
  1. 2024Efficient Prompting Methods for Large Language Models: A Surveycited by 47
  2. 2024Dynamic Rewarding with Prompt Optimization Enables Tuning-free Self-Alignment of Language Modelscited by 13
  3. 2024GReaTer: Gradients over Reasoning Makes Smaller Language Models Strong Prompt Optimizerscited by 12

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Enhancing LLM Instruction Following: An Evaluation-Driven Multi-Agentic Workflow for Prompt Instructions Optimization
  2. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs
  3. 2025AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios
  4. 2025AgentRefine: Enhancing Agent Generalization through Refinement Tuning
  5. 2025ZERA: Zero-init Instruction Evolving Refinement Agent -- From Zero Instructions to Structured Prompts via Principle-based Optimization
  6. 2026Prompt Codebooks: Discrete Compositional Optimization for Language Model Instruction Refinement
  7. 2025Dynamic System Instructions and Tool Exposure for Efficient Agentic LLMs
  8. 2025Instruction-Level Weight Shaping: A Framework for Self-Improving AI Agents