Helix: A Dual-Helix Co-Evolutionary Multi-Agent System for Prompt Optimization and Question Reformulation
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Automated prompt optimization (APO) aims to improve large language model performance by refining prompt instructions. However, existing methods are largely constrained by fixed prompt templates, limited search spaces, or single-sided optimization that treats user questions as immutable inputs. In practice, question formulation and prompt design are inherently interdependent: clearer question structures facilitate focused reasoning and task understanding, while effective prompts reveal better ways to organize and restate queries. Ignoring this coupling fundamentally limits the effectiveness and adaptability of current APO approaches. We propose a unified multi-agent system (Helix) that jointly optimizes question reformulation and prompt instructions through a structured three-stage co-evolutionary framework. Helix integrates (1) planner-guided decomposition that breaks optimization into coupled question-prompt objectives, (2) dual-track co-evolution where specialized agents iteratively refine and critique each other to produce complementary improvements, and (3) strategy-driven question generation that instantiates high-quality reformulations for robust inference. Extensive experiments on 12 benchmarks against 6 strong baselines demonstrate the effectiveness of Helix, achieving up to 3.95% performance improvements across tasks with favorable optimization efficiency.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 33 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
28 of 33 references.
Closest ancestors · 3
Same direction, newest first
- 2025MPO: Boosting LLM Agents with Meta Plan Optimization4 Mar
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMs10 Jan
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
Other references · 25
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
13 more
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023Large Language Models as Optimizerscited by 830
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 226
- 2023Prompt Engineering a Prompt Engineercited by 53
- 2023Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Samplingcited by 46
- 2023Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Modelscited by 38
- 2024A Semantic Mention Graph Augmented Model for Document-Level Event Argument Extractioncited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answering
- 2024Towards Hierarchical Multi-Agent Workflows for Zero-Shot Prompt Optimization
- 2025MARS: Multi-Agent Adaptive Reasoning with Socratic Guidance for Automated Prompt Optimization
- 2026Agent-GWO: Collaborative Agents for Dynamic Prompt Optimization in Large Language Models
- 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference
- 2026Asking Questions the Right Way: A Multi-Agent Conversational System for Prompt Formulation in Complex Task Resolution
- 2025Tournament of Prompts: Evolving LLM Instructions Through Structured Debates and Elo Ratings
- 2025GreenTEA: Gradient Descent with Topic-modeling and Evolutionary Auto-prompting