Why Search When You Can Transfer? Amortized Agentic Workflow Design from Structural Priors
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Automated agentic workflow design currently relies on per-task iterative search, which is computationally prohibitive and fails to reuse structural knowledge across tasks. We observe that optimized workflows converge to a small family of domain-specific topologies, suggesting that this combinatorial search is largely redundant. Building on this insight, we propose SWIFT (Synthesizing Workflows via Few-shot Transfer), a framework that amortizes workflow design into reusable structural priors. SWIFT first distills compositional heuristics and output-interface contracts from contrastive analysis of prior search trajectories across source tasks. At inference time, it conditions a single LLM generation pass on these priors together with cross-task workflow demonstrations to synthesize a complete, executable workflow for an unseen target task, bypassing iterative search entirely. On five benchmarks, SWIFT outperforms the state-of-the-art search-based method while reducing marginal per-task optimization cost by three orders of magnitude. It further generalizes to four additional unseen benchmarks and transfers successfully from GPT-4o-mini to three additional foundation models (Grok, Qwen, Gemma). Controlled ablations reveal that workflow demonstrations primarily transfer topological structure rather than surface semantics: replacing all operator names with random strings still retains over 93% of the full system's average performance.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 35 of its 41 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
35 of 41 references.
Closest ancestors · 2
Same direction, newest first
- 2025Difficulty-Aware Agentic Orchestration for Query-Specific Multi-Agent Workflows14 Sep
- 2024AFlow: Automating Agentic Workflow Generation14 Oct
Other references · 33
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2023Large Language Models as Optimizerscited by 830
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
21 more
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
- 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
- 2024Automated Design of Agentic Systemscited by 360
- 2024Agent Workflow Memorycited by 342
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 281
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 246
- 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 235
- 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
- 2025Multi-agent Architecture Search via Agentic Supernetcited by 164
- 2016DeepCoder: Learning to Write Programscited by 145
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
- 2017RobustFill: Neural Program Learning under Noisy I/Ocited by 124
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networkscited by 110
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 106
- 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systemscited by 45
- 2025Efficient Agents: Building Effective Agents While Reducing Costcited by 32
- 2025Inefficiencies of Meta Agents for Agent Designcited by 5
- 2024In-Context Transfer Learning: Demonstration Synthesis by Transferring Similar Taskscited by 3
- 2025CrossICL: Cross-Task In-Context Learning via Unsupervised Demonstration Transfercited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026AtelierEval: Agentic Evaluation of Humans & LLMs as Text-to-Image Prompterscited by 7
- 2026MasDrift: Benchmarking Authorization Preservation Across Multi-Agent Architecturescited by 3
- 2026AutoCRAT: Within-trajectory Joint Control of Stochasticity and Compute for LLM Reasoningcited by 1
- 2026Credo: Reusable Declarative Primitives for Agentic Workflowscited by 0
- 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMscited by 0
- 2026From Pareto to Preference: Personalized Test-Time Scaling via Amortized Agentic Policy Discoverycited by 0
- 2026From Pareto to Preference: Personalized Test-Time Scaling via Amortized Agentic Policy Discovery7 Oct 2026
- 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMs10 Sep 2026
- 2026AutoCRAT: Within-trajectory Joint Control of Stochasticity and Compute for LLM Reasoning30 Aug 2026
- 2026Credo: Reusable Declarative Primitives for Agentic Workflows28 Aug 2026
- 2026MasDrift: Benchmarking Authorization Preservation Across Multi-Agent Architectures2 Aug 2026
- 2026AtelierEval: Agentic Evaluation of Humans & LLMs as Text-to-Image Prompters21 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Global Optimization and Inference-Time Region Grafting for Agentic Workflows
- 2026Learning to Compose for Cross-domain Agentic Workflow Generation
- 2026Coupled Hierarchical Search over Topology and Execution for Agentic Workflow Synthesis
- 2026FlowBank: Query-Adaptive Agentic Workflows Optimization through Precompute-and-Reuse
- 2026AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction
- 2026It Takes Workflows to Evolve Better Workflows
- 2026Learning Compositional Meta-Routing for Agentic Workflows: An Executable Benchmark
- 2026Agent-UCT: Upper Confidence Bounds Applied to Trees for Agentic Workflow Optimization with Cost-Awareness