mlsanityData to 7 Oct 2026

Why Search When You Can Transfer? Amortized Agentic Workflow Design from Structural Priors

arXiv 2604.25012 ↗First posted 27 Apr 2026cs.LGcited by 6

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Automated agentic workflow design currently relies on per-task iterative search, which is computationally prohibitive and fails to reuse structural knowledge across tasks. We observe that optimized workflows converge to a small family of domain-specific topologies, suggesting that this combinatorial search is largely redundant. Building on this insight, we propose SWIFT (Synthesizing Workflows via Few-shot Transfer), a framework that amortizes workflow design into reusable structural priors. SWIFT first distills compositional heuristics and output-interface contracts from contrastive analysis of prior search trajectories across source tasks. At inference time, it conditions a single LLM generation pass on these priors together with cross-task workflow demonstrations to synthesize a complete, executable workflow for an unseen target task, bypassing iterative search entirely. On five benchmarks, SWIFT outperforms the state-of-the-art search-based method while reducing marginal per-task optimization cost by three orders of magnitude. It further generalizes to four additional unseen benchmarks and transfers successfully from GPT-4o-mini to three additional foundation models (Grok, Qwen, Gemma). Controlled ablations reveal that workflow demonstrations primarily transfer topological structure rather than surface semantics: replacing all operator names with random strings still retains over 93% of the full system's average performance.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 35 of its 41 references that are in the map. First posted on arXiv 27 Apr 2026.

Builds on

35 of 41 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Difficulty-Aware Agentic Orchestration for Query-Specific Multi-Agent Workflows14 Sep
  2. 2024AFlow: Automating Agentic Workflow Generation14 Oct

Other references · 33

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  8. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  9. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  10. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  11. 2023Large Language Models as Optimizerscited by 830
  12. 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
21 more
  1. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
  2. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
  3. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
  4. 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
  5. 2024Automated Design of Agentic Systemscited by 360
  6. 2024Agent Workflow Memorycited by 342
  7. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 281
  8. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 246
  9. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 235
  10. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
  11. 2025Multi-agent Architecture Search via Agentic Supernetcited by 164
  12. 2016DeepCoder: Learning to Write Programscited by 145
  13. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
  14. 2017RobustFill: Neural Program Learning under Noisy I/Ocited by 124
  15. 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networkscited by 110
  16. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 106
  17. 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systemscited by 45
  18. 2025Efficient Agents: Building Effective Agents While Reducing Costcited by 32
  19. 2025Inefficiencies of Meta Agents for Agent Designcited by 5
  20. 2024In-Context Transfer Learning: Demonstration Synthesis by Transferring Similar Taskscited by 3
  21. 2025CrossICL: Cross-Task In-Context Learning via Unsupervised Demonstration Transfercited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Global Optimization and Inference-Time Region Grafting for Agentic Workflows
  2. 2026Learning to Compose for Cross-domain Agentic Workflow Generation
  3. 2026Coupled Hierarchical Search over Topology and Execution for Agentic Workflow Synthesis
  4. 2026FlowBank: Query-Adaptive Agentic Workflows Optimization through Precompute-and-Reuse
  5. 2026AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction
  6. 2026It Takes Workflows to Evolve Better Workflows
  7. 2026Learning Compositional Meta-Routing for Agentic Workflows: An Executable Benchmark
  8. 2026Agent-UCT: Upper Confidence Bounds Applied to Trees for Agentic Workflow Optimization with Cost-Awareness