Learning to Compose for Cross-domain Agentic Workflow Generation
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Automatically generating agentic workflows -- executable operator graphs or codes that orchestrate reasoning, verification, and repair -- has become a practical way to solve complex tasks beyond what single-pass LLM generation can reliably handle. Yet what constitutes a good workflow depends heavily on the task distribution and the available operators. Under domain shift, current systems typically rely on iterative workflow refinement to discover a feasible workflow from a large workflow space, incurring high iteration costs and yielding unstable, domain-specific behavior. In response, we internalize a decompose-recompose-decide mechanism into an open-source LLM for cross-domain workflow generation. To decompose, we learn a compact set of reusable workflow capabilities across diverse domains. To recompose, we map each input task to a sparse composition over these bases to generate a task-specific workflow in a single pass. To decide, we attribute the success or failure of workflow generation to counterfactual contributions from learned capabilities, thereby capturing which capabilities actually drive success by their marginal effects. Across stringent multi-domain, cross-domain, and unseen-domain evaluations, our 1-pass generator surpasses SOTA refinement baselines that consume 20 iterations, while substantially reducing generation latency and cost.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 32 of its 49 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
32 of 49 references.
Closest ancestors · 6
Same direction, newest first
- 2025RobustFlow: Towards Robust Agentic Workflow Generation26 Sep
- 2025Multi-View Encoders for Performance Prediction in LLM-Based Agentic Workflows26 May
- 2025GNNs as Predictors of Agentic Workflow Performances14 Mar
- 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization6 Feb
- 2024AFlow: Automating Agentic Workflow Generation14 Oct
- 2024Benchmarking Agentic Workflow Generation10 Oct
Other references · 26
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
14 more
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
- 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 488
- 2024Automated Design of Agentic Systemscited by 360
- 2019Causal Confusion in Imitation Learningcited by 286
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 281
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 246
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 106
- 2024Multi-LoRA Composition for Image Generationcited by 80
- 2021Generalizable Person Re-identification with Relevance-aware Mixture of Expertscited by 77
- 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 56
- 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systemscited by 45
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Frameworkcited by 32
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025A2Flow: Automating Agentic Workflow Generation via Self-Adaptive Abstraction Operators
- 2026Learning Compositional Meta-Routing for Agentic Workflows: An Executable Benchmark
- 2026It Takes Workflows to Evolve Better Workflows
- 2026Workflow-Localized Mechanism Learning: Attribution-Guided Repair and Knowledge Reuse for Structured Agent Skills
- 2025MermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary Programming
- 2026Global Optimization and Inference-Time Region Grafting for Agentic Workflows
- 2026WorkflowOps: Learning Agent Collaboration Priors for Multi-Agent Workflow Orchestration
- 2025DyFlow: Dynamic Workflow Framework for Agentic Reasoning