mlsanityData to 7 Oct 2026

GLOW: Graph-Language Co-Encoding for Agentic Workflow Performance Prediction

arXiv 2512.15751 ↗First posted 11 Dec 2025cs.LG cs.AI cs.MAcited by 1

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Agentic Workflows (AWs) have emerged as a promising paradigm for solving complex tasks. However, automatically generating high-quality AWs remains expensive because AW optimization requires evaluating a large number of candidate AWs via execution, resulting in high computational cost and latency. Recently, AW performance prediction has become a hot research topic to avoid costly execution-based evaluation, but existing methods primarily use Graph Neural Networks (GNNs) to model workflow structures and insufficiently capture the semantic relationships among agents. To address this limitation, we propose GLOW, a unified framework for AW performance prediction that combines the graph-structure modeling ability of GNNs with the topology-aware semantic encoding capability of LLMs. Specifically, a graph-oriented LLM is first built through instruction-tuning on graph understanding tasks to extract topology-aware semantic representations from descriptive text of AWs. Meanwhile, a GNN explicitly models the structural information of AWs and produces corresponding structural representations. The semantic and structural representations are then fused in a shared latent space using a Transformer-based fusion module. A contrastive learning strategy is further introduced to learn more discriminative representations for AWs. Experiments on the FLORA-Bench benchmark demonstrate that GLOW consistently outperforms state-of-the-art baselines in both prediction accuracy and ranking utility. Moreover, when integrated into the AFLOW, an automatic AW generation framework, GLOW reduces optimization time by 98.7% with only a 0.031 average score decrease across three datasets, showing its effectiveness as an efficient surrogate evaluator for AW optimization.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 48 of its 58 references that are in the map. First posted on arXiv 11 Dec 2025.

Builds on

48 of 58 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025A2Flow: Automating Agentic Workflow Generation via Self-Adaptive Abstraction Operators23 Nov
  2. 2025DyFlow: Dynamic Workflow Framework for Agentic Reasoning30 Sep
  3. 2025RobustFlow: Towards Robust Agentic Workflow Generation26 Sep
  4. 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub18 Sep
  5. 2025Multi-View Encoders for Performance Prediction in LLM-Based Agentic Workflows26 May
  6. 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generation24 May
  7. 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
  8. 2025GNNs as Predictors of Agentic Workflow Performances14 Mar
  9. 2025Flow: Modularized Agentic Workflow Automation14 Jan
  10. 2024Self-Evolving Multi-Agent Collaboration Networks for Software Development22 Oct
  11. 2024AFlow: Automating Agentic Workflow Generation14 Oct
  12. 2024AutoFlow: Automated Workflow Generation for Large Language Model Agents1 Jul
1 more
  1. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead7 Apr

Other references · 35

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2017Graph Attention Networkscited by 8,854
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  7. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  8. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  9. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  10. 2018How Powerful are Graph Neural Networks?cited by 4,355
  11. 2021Program Synthesis with Large Language Modelscited by 3,509
  12. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
23 more
  1. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  2. 2020Simple and Deep Graph Convolutional Networkscited by 857
  3. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 500
  4. 2024Automated Design of Agentic Systemscited by 360
  5. 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 276
  6. 2023Can Language Models Solve Graph Problems in Natural Language?cited by 249
  7. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  8. 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
  9. 2023Language is All a Graph Needscited by 219
  10. 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 175
  11. 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networkscited by 110
  12. 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Modelcited by 105
  13. 2023Scaling Sentence Embeddings with Large Language Modelscited by 83
  14. 2024LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddingscited by 60
  15. 2024InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignmentcited by 56
  16. 2024Can we Soft Prompt LLMs for Graph Learning Tasks?cited by 52
  17. 2023LLM4DyG: Can Large Language Models Solve Spatial-Temporal Problems on Dynamic Graphs?cited by 40
  18. 2024MAgICoRe: Multi-Agent, Iterative, Coarse-to-Fine Refinement for Reasoningcited by 40
  19. 2024Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Better Solvers for Math Word Problemscited by 31
  20. 2024Simple Techniques for Enhancing Sentence Embeddings in Generative Language Modelscited by 26
  21. 2024LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learningcited by 17
  22. 2024Reasoning Capacity in Multi-Agent Systems: Limitations, Challenges and Human-Centered Solutionscited by 15
  23. 2024Investigating Instruction Tuning Large Language Models on Graphscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026GraphFlow: A Graph-Based Workflow Management for Efficient LLM-Agent Serving
  2. 2026WorkflowOps: Learning Agent Collaboration Priors for Multi-Agent Workflow Orchestration
  3. 2024Benchmarking Agentic Workflow Generation
  4. 2026AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction
  5. 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows
  6. 2026Learning Compositional Meta-Routing for Agentic Workflows: An Executable Benchmark
  7. 2026GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration
  8. 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents