A Learning Method with Gap-Aware Generation for Heterogeneous DAG Scheduling
Not on the map. Why?
Abstract (arXiv)
Efficient scheduling of directed acyclic graphs (DAGs) is a core problem in large-scale data-intensive computing systems, where query plans, data-processing workloads, and computation graphs consist of dependent tasks competing for limited heterogeneous resource pools. In practice, achieving high-performance execution requires schedulers to adapt across environments with varying resource pools and task types, while generating schedules under tight runtime budgets. We propose WeCAN, an end-to-end reinforcement learning framework for heterogeneous DAG scheduling that addresses task-pool compatibility coefficients and generation-induced optimality gaps. It adopts a two-stage single-pass design: a single forward pass produces task-pool scores and global parameters, followed by a generation map that constructs schedules without repeated network calls. Its weighted cross-attention encoder models task-pool interactions gated by compatibility coefficients, and is size-agnostic to environment fluctuations. Moreover, widely used list-scheduling maps can incur generation-induced optimality gaps from restricted reachability. We introduce an order-space analysis that characterizes the reachable set of generation maps via feasible schedule orders, explains the mechanism behind generation-induced gaps, and yields sufficient conditions for gap elimination. Guided by these conditions, we design a skip-extended realization with an analytically parameterized decreasing skip rule, which enlarges the reachable order set while preserving single-pass efficiency. Experiments on real-world TPC-H query DAGs, resource-intensive workload datasets, and ML-compiler computation graphs demonstrate improved makespan over strong baselines, with inference time comparable to classical heuristics and faster than multi-round neural schedulers.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 54 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
24 of 54 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
- 2024Reinforcement learningcited by 236
- 2020Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learningcited by 139
- 2018Learning Scheduling Algorithms for Data Processing Clusterscited by 133
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 82
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
- 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 69
- 2021Learning to schedule job-shop problems: Representation and policy learning using graph neural network and reinforcement learningcited by 52
- 2020Transferable Graph Optimizers for ML Compilerscited by 29
- 2021A Bi-Level Framework for Learning to Solve Combinatorial Optimization on Graphscited by 26
- 2022Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop Schedulingcited by 20
12 more
- 2023Flexible Job Shop Scheduling via Dual Attention Network Based Reinforcement Learningcited by 20
- 2019Reinforced Genetic Algorithm Learning for Optimizing Computation Graphscited by 17
- 2022Neural Topological Ordering for Computation Graphscited by 12
- 2020Revocable Deep Reinforcement Learning with Affinity Regularization for Outlier-Robust Graph Matchingcited by 11
- 2025Learning-Guided Rolling Horizon Optimization for Long-Horizon Flexible Job-Shop Schedulingcited by 7
- 2021Learning to Optimize DAG Scheduling in Heterogeneous Environmentcited by 6
- 2023Learning Coordination Policies over Heterogeneous Graphs for Human-Robot Teams via Recurrent Neural Schedule Propagationcited by 5
- 2024Learning Topological Representations with Bidirectional Graph Attention Network for Solving Job Shop Scheduling Problemcited by 5
- 2019Inductive-bias-driven Reinforcement Learning For Efficient Schedules in Heterogeneous Clusterscited by 4
- 2020Geometric Deep Reinforcement Learning for Dynamic DAG Schedulingcited by 3
- 2025LMask: Learn to Solve Constrained Routing Problems with Lazy Maskingcited by 3
- 2023Edge Generation Scheduling for DAG Tasks Using Deep Reinforcement Learningcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.