Robust Scheduling with GFlowNets
Not on the map. Why?
Abstract (arXiv)
Finding the best way to schedule operations in a computation graph is a classical NP-hard problem which is central to compiler optimization. However, evaluating the goodness of a schedule on the target hardware can be very time-consuming. Traditional approaches as well as previous machine learning ones typically optimize proxy metrics, which are fast to evaluate but can lead to bad schedules when tested on the target hardware. In this work, we propose a new approach to scheduling by sampling proportionally to the proxy metric using a novel GFlowNet method. We introduce a technique to control the trade-off between diversity and goodness of the proposed schedules at inference time and demonstrate empirically that the pure optimization baselines can lead to subpar performance with respect to our approach when tested on a target model. Furthermore, we show that conditioning the GFlowNet on the computation graph enables generalization to unseen scheduling problems for both synthetic and real-world compiler datasets.
Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). Builds on 22 of its 43 references that are in the map. First posted on arXiv 17 Jan 2023.
Builds on
22 of 43 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
- 2021Flow Network based Generative Models for Non-Iterative Diverse Candidate Generationcited by 384
- 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 244
- 2020How Neural Networks Extrapolate: From Feedforward to Graph Neural Networkscited by 218
- 2020pymoo: Multi-objective Optimization in Pythoncited by 196
- 2022Biological Sequence Design with GFlowNetscited by 172
- 2018Understanding the impact of entropy on policy optimizationcited by 171
10 more
- 2022Bayesian Structure Learning with Generative Flow Networkscited by 153
- 2020Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learningcited by 139
- 2018Learning Scheduling Algorithms for Data Processing Clusterscited by 133
- 2022Generative Flow Networks for Discrete Probabilistic Modelingcited by 113
- 2018Observe and Look Further: Achieving Consistent Performance on Ataricited by 42
- 2020Transferable Graph Optimizers for ML Compilerscited by 29
- 2019Placeto: Learning Generalizable Device Placement Algorithms for Distributed Machine Learningcited by 26
- 2019Reinforced Genetic Algorithm Learning for Optimizing Computation Graphscited by 17
- 2022Neural Topological Ordering for Computation Graphscited by 12
- 2020Optimizing Memory Placement using Evolutionary Graph Reinforcement Learningcited by 7
Built on by
Citing papers per year: 2023: 19; 2024: 21; 2025: 11; 2026: 16.
67 papers.
Sort:
By area:
- 2023A theory of continuous generative flow networkscited by 98
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2024Learning diverse attacks on large language models for robust red-teaming and safety tuningcited by 54
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2023Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Networkcited by 50
- 2024Improved off-policy training of diffusion samplerscited by 47
- 2023Local Search GFlowNetscited by 45
- 2023GFlowNet-EM for learning compositional latent variable modelscited by 40
- 2023Let the Flows Tell: Solving Graph Combinatorial Optimization Problems with GFlowNetscited by 40
- 2024Discrete Probabilistic Inference as Control in Multi-path Environmentscited by 40
- 2025FlowRL: Matching Reward Distributions for LLM Reasoningcited by 38
- 2023Stochastic Generative Flow Networkscited by 32
38 more
- 2023Thompson sampling for improved exploration in GFlowNetscited by 31
- 2024Efficient Diversity-Preserving Diffusion Alignment via Gradient-Informed GFlowNetscited by 30
- 2024Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examplescited by 29
- 2023Distributional GFlowNets with Quantile Flowscited by 28
- 2024Improving GFlowNets for Text-to-Image Diffusion Alignmentcited by 27
- 2025Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Trainingcited by 27
- 2023Learning to Scale Logits for Temperature-Conditional GFlowNetscited by 26
- 2023PhyloGFN: Phylogenetic inference with generative flow networkscited by 20
- 2023Goal-conditioned GFlowNets for Controllable Multi-Objective Molecular Designcited by 17
- 2023Pre-Training and Fine-Tuning Generative Flow Networkscited by 16
- 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generationcited by 16
- 2025GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networkscited by 15
- 2023Order-Preserving GFlowNetscited by 13
- 2024Pessimistic Backward Policy for GFlowNetscited by 13
- 2024Can a Bayesian Oracle Prevent Harm from an Agent?cited by 12
- 2025Adversarial Generative Flow Network for Solving Vehicle Routing Problemscited by 10
- 2023torchgfn: A PyTorch GFlowNet librarycited by 9
- 2023Expert-Aided Causal Discovery of Ancestral Graphscited by 8
- 2024Looking Backward: Retrospective Backward Synthesis for Goal-Conditioned GFlowNetscited by 8
- 2025Revisiting Non-Acyclic GFlowNets in Discrete Environmentscited by 8
- 2023Expected flow networks in stochastic environments and two-player zero-sum gamescited by 7
- 2024Baking Symmetry into GFlowNetscited by 7
- 2024ARCLE: The Abstraction and Reasoning Corpus Learning Environment for Reinforcement Learningcited by 7
- 2024MetaGFN: Exploring Distant Modes with Adapted Metadynamics for Continuous GFlowNetscited by 6
- 2024On Divergence Measures for Training GFlowNetscited by 6
- 2025Adaptive Destruction Processes for Diffusion Samplerscited by 6
- 2026SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestrationcited by 6
- 2024Random Policy Evaluation Uncovers Policies of Generative Flow Networkscited by 5
- 2025Loss-Guided Auxiliary Agents for Overcoming Mode Collapse in GFlowNetscited by 4
- 2023GenCO: Generating Diverse Designs with Combinatorial Constraintscited by 3
- 2024Embarrassingly Parallel GFlowNetscited by 3
- 2025Pretraining Generative Flow Networks with Inexpensive Rewards for Molecular Graph Generationcited by 3
- 2026Avoid What You Know: Divergent Trajectory Balance for GFlowNetscited by 3
- 2023BatchGFN: Generative Flow Networks for Batch Active Learningcited by 2
- 2025Discrete Compositional Generation via General Soft Operators and Robust Reinforcement Learningcited by 2
- 2024Bifurcated Generative Flow Networkscited by 1
- 2025A Generative Neural Annealer for Black-Box Combinatorial Optimizationcited by 1
- 2026GFlowRL: Scaling Distribution-Matching RL to Large Language Modelscited by 1
50 most cited of 67 All 67 (JSON)
- 2026One Proposal for Every Margin: Zero-Shot Amortized Sequential Importance Sampling for Binary Matrices28 Sep 2026
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolution27 Sep 2026
- 2026Particle GFlowNets: Rethinking Generative Marginalization Models10 Sep 2026
- 2026Generative Learning for Quantum Measurement Design11 Aug 2026
- 2026Path-dependent Discrete Amortized Inference9 Aug 2026
- 2026GFlowRL: Scaling Distribution-Matching RL to Large Language Models15 Jul 2026
- 2026Your GFlowNet Secretly Learns an Optimal Transport Plan4 Jun 2026
- 2026SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestration13 May 2026
- 2026WINFlowNets: Warm-up Integrated Networks Training of Generative Flow Networks for Robotics and Machine Fault Adaptation18 Mar 2026
- 2026Learning to Solve Orienteering Problem with Time Windows and Variable Profits6 Mar 2026
- 2026Avoid What You Know: Divergent Trajectory Balance for GFlowNets19 Feb 2026
- 2026Beyond Normalization: Rethinking the Partition Function as a Difficulty Scheduler for RLVR13 Feb 2026
38 more
- 2026Exploring Multiple High-Scoring Subspaces in Generative Flow Networks12 Feb 2026
- 2026GFlowPO: Generative Flow Network as a Language Model Prompt Optimizer3 Feb 2026
- 2026Controlling Exploration-Exploitation in GFlowNets via Markov Chain Perspectives2 Feb 2026
- 2026Signal from Structure: Exploiting Submodular Upper Bounds in Generative Flow Networks28 Jan 2026
- 2025FlowRL: Matching Reward Distributions for LLM Reasoning18 Sep 2025
- 2025Discrete Compositional Generation via General Soft Operators and Robust Reinforcement Learning20 Jun 2025
- 2025Adaptive Destruction Processes for Diffusion Samplers2 Jun 2025
- 2025Loss-Guided Auxiliary Agents for Overcoming Mode Collapse in GFlowNets21 May 2025
- 2025A Generative Neural Annealer for Black-Box Combinatorial Optimization14 May 2025
- 2025Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Training24 Mar 2025
- 2025GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networks9 Mar 2025
- 2025Pretraining Generative Flow Networks with Inexpensive Rewards for Molecular Graph Generation8 Mar 2025
- 2025Adversarial Generative Flow Network for Solving Vehicle Routing Problems3 Mar 2025
- 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generation17 Feb 2025
- 2025Revisiting Non-Acyclic GFlowNets in Discrete Environments11 Feb 2025
- 2024Efficient Diversity-Preserving Diffusion Alignment via Gradient-Informed GFlowNets10 Dec 2024
- 2024Effective Reward Specification in Deep Reinforcement Learning10 Dec 2024
- 2024Network Representation Learning for Biophysical Neural Network Analysis15 Oct 2024
- 2024On Divergence Measures for Training GFlowNets12 Oct 2024
- 2024Enhancing Solution Efficiency in Reinforcement Learning: Leveraging Sub-GFlowNet and Entropy Integration1 Oct 2024
- 2024MetaGFN: Exploring Distant Modes with Adapted Metadynamics for Continuous GFlowNets28 Aug 2024
- 2024Can a Bayesian Oracle Prevent Harm from an Agent?9 Aug 2024
- 2024ARCLE: The Abstraction and Reasoning Corpus Learning Environment for Reinforcement Learning30 Jul 2024
- 2024Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples9 Jun 2024
- 2024Baking Symmetry into GFlowNets8 Jun 2024
- 2024Embarrassingly Parallel GFlowNets5 Jun 2024
- 2024Random Policy Evaluation Uncovers Policies of Generative Flow Networks4 Jun 2024
- 2024Bifurcated Generative Flow Networks4 Jun 2024
- 2024Looking Backward: Retrospective Backward Synthesis for Goal-Conditioned GFlowNets3 Jun 2024
- 2024Improving GFlowNets for Text-to-Image Diffusion Alignment2 Jun 2024
- 2024Learning diverse attacks on large language models for robust red-teaming and safety tuning28 May 2024
- 2024Pessimistic Backward Policy for GFlowNets25 May 2024
- 2024Dynamic Backtracking in GFlowNets: Enhancing Decision Steps with Reward-Dependent Adjustment Mechanisms8 Apr 2024
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimization11 Mar 2024
- 2024Discrete Probabilistic Inference as Control in Multi-path Environments15 Feb 2024
- 2024Improved off-policy training of diffusion samplers7 Feb 2024
- 2023PhyloGFN: Phylogenetic inference with generative flow networks12 Oct 2023
- 2023Pre-Training and Fine-Tuning Generative Flow Networks5 Oct 2023
50 newest of 67 All 67 (JSON)
- 2025FlowRL: Matching Reward Distributions for LLM Reasoningcited by 38
- 2024Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examplescited by 29
- 2025Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Trainingcited by 27
- 2025GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networkscited by 15
- 2026GFlowRL: Scaling Distribution-Matching RL to Large Language Modelscited by 1
- 2026Beyond Normalization: Rethinking the Partition Function as a Difficulty Scheduler for RLVRcited by 0
- 2026GFlowRL: Scaling Distribution-Matching RL to Large Language Models15 Jul 2026
- 2026Beyond Normalization: Rethinking the Partition Function as a Difficulty Scheduler for RLVR13 Feb 2026
- 2025FlowRL: Matching Reward Distributions for LLM Reasoning18 Sep 2025
- 2025Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Training24 Mar 2025
- 2025GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networks9 Mar 2025
- 2024Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples9 Jun 2024
- 2024Improved off-policy training of diffusion samplerscited by 47
- 2024Efficient Diversity-Preserving Diffusion Alignment via Gradient-Informed GFlowNetscited by 30
- 2024Improving GFlowNets for Text-to-Image Diffusion Alignmentcited by 27
- 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generationcited by 16
- 2025Adaptive Destruction Processes for Diffusion Samplerscited by 6
- 2025Adaptive Destruction Processes for Diffusion Samplers2 Jun 2025
- 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generation17 Feb 2025
- 2024Efficient Diversity-Preserving Diffusion Alignment via Gradient-Informed GFlowNets10 Dec 2024
- 2024Improving GFlowNets for Text-to-Image Diffusion Alignment2 Jun 2024
- 2024Improved off-policy training of diffusion samplers7 Feb 2024
- 2023A theory of continuous generative flow networkscited by 98
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2023Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Networkcited by 50
- 2023Local Search GFlowNetscited by 45
- 2023GFlowNet-EM for learning compositional latent variable modelscited by 40
- 2023Let the Flows Tell: Solving Graph Combinatorial Optimization Problems with GFlowNetscited by 40
- 2024Discrete Probabilistic Inference as Control in Multi-path Environmentscited by 40
- 2023Stochastic Generative Flow Networkscited by 32
- 2023Thompson sampling for improved exploration in GFlowNetscited by 31
- 2023Distributional GFlowNets with Quantile Flowscited by 28
- 2023Learning to Scale Logits for Temperature-Conditional GFlowNetscited by 26
12 most cited of 53 All 53 (JSON)
- 2026One Proposal for Every Margin: Zero-Shot Amortized Sequential Importance Sampling for Binary Matrices28 Sep 2026
- 2026Particle GFlowNets: Rethinking Generative Marginalization Models10 Sep 2026
- 2026Generative Learning for Quantum Measurement Design11 Aug 2026
- 2026Path-dependent Discrete Amortized Inference9 Aug 2026
- 2026Your GFlowNet Secretly Learns an Optimal Transport Plan4 Jun 2026
- 2026WINFlowNets: Warm-up Integrated Networks Training of Generative Flow Networks for Robotics and Machine Fault Adaptation18 Mar 2026
- 2026Learning to Solve Orienteering Problem with Time Windows and Variable Profits6 Mar 2026
- 2026Avoid What You Know: Divergent Trajectory Balance for GFlowNets19 Feb 2026
- 2026Exploring Multiple High-Scoring Subspaces in Generative Flow Networks12 Feb 2026
- 2026GFlowPO: Generative Flow Network as a Language Model Prompt Optimizer3 Feb 2026
- 2026Controlling Exploration-Exploitation in GFlowNets via Markov Chain Perspectives2 Feb 2026
- 2026Signal from Structure: Exploiting Submodular Upper Bounds in Generative Flow Networks28 Jan 2026
12 newest of 53 All 53 (JSON)