GFlowNet Foundations
Not on the map. Why?
Cited by 35 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates in an active learning context, with a training objective that makes them approximately sample in proportion to a given reward function. In this paper, we show a number of additional theoretical properties of GFlowNets. They can be used to estimate joint probability distributions and the corresponding marginal distributions where some variables are unspecified and, of particular interest, can represent distributions over composite objects like sets and graphs. GFlowNets amortize the work typically done by computationally expensive MCMC methods in a single but trained generative pass. They could also be used to estimate partition functions and free energies, conditional probabilities of supersets (supergraphs) given a subset (subgraph), as well as marginal distributions over all supersets (supergraphs) of a given set (graph). We introduce variations enabling the estimation of entropy and mutual information, sampling from a Pareto frontier, connections to reward-maximizing policies, and extensions to stochastic environments, continuous actions and modular energy functions.
Key facts. Cited by 286 papers in the map (data through 7 Oct 2026). Builds on 29 of its 72 references that are in the map. First posted on arXiv 17 Nov 2021.
Builds on
29 of 72 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2014NICE: Non-linear Independent Components Estimationcited by 1,052
- 2017A Distributional Perspective on Reinforcement Learningcited by 743
- 2017Reinforcement Learning with Deep Energy-Based Policiescited by 659
- 2019Deep Equilibrium Modelscited by 603
- 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 555
- 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 466
- 2021Flow Network based Generative Models for Non-Iterative Diverse Candidate Generationcited by 384
17 more
- 2017Grammar Variational Autoencodercited by 283
- 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 273
- 2019DualDICE: Behavior-Agnostic Estimation of Discounted Stationary Distribution Correctionscited by 254
- 2019Recurrent Independent Mechanismscited by 219
- 2017Bridging the Gap Between Value and Policy Based Reinforcement Learningcited by 178
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2019Reinforcement Learning Upside Down: Don't Predict Rewards -- Just Map Them to Actionscited by 124
- 2021Oops I Took A Gradient: Scalable Sampling for Discrete Distributionscited by 92
- 2019Elements of Sequential Monte Carlocited by 60
- 2019Maximum Entropy Generators for Energy-Based Modelscited by 55
- 2018Learning Actionable Representations with Goal-Conditioned Policiescited by 53
- 2020Learning Discrete Energy-based Models via Auxiliary-variable Local Explorationcited by 29
- 2019Autoregressive Energy Machinescited by 23
- 2018A Framework for Adaptive MCMC Targeting Multimodal Distributionscited by 21
- 2017Constrained Bayesian Optimization for Automatic Chemical Designcited by 20
- 2020Batch Stationary Distribution Estimationcited by 19
- 2019Discrete Object Generation with Reversible Inductive Constructioncited by 16
Built on by
Citing papers per year: 2022: 22; 2023: 55; 2024: 79; 2025: 74; 2026: 56.
286 papers.
Sort:
By area:
- 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 294
- 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 244
- 2022Bayesian Structure Learning with Generative Flow Networkscited by 153
- 2024Fine-Tuning of Continuous-Time Diffusion Models as Entropy-Regularized Controlcited by 136
- 2022Learning GFlowNets from partial episodes for improved convergence and stabilitycited by 129
- 2022Generative Flow Networks for Discrete Probabilistic Modelingcited by 113
- 2022GFlowNets and variational inferencecited by 103
- 2023A theory of continuous generative flow networkscited by 98
- 2023Amortizing intractable inference in large language modelscited by 94
- 2024Understanding Reinforcement Learning-Based Fine-Tuning of Diffusion Models: A Tutorial and Reviewcited by 92
- 2023Better Training of GFlowNets with Local Credit and Incomplete Trajectoriescited by 83
- 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matchingcited by 78
38 more
- 2023Towards Understanding and Improving GFlowNet Trainingcited by 74
- 2024Amortizing intractable inference in diffusion models for vision, language, and controlcited by 70
- 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
- 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidancecited by 67
- 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
- 2023GFlowNets for AI-Driven Scientific Discoverycited by 63
- 2023Generative Flow Networks as Entropy-Regularized RLcited by 60
- 2022DiffBP: Generative Diffusion of 3D Molecules for Target Protein Bindingcited by 58
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 58
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2024Learning diverse attacks on large language models for robust red-teaming and safety tuningcited by 54
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2023Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Networkcited by 50
- 2022Generative Augmented Flow Networkscited by 48
- 2023Sample-efficient Multi-objective Molecular Optimization with GFlowNetscited by 48
- 2024Improved off-policy training of diffusion samplerscited by 47
- 2022Reinforced Genetic Algorithm for Structure-based Drug Designcited by 46
- 2023Local Search GFlowNetscited by 45
- 2023GFlowNet-EM for learning compositional latent variable modelscited by 40
- 2023Let the Flows Tell: Solving Graph Combinatorial Optimization Problems with GFlowNetscited by 40
- 2024Discrete Probabilistic Inference as Control in Multi-path Environmentscited by 40
- 2022A Variational Perspective on Generative Flow Networkscited by 39
- 2024RGFN: Synthesizable Molecular Generation Using GFlowNetscited by 39
- 2025FlowRL: Matching Reward Distributions for LLM Reasoningcited by 38
- 2024Genetic-guided GFlowNets for Sample Efficient Molecular Optimizationcited by 36
- 2023BayesDAG: Gradient-Based Posterior Inference for Causal Discoverycited by 33
- 2023Stochastic Generative Flow Networkscited by 32
- 2023Thompson sampling for improved exploration in GFlowNetscited by 31
- 2023Functional-Group-Based Diffusion for Pocket-Specific Molecule Generation and Elaborationcited by 30
- 2023Maximum entropy GFlowNets with soft Q-learningcited by 30
- 2024Efficient Diversity-Preserving Diffusion Alignment via Gradient-Informed GFlowNetscited by 30
- 2023Distributional GFlowNets with Quantile Flowscited by 28
- 2023A Survey on Explainability of Graph Neural Networkscited by 28
- 2024Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Predictioncited by 28
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physicscited by 28
- 2023DynGFN: Towards Bayesian Inference of Gene Regulatory Networks with GFlowNetscited by 27
- 2024Improving GFlowNets for Text-to-Image Diffusion Alignmentcited by 27
- 2025Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Trainingcited by 27
50 most cited of 286 All 286 (JSON)
- 2026CollabFlow: Recursive Self-Improvement of Agent Collaboration29 Sep 2026
- 2026Iterative Exact Discrete Guidance for Energy-Based Sampling29 Sep 2026
- 2026One Proposal for Every Margin: Zero-Shot Amortized Sequential Importance Sampling for Binary Matrices28 Sep 2026
- 2026FestDPO: Few-step Generator Alignment with Direct Preference Optimization28 Sep 2026
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolution27 Sep 2026
- 2026SPIBER: Reconstructing Free Energy Landscapes from Short, Unconverged Trajectories with Generative Flow Networks19 Sep 2026
- 2026Particle GFlowNets: Rethinking Generative Marginalization Models10 Sep 2026
- 2026FlowBalance: Verifier-Grounded Self-Improvement from On-Policy Reasoning Experience3 Sep 2026
- 2026MAIL: Memory-driven, Adaptive, Incremental, and Literature-grounded Framework for Hypothesis Generation in Chemistry28 Aug 2026
- 2026Generative Learning for Quantum Measurement Design11 Aug 2026
- 2026Path-dependent Discrete Amortized Inference9 Aug 2026
- 2026Information-Geometric Forward Policy Training in GFlowNets4 Aug 2026
38 more
- 2026GFlowRL: Scaling Distribution-Matching RL to Large Language Models15 Jul 2026
- 2026TILDE: TILt-based Distributional Erasure for Concept Unlearning7 Jul 2026
- 2026Inoculation Adapters: Improved Selective Generalization of Capabilities with Fewer Surprising Backdoors29 Jun 2026
- 2026FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction23 Jun 2026
- 2026Stop the Sampler! Classifier-Based Adaptive Stopping for Sampling Kernels15 Jun 2026
- 2026Proximal Policy Optimization for Amortized Discrete Sampling14 Jun 2026
- 2026Reward Transport: Property Control in Flow Matching via Noise-Space Alignment13 Jun 2026
- 2026Your GFlowNet Secretly Learns an Optimal Transport Plan4 Jun 2026
- 2026GEM: Geometric Erasure by Contrastive Velocity Matching in Rectified Flows29 May 2026
- 2026SeedER: Seed-Expand-Retrieve for Efficient Knowledge Graph Retrieval22 May 2026
- 2026f-Trajectory Balance: A Loss Family for Tuning GFlowNets, Generative Models, and LLMs with Off- and On-Policy Data14 May 2026
- 2026SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestration13 May 2026
- 2026Beyond Mode-Seeking RL: Trajectory-Balance Post-Training for Diffusion Language Models13 May 2026
- 2026Stable GFlowNets with TV Monitoring and Probabilistic Guarantees3 May 2026
- 2026Position: agentic AI orchestration should be Bayes-consistent1 May 2026
- 2026Stable-GFlowNet: Toward Diverse and Robust LLM Red-Teaming via Contrastive Trajectory Balance1 May 2026
- 2026GFlowState: Visualizing the Training of Generative Flow Networks Beyond the Reward23 Apr 2026
- 2026Generative Flow Networks for Model Adaptation in Digital Twins of Natural Systems22 Apr 2026
- 2026Local Inconsistency Resolution: The Interplay between Attention and Control in Probabilistic Models18 Apr 2026
- 2026FlowPIE: Test-Time Scientific Idea Evolution with Flow-Guided Literature Exploration31 Mar 2026
- 2026QFlowNet: Fast, Diverse, and Efficient Unitary Synthesis with Generative Flow Networks3 Mar 2026
- 2026Learning Shortest Paths with Generative Flow Networks2 Mar 2026
- 2026Transform-Invariant Generative Ray Path Sampling for Efficient Radio Propagation Modeling2 Mar 2026
- 2026Evaluating GFlowNet from partial episodes for stable and flexible policy-based training1 Mar 2026
- 2026Rooted Absorbed Prefix Trajectory Balance with Submodular Replay for GFlowNet Training28 Feb 2026
- 2026Routing by Reaching: Composition of Pre-trained GFlowNets for Multi-Objective Generation25 Feb 2026
- 2026LAD: Learning Advantage Distribution for Reasoning23 Feb 2026
- 2026Avoid What You Know: Divergent Trajectory Balance for GFlowNets19 Feb 2026
- 2026Beyond Normalization: Rethinking the Partition Function as a Difficulty Scheduler for RLVR13 Feb 2026
- 2026Partial GFlowNet: Accelerating Convergence in Large State Spaces via Strategic Partitioning12 Feb 2026
- 2026Sample Efficient Generative Molecular Optimization with Joint Self-Improvement11 Feb 2026
- 2026Flow of Spans: Generalizing Language Models to Dynamic Span-Vocabulary via GFlowNets11 Feb 2026
- 2026Affective Flow Language Model for Emotional Support Conversation9 Feb 2026
- 2026Discrete diffusion samplers and bridges: Off-policy algorithms and applications in latent spaces5 Feb 2026
- 2026Synthesizable Molecular Generation via Soft-constrained GFlowNets with Rich Chemical Priors4 Feb 2026
- 2026GFlowPO: Generative Flow Network as a Language Model Prompt Optimizer3 Feb 2026
- 2026A Systematic Evaluation of Co-folding Model Representations for Small-Molecule Learning2 Feb 2026
- 2026Controlling Exploration-Exploitation in GFlowNets via Markov Chain Perspectives2 Feb 2026
50 newest of 286 All 286 (JSON)
- 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 294
- 2024Fine-Tuning of Continuous-Time Diffusion Models as Entropy-Regularized Controlcited by 136
- 2024Understanding Reinforcement Learning-Based Fine-Tuning of Diffusion Models: A Tutorial and Reviewcited by 92
- 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matchingcited by 78
- 2024Amortizing intractable inference in diffusion models for vision, language, and controlcited by 70
- 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidancecited by 67
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 58
- 2024Improved off-policy training of diffusion samplerscited by 47
- 2024Efficient Diversity-Preserving Diffusion Alignment via Gradient-Informed GFlowNetscited by 30
- 2024Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Predictioncited by 28
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physicscited by 28
- 2024Improving GFlowNets for Text-to-Image Diffusion Alignmentcited by 27
12 most cited of 35 All 35 (JSON)
- 2026TILDE: TILt-based Distributional Erasure for Concept Unlearning7 Jul 2026
- 2026Reward Transport: Property Control in Flow Matching via Noise-Space Alignment13 Jun 2026
- 2026GEM: Geometric Erasure by Contrastive Velocity Matching in Rectified Flows29 May 2026
- 2026Beyond Mode-Seeking RL: Trajectory-Balance Post-Training for Diffusion Language Models13 May 2026
- 2026Discrete diffusion samplers and bridges: Off-policy algorithms and applications in latent spaces5 Feb 2026
- 2025One-Step Diffusion Samplers via Self-Distillation and Deterministic Flow4 Dec 2025
- 2025Value Gradient Guidance for Flow Matching Alignment4 Dec 2025
- 2025Diffusion-Augmented Markov Decision Processes for Maximum Entropy Reinforcement Learning1 Dec 2025
- 2025Relative Trajectory Balance is equivalent to Trust-PCL1 Sep 2025
- 2025Concept-TRAK: Understanding how diffusion models learn concepts through concept-level attribution9 Jul 2025
- 2025Nabla-R2D3: Effective and Efficient 3D Diffusion Alignment with 2D Rewards18 Jun 2025
- 2025Adaptive Destruction Processes for Diffusion Samplers2 Jun 2025
12 newest of 35 All 35 (JSON)
- 2025FlowRL: Matching Reward Distributions for LLM Reasoningcited by 38
- 2025Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Trainingcited by 27
- 2024Machine learning and information theory concepts towards an AI Mathematiciancited by 20
- 2024On the Hardness of Probabilistic Neurosymbolic Learningcited by 9
- 2024GFlowNet Fine-tuning for Diverse Correct Solutions in Mathematical Reasoning Taskscited by 7
- 2026Toward Cognitive Supersensing in Multimodal Large Language Modelcited by 4
- 2026LAD: Learning Advantage Distribution for Reasoningcited by 2
- 2026GFlowRL: Scaling Distribution-Matching RL to Large Language Modelscited by 1
- 2025Do GFlowNets Transfer? Case Study on the Game of 24/42cited by 0
- 2025Learning to Reason in LLMs by Expectation Maximizationcited by 0
- 2026Beyond Normalization: Rethinking the Partition Function as a Difficulty Scheduler for RLVRcited by 0
- 2026FlowBalance: Verifier-Grounded Self-Improvement from On-Policy Reasoning Experiencecited by 0
- 2026FlowBalance: Verifier-Grounded Self-Improvement from On-Policy Reasoning Experience3 Sep 2026
- 2026GFlowRL: Scaling Distribution-Matching RL to Large Language Models15 Jul 2026
- 2026LAD: Learning Advantage Distribution for Reasoning23 Feb 2026
- 2026Beyond Normalization: Rethinking the Partition Function as a Difficulty Scheduler for RLVR13 Feb 2026
- 2026Toward Cognitive Supersensing in Multimodal Large Language Model2 Feb 2026
- 2025Learning to Reason in LLMs by Expectation Maximization23 Dec 2025
- 2025FlowRL: Matching Reward Distributions for LLM Reasoning18 Sep 2025
- 2025Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Training24 Mar 2025
- 2025Do GFlowNets Transfer? Case Study on the Game of 24/423 Mar 2025
- 2024GFlowNet Fine-tuning for Diverse Correct Solutions in Mathematical Reasoning Tasks26 Oct 2024
- 2024On the Hardness of Probabilistic Neurosymbolic Learning6 Jun 2024
- 2024Machine learning and information theory concepts towards an AI Mathematician7 Mar 2024
- 2025EraseFlow: Learning Concept Erasure Policies via GFlowNet-Driven Alignmentcited by 8
- 2024Investigating Regularization of Self-Play Language Modelscited by 7
- 2025GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networkscited by 3
- 2023Diverse Policy Optimization for Structured Action Spacecited by 1
- 2026FestDPO: Few-step Generator Alignment with Direct Preference Optimizationcited by 0
- 2026FestDPO: Few-step Generator Alignment with Direct Preference Optimization28 Sep 2026
- 2025EraseFlow: Learning Concept Erasure Policies via GFlowNet-Driven Alignment2 Nov 2025
- 2025GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networks19 Jun 2025
- 2024Investigating Regularization of Self-Play Language Models4 Apr 2024
- 2023Diverse Policy Optimization for Structured Action Space23 Feb 2023
- 2026SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestrationcited by 6
- 2026Position: agentic AI orchestration should be Bayes-consistentcited by 3
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolutioncited by 0
- 2026CollabFlow: Recursive Self-Improvement of Agent Collaborationcited by 0
- 2026CollabFlow: Recursive Self-Improvement of Agent Collaboration29 Sep 2026
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolution27 Sep 2026
- 2026SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestration13 May 2026
- 2026Position: agentic AI orchestration should be Bayes-consistent1 May 2026
- 2022Ray Based Distributed Autonomous Vehicle Research Platform18 Jan 2022
- 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 244
- 2022Bayesian Structure Learning with Generative Flow Networkscited by 153
- 2022Learning GFlowNets from partial episodes for improved convergence and stabilitycited by 129
- 2022Generative Flow Networks for Discrete Probabilistic Modelingcited by 113
- 2022GFlowNets and variational inferencecited by 103
- 2023A theory of continuous generative flow networkscited by 98
- 2023Amortizing intractable inference in large language modelscited by 94
- 2023Better Training of GFlowNets with Local Credit and Incomplete Trajectoriescited by 83
- 2023Towards Understanding and Improving GFlowNet Trainingcited by 74
- 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
- 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
- 2023GFlowNets for AI-Driven Scientific Discoverycited by 63
12 most cited of 222 All 222 (JSON)
- 2026Iterative Exact Discrete Guidance for Energy-Based Sampling29 Sep 2026
- 2026One Proposal for Every Margin: Zero-Shot Amortized Sequential Importance Sampling for Binary Matrices28 Sep 2026
- 2026SPIBER: Reconstructing Free Energy Landscapes from Short, Unconverged Trajectories with Generative Flow Networks19 Sep 2026
- 2026Particle GFlowNets: Rethinking Generative Marginalization Models10 Sep 2026
- 2026MAIL: Memory-driven, Adaptive, Incremental, and Literature-grounded Framework for Hypothesis Generation in Chemistry28 Aug 2026
- 2026Generative Learning for Quantum Measurement Design11 Aug 2026
- 2026Path-dependent Discrete Amortized Inference9 Aug 2026
- 2026Information-Geometric Forward Policy Training in GFlowNets4 Aug 2026
- 2026Inoculation Adapters: Improved Selective Generalization of Capabilities with Fewer Surprising Backdoors29 Jun 2026
- 2026FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction23 Jun 2026
- 2026Stop the Sampler! Classifier-Based Adaptive Stopping for Sampling Kernels15 Jun 2026
- 2026Proximal Policy Optimization for Amortized Discrete Sampling14 Jun 2026
12 newest of 222 All 222 (JSON)