Multi-Objective GFlowNets
Not on the map. Why?
Abstract (arXiv)
We study the problem of generating diverse candidates in the context of Multi-Objective Optimization. In many applications of machine learning such as drug discovery and material design, the goal is to generate candidates which simultaneously optimize a set of potentially conflicting objectives. Moreover, these objectives are often imperfect evaluations of some underlying property of interest, making it important to generate diverse candidates to have multiple options for expensive downstream evaluations. We propose Multi-Objective GFlowNets (MOGFNs), a novel method for generating diverse Pareto optimal solutions, based on GFlowNets. We introduce two variants of MOGFNs: MOGFN-PC, which models a family of independent sub-problems defined by a scalarization function, with reward-conditional GFlowNets, and MOGFN-AL, which solves a sequence of sub-problems defined by an acquisition function in an active learning loop. Our experiments on wide variety of synthetic and benchmark tasks demonstrate advantages of the proposed methods in terms of the Pareto performance and importantly, improved candidate diversity, which is the main contribution of this work.
Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). Builds on 33 of its 80 references that are in the map. First posted on arXiv 23 Oct 2022.
Builds on
33 of 80 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2017Reinforcement Learning with Deep Energy-Based Policiescited by 659
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
- 2019Graph Transformer Networkscited by 520
- 2021Flow Network based Generative Models for Non-Iterative Diverse Candidate Generationcited by 384
- 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 244
- 2021A Practical Guide to Multi-Objective Reinforcement Learning and Planningcited by 240
- 2014A Survey of Multi-Objective Sequential Decision-Makingcited by 229
- 2020pymoo: Multi-objective Optimization in Pythoncited by 196
- 2020Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimizationcited by 176
21 more
- 2022Biological Sequence Design with GFlowNetscited by 172
- 2019A Generalized Algorithm for Multi-Objective Reinforcement Learning and Policy Adaptationcited by 166
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2021Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvementcited by 115
- 2013Generalized Denoising Auto-Encoders as Generative Modelscited by 113
- 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
- 2018A Flexible Framework for Multi-Objective Bayesian Optimization using Random Scalarizationscited by 98
- 2021Multi-Objective Bayesian Optimization over High-Dimensional Search Spacescited by 87
- 2020Max-value Entropy Search for Multi-Objective Bayesian Optimization with Constraintscited by 81
- 2020Random Hypervolume Scalarizations for Provable Multi-Objective Black Box Optimizationcited by 60
- 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
- 2020A Distributional View on Multi-Objective Policy Optimizationcited by 51
- 2020Molecular Mechanics-Driven Graph Neural Network with Multiplex Graph for Molecular Structurescited by 44
- 2022Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomescited by 41
- 2021Bayesian Optimization with High-Dimensional Outputscited by 32
- 2022Discovering Many Diverse Solutions with Bayesian Optimizationcited by 29
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2022Pareto Conditioned Networkscited by 22
- 2019Multi-objective Bayesian optimisation with preferences over objectivescited by 16
- 2019Discrete Object Generation with Reversible Inductive Constructioncited by 16
- 2021Neuroevolution-Enhanced Multi-Objective Optimization for Mixed-Precision Quantizationcited by 6
Built on by
Citing papers per year: 2023: 20; 2024: 44; 2025: 24; 2026: 12.
100 papers.
Sort:
By area:
- 2023Protein Design with Guided Discrete Diffusioncited by 154
- 2023Better Training of GFlowNets with Local Credit and Incomplete Trajectoriescited by 83
- 2024Panacea: Pareto Alignment via Preference Adaptation for LLMscited by 78
- 2023GFlowNets for AI-Driven Scientific Discoverycited by 63
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2024Smooth Tchebycheff Scalarization for Multi-Objective Optimizationcited by 50
- 2023Sample-efficient Multi-objective Molecular Optimization with GFlowNetscited by 48
- 2023Local Search GFlowNetscited by 45
- 2023GFlowNet-EM for learning compositional latent variable modelscited by 40
- 2023Let the Flows Tell: Solving Graph Combinatorial Optimization Problems with GFlowNetscited by 40
- 2024Discrete Probabilistic Inference as Control in Multi-path Environmentscited by 40
- 2025FlowRL: Matching Reward Distributions for LLM Reasoningcited by 38
38 more
- 2023Stochastic Generative Flow Networkscited by 32
- 2023Thompson sampling for improved exploration in GFlowNetscited by 31
- 2023Maximum entropy GFlowNets with soft Q-learningcited by 30
- 2023Distributional GFlowNets with Quantile Flowscited by 28
- 2024Improving GFlowNets for Text-to-Image Diffusion Alignmentcited by 27
- 2023Compositional Sculpting of Iterative Generative Processescited by 26
- 2023Learning to Scale Logits for Temperature-Conditional GFlowNetscited by 26
- 2024SynFlowNet: Design of Diverse and Novel Molecules with Synthesis Constraintscited by 26
- 2024MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximationcited by 20
- 2024Generative Flows on Synthetic Pathway for Drug Designcited by 20
- 2024QGFN: Controllable Greediness with Action Valuescited by 18
- 2025Pareto Set Learning for Multi-Objective Reinforcement Learningcited by 18
- 2023Goal-conditioned GFlowNets for Controllable Multi-Objective Molecular Designcited by 17
- 2024ParetoFlow: Guided Flows in Multi-Objective Optimizationcited by 17
- 2025DiverseFlow: Sample-Efficient Diverse Mode Coverage in Flowscited by 17
- 2023Pre-Training and Fine-Tuning Generative Flow Networkscited by 16
- 2023Multi-Fidelity Active Learning with GFlowNetscited by 15
- 2024Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimizationcited by 15
- 2024PROUD: PaRetO-gUided Diffusion Model for Multi-objective Generationcited by 15
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyondcited by 15
- 2024Offline Multi-Objective Optimizationcited by 14
- 2025Generative Models in Decision Making: A Surveycited by 14
- 2025Offline Model-Based Optimization: Comprehensive Reviewcited by 14
- 2023Order-Preserving GFlowNetscited by 13
- 2024Pessimistic Backward Policy for GFlowNetscited by 13
- 2024Pareto Front-Diverse Batch Multi-Objective Bayesian Optimizationcited by 13
- 2024Improved Off-policy Reinforcement Learning in Biological Sequence Designcited by 13
- 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusioncited by 13
- 2024Optimizing Backward Policies in GFlowNets via Trajectory Likelihood Maximizationcited by 12
- 2024RetroGFN: Diverse and Feasible Retrosynthesis using GFlowNetscited by 10
- 2024Beyond Squared Error: Exploring Loss Design for Enhanced Training of Generative Flow Networkscited by 9
- 2023Molecule Design by Latent Prompt Transformercited by 8
- 2024Baking Symmetry into GFlowNetscited by 7
- 2024ARCLE: The Abstraction and Reasoning Corpus Learning Environment for Reinforcement Learningcited by 7
- 2024GFlowNet Fine-tuning for Diverse Correct Solutions in Mathematical Reasoning Taskscited by 7
- 2024Investigating Generalization Behaviours of Generative Flow Networkscited by 6
- 2024MetaGFN: Exploring Distant Modes with Adapted Metadynamics for Continuous GFlowNetscited by 6
- 2024Multi-objective Deep Learning: Taxonomy and Survey of the State of the Artcited by 6
50 most cited of 100 All 100 (JSON)
- 2026pCoMole: Pareto-Constrained Molecule Editing with Discrete Flows1 Oct 2026
- 2026One Sequence, Many Decodings: CAGenMol-2 Recasts Drug Design as Masked Molecular Inference28 Sep 2026
- 2026Particle GFlowNets: Rethinking Generative Marginalization Models10 Sep 2026
- 2026Generative Learning for Quantum Measurement Design11 Aug 2026
- 2026Pepti-drift: Scalable Safe-Active Peptide Generation Without Inference-Time Guidance26 Jun 2026
- 2026Proximal Policy Optimization for Amortized Discrete Sampling14 Jun 2026
- 2026Generative Flow Networks for Model Adaptation in Digital Twins of Natural Systems22 Apr 2026
- 2026Rooted Absorbed Prefix Trajectory Balance with Submodular Replay for GFlowNet Training28 Feb 2026
- 2026Routing by Reaching: Composition of Pre-trained GFlowNets for Multi-Objective Generation25 Feb 2026
- 2026Synthesizable Molecular Generation via Soft-constrained GFlowNets with Rich Chemical Priors4 Feb 2026
- 2026Pareto-Conditioned Diffusion Models for Offline Multi-Objective Optimization31 Jan 2026
- 2026M^4olGen: Multi-Agent, Multi-Stage Molecular Generation under Precise Multi-Property Constraints15 Jan 2026
38 more
- 2025gfnx: Fast and Scalable Library for Generative Flow Networks in JAX20 Nov 2025
- 2025Iterative Foundation Model Fine-Tuning on Multiple Rewards31 Oct 2025
- 2025Amortized Active Generation of Pareto Sets23 Oct 2025
- 2025Curriculum-Augmented GFlowNets For mRNA Sequence Generation4 Oct 2025
- 2025AReUReDi: Annealed Rectified Updates for Refining Discrete Flows with Multi-Objective Guidance30 Sep 2025
- 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusion29 Sep 2025
- 2025Discovery of Sustainable Refrigerants through Physics-Informed RL Fine-Tuning of Sequence Models23 Sep 2025
- 2025FlowRL: Matching Reward Distributions for LLM Reasoning18 Sep 2025
- 2025Property-Isometric Variational Autoencoders for Sequence Modeling and Design16 Sep 2025
- 2025Multi-Armed Sampling Problem and the End of Exploration14 Jul 2025
- 2025Improved Exploration in GFlownets via Enhanced Epistemic Neural Networks19 Jun 2025
- 2025Scalable and Cost-Efficient de Novo Template-Based Molecular Generation10 Jun 2025
- 2025Symmetry-Aware GFlowNets3 Jun 2025
- 2025Beyond the Proxy: Trajectory-Distilled Guidance for Offline GFlowNet Training26 May 2025
- 2025Compositional Flows for 3D Molecule and Synthesis Pathway Co-design10 Apr 2025
- 2025DiverseFlow: Sample-Efficient Diverse Mode Coverage in Flows10 Apr 2025
- 2025Global-Order GFlowNets3 Apr 2025
- 2025Offline Model-Based Optimization: Comprehensive Review21 Mar 2025
- 2025Pretraining Generative Flow Networks with Inexpensive Rewards for Molecular Graph Generation8 Mar 2025
- 2025InversionGNN: A Dual Path Network for Multi-Property Molecular Optimization3 Mar 2025
- 2025Generative Models in Decision Making: A Survey24 Feb 2025
- 2025Mol-MoE: Training Preference-Guided Routers for Molecule Generation8 Feb 2025
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyond19 Jan 2025
- 2025Pareto Set Learning for Multi-Objective Reinforcement Learning12 Jan 2025
- 2024Effective Reward Specification in Deep Reinforcement Learning10 Dec 2024
- 2024ParetoFlow: Guided Flows in Multi-Objective Optimization4 Dec 2024
- 2024Multi-objective Deep Learning: Taxonomy and Survey of the State of the Art2 Dec 2024
- 2024Streaming Bayes GFlowNets8 Nov 2024
- 2024GFlowNet Fine-tuning for Diverse Correct Solutions in Mathematical Reasoning Tasks26 Oct 2024
- 2024Federated Communication-Efficient Multi-Objective Optimization21 Oct 2024
- 2024Optimizing Backward Policies in GFlowNets via Trajectory Likelihood Maximization20 Oct 2024
- 2024Generative Flows on Synthetic Pathway for Drug Design6 Oct 2024
- 2024Improved Off-policy Reinforcement Learning in Biological Sequence Design6 Oct 2024
- 2024Beyond Squared Error: Exploring Loss Design for Enhanced Training of Generative Flow Networks3 Oct 2024
- 2024Enhancing Solution Efficiency in Reinforcement Learning: Leveraging Sub-GFlowNet and Entropy Integration1 Oct 2024
- 2024GFlowNet Pretraining with Inexpensive Rewards15 Sep 2024
- 2024MetaGFN: Exploring Distant Modes with Adapted Metadynamics for Continuous GFlowNets28 Aug 2024
- 2024Preference-Optimized Pareto Set Learning for Blackbox Optimization19 Aug 2024
50 newest of 100 All 100 (JSON)
- 2023Protein Design with Guided Discrete Diffusioncited by 154
- 2024Improving GFlowNets for Text-to-Image Diffusion Alignmentcited by 27
- 2023Compositional Sculpting of Iterative Generative Processescited by 26
- 2024PROUD: PaRetO-gUided Diffusion Model for Multi-objective Generationcited by 15
- 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusioncited by 13
- 2025Compositional Flows for 3D Molecule and Synthesis Pathway Co-designcited by 6
- 2026Pareto-Conditioned Diffusion Models for Offline Multi-Objective Optimizationcited by 2
- 2026Pareto-Conditioned Diffusion Models for Offline Multi-Objective Optimization31 Jan 2026
- 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusion29 Sep 2025
- 2025Compositional Flows for 3D Molecule and Synthesis Pathway Co-design10 Apr 2025
- 2024PROUD: PaRetO-gUided Diffusion Model for Multi-objective Generation5 Jul 2024
- 2024Improving GFlowNets for Text-to-Image Diffusion Alignment2 Jun 2024
- 2023Compositional Sculpting of Iterative Generative Processes28 Sep 2023
- 2023Protein Design with Guided Discrete Diffusion31 May 2023
- 2024Panacea: Pareto Alignment via Preference Adaptation for LLMscited by 78
- 2023Better Training of GFlowNets with Local Credit and Incomplete Trajectoriescited by 83
- 2023GFlowNets for AI-Driven Scientific Discoverycited by 63
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2024Smooth Tchebycheff Scalarization for Multi-Objective Optimizationcited by 50
- 2023Sample-efficient Multi-objective Molecular Optimization with GFlowNetscited by 48
- 2023Local Search GFlowNetscited by 45
- 2023GFlowNet-EM for learning compositional latent variable modelscited by 40
- 2023Let the Flows Tell: Solving Graph Combinatorial Optimization Problems with GFlowNetscited by 40
- 2024Discrete Probabilistic Inference as Control in Multi-path Environmentscited by 40
- 2023Stochastic Generative Flow Networkscited by 32
- 2023Thompson sampling for improved exploration in GFlowNetscited by 31
- 2023Maximum entropy GFlowNets with soft Q-learningcited by 30
12 most cited of 88 All 88 (JSON)
- 2026pCoMole: Pareto-Constrained Molecule Editing with Discrete Flows1 Oct 2026
- 2026One Sequence, Many Decodings: CAGenMol-2 Recasts Drug Design as Masked Molecular Inference28 Sep 2026
- 2026Particle GFlowNets: Rethinking Generative Marginalization Models10 Sep 2026
- 2026Generative Learning for Quantum Measurement Design11 Aug 2026
- 2026Pepti-drift: Scalable Safe-Active Peptide Generation Without Inference-Time Guidance26 Jun 2026
- 2026Proximal Policy Optimization for Amortized Discrete Sampling14 Jun 2026
- 2026Generative Flow Networks for Model Adaptation in Digital Twins of Natural Systems22 Apr 2026
- 2026Rooted Absorbed Prefix Trajectory Balance with Submodular Replay for GFlowNet Training28 Feb 2026
- 2026Routing by Reaching: Composition of Pre-trained GFlowNets for Multi-Objective Generation25 Feb 2026
- 2026Synthesizable Molecular Generation via Soft-constrained GFlowNets with Rich Chemical Priors4 Feb 2026
- 2025gfnx: Fast and Scalable Library for Generative Flow Networks in JAX20 Nov 2025
- 2025Iterative Foundation Model Fine-Tuning on Multiple Rewards31 Oct 2025
12 newest of 88 All 88 (JSON)