mlsanityData to 7 Oct 2026

Pareto-Conditioned Diffusion Models for Offline Multi-Objective Optimization

arXiv 2602.00737 ↗First posted 31 Jan 2026cs.LG cs.AIcited by 2

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Multi-objective optimization (MOO) arises in many real-world applications where trade-offs between competing objectives must be carefully balanced. In the offline setting, where only a static dataset is available, the main challenge is generalizing beyond observed data. We introduce Pareto-Conditioned Diffusion (PCD), a novel framework that formulates offline MOO as a conditional sampling problem. By conditioning directly on desired trade-offs, PCD avoids the need for explicit surrogate models. To effectively explore the Pareto front, PCD employs a reweighting strategy that focuses on high-performing samples and a reference-direction mechanism to guide sampling towards novel, promising regions beyond the training data. Experiments on standard offline MOO benchmarks show that PCD achieves highly competitive performance and, importantly, demonstrates greater consistency across diverse tasks than existing offline MOO approaches.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 47 of its 62 references that are in the map. First posted on arXiv 31 Jan 2026.

Builds on

47 of 62 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025Preference-Guided Diffusion for Multi-Objective Offline Optimization21 Mar
  2. 2024Simple Guidance Mechanisms for Discrete Diffusion Models13 Dec
  3. 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimization3 Jun
  4. 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
  5. 2023Diffusion Models for Black-Box Optimization12 Jun
  6. 2023DiffusionNAG: Predictor-guided Neural Architecture Generation with Diffusion Models26 May
  7. 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimization16 Feb
  8. 2022Scalable Diffusion Models with Transformers19 Dec
  9. 2022Classifier-Free Diffusion Guidance26 Jul
  10. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  11. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  12. 2021Structured Denoising Diffusion Models in Discrete State-Spaces7 Jul
5 more
  1. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  2. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  4. 2020Denoising Diffusion Implicit Models6 Oct
  5. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 30

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  4. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  5. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  6. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  7. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  8. 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equationscited by 273
  9. 2020Permutation Invariant Graph Generation via Score-Based Generative Modelingcited by 263
  10. 2022Continuous diffusion for categorical datacited by 202
  11. 2020Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimizationcited by 176
  12. 2024Unlocking Guidance for Discrete State-Space Diffusion and Flow Modelscited by 124
18 more
  1. 2021Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvementcited by 115
  2. 2022Multi-Objective GFlowNetscited by 100
  3. 2023Synthetic Experience Replaycited by 100
  4. 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
  5. 2022Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimizationcited by 96
  6. 2021Conservative Objective Models for Effective Offline Model-Based Optimizationcited by 87
  7. 2022Learning to Learn with Generative Models of Neural Network Checkpointscited by 85
  8. 2019Model Inversion Networks for Model-Based Optimizationcited by 83
  9. 2020An Easy-to-use Real-world Multi-objective Optimization Problem Suitecited by 71
  10. 2023Reward-Directed Conditional Diffusion: Provable Distribution Estimation and Reward Improvementcited by 49
  11. 2021RoMA: Robust Model Adaptation for Offline Model-based Optimizationcited by 39
  12. 2020Population-Based Black-Box Optimization for Biological Sequence Designcited by 29
  13. 2023Importance-aware Co-teaching for Offline Model-based Optimizationcited by 28
  14. 2023Parallel-mentoring for Offline Model-based Optimizationcited by 26
  15. 2023Bootstrapped Training of Score-Conditioned Generator for Offline Design of Biological Sequencescited by 23
  16. 2024ParetoFlow: Guided Flows in Multi-Objective Optimizationcited by 17
  17. 2024Offline Multi-Objective Optimizationcited by 14
  18. 2025Offline Model-Based Optimization: Comprehensive Reviewcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ParetoPilot: Zero-Surrogate Offline Multi-Objective Optimization via Infer-Perturb-Guide Diffusion
  2. 2025SPREAD: Sampling-based Pareto front Refinement via Efficient Adaptive Diffusion
  3. 2026Learning Where to Steer: Noise-Space Geometry for Efficient Offline Multi-Objective Optimization with Generative Models
  4. 2026The Offline-Frontier Shift: Diagnosing Distributional Limits in Generative Multi-Objective Optimization
  5. 2026Multi-Objective Learning for Diffusion Models: A Statistical Theory under Semi-Supervised Learning
  6. 2024EmoDM: A Diffusion Model for Evolutionary Multi-objective Optimization
  7. 2024Robust Guided Diffusion for Offline Black-Box Optimization
  8. 2024Guided Trajectory Generation with Diffusion Models for Offline Model-based Optimization