Context-Guided Diffusion for Out-of-Distribution Molecular and Protein Design
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Generative models have the potential to accelerate key steps in the discovery of novel molecular therapeutics and materials. Diffusion models have recently emerged as a powerful approach, excelling at unconditional sample generation and, with data-driven guidance, conditional generation within their training domain. Reliably sampling from high-value regions beyond the training data, however, remains an open challenge -- with current methods predominantly focusing on modifying the diffusion process itself. In this paper, we develop context-guided diffusion (CGD), a simple plug-and-play method that leverages unlabeled data and smoothness constraints to improve the out-of-distribution generalization of guided diffusion models. We demonstrate that this approach leads to substantial performance gains across various settings, including continuous, discrete, and graph-structured diffusion processes with applications across drug discovery, materials science, and protein design.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 58 of its 105 references that are in the map. First posted on arXiv 16 Jul 2024.
Builds on
58 of 105 references.
Closest ancestors · 5
Same direction, newest first
- 2024DecompDiff: Diffusion Models with Decomposed Priors for Structure-Based Drug Design26 Feb
- 2023Protein Design with Guided Discrete Diffusion31 May
- 2023Geometric Latent Diffusion Models for 3D Molecule Generation2 May
- 2022Equivariant Diffusion for Molecule Generation in 3D31 Mar
- 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equations5 Feb
Other references · 53
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
38 more
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2013Intriguing properties of neural networkscited by 5,114
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
- 2019Contrastive Adaptation Network for Unsupervised Domain Adaptationcited by 407
- 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
- 2022DiffDock: Diffusion Steps, Twists, and Turns for Molecular Dockingcited by 307
- 2022Torsional Diffusion for Molecular Conformer Generationcited by 262
- 2022Riemannian Score-Based Generative Modellingcited by 216
- 2015Simultaneous Deep Transfer Across Domains and Taskscited by 205
- 2023Generalization in diffusion models arises from geometry-adaptive harmonic representationscited by 179
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
- 2022Riemannian Diffusion Modelscited by 120
- 2022Plex: Towards Reliability using Pretrained Large Model Extensionscited by 102
- 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
- 2023Reflected Diffusion Modelscited by 81
- 2021Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristicscited by 67
- 2023MolDiff: Addressing the Atom-Bond Inconsistency Problem in 3D Molecule Diffusion Generationcited by 65
- 2023Diffusion Models for Constrained Domainscited by 60
- 2022Benchmarking Bayesian Deep Learning on Diabetic Retinopathy Detection Taskscited by 49
- 2023Tractable Function-Space Variational Inference in Bayesian Neural Networkscited by 41
- 2023Metropolis Sampling for Constrained Diffusion Modelscited by 28
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 5; 2026: 2.
11 papers.
- 2025Steering Generative Models with Experimental Data for Protein Fitness Optimizationcited by 7
- 2024Chemistry-Inspired Diffusion with Non-Differentiable Guidancecited by 6
- 2026Verifier-Constrained Flow Expansion for Discovery Beyond the Datacited by 6
- 2024G2D2: Gradient-Guided Discrete Diffusion for Inverse Problem Solvingcited by 4
- 2024Diffusion Twigs with Loop Guidance for Conditional Graph Generationcited by 4
- 2025Amortized Active Generation of Pareto Setscited by 1
- 2024Sampling Out-of-Distribution Chemical Spaces via Bayesian Flowcited by 0
- 2025ReconMOST: Multi-Layer Sea Temperature Reconstruction with Observations-Guided Diffusioncited by 0
- 2025Demystify Protein Generation with Hierarchical Conditional Diffusion Modelscited by 0
- 2025Diffusion Models at the Drug Discovery Frontier: A Review on Generating Small Molecules versus Therapeutic Peptidescited by 0
- 2026From Snapshots to Symphonies: The Evolution of Protein Prediction from Static Structures to Generative Dynamics and Multimodal Interactionscited by 0
- 2026From Snapshots to Symphonies: The Evolution of Protein Prediction from Static Structures to Generative Dynamics and Multimodal Interactions19 Mar 2026
- 2026Verifier-Constrained Flow Expansion for Discovery Beyond the Data17 Feb 2026
- 2025Diffusion Models at the Drug Discovery Frontier: A Review on Generating Small Molecules versus Therapeutic Peptides31 Oct 2025
- 2025Amortized Active Generation of Pareto Sets23 Oct 2025
- 2025Demystify Protein Generation with Hierarchical Conditional Diffusion Models24 Jul 2025
- 2025ReconMOST: Multi-Layer Sea Temperature Reconstruction with Observations-Guided Diffusion12 Jun 2025
- 2025Steering Generative Models with Experimental Data for Protein Fitness Optimization21 May 2025
- 2024Sampling Out-of-Distribution Chemical Spaces via Bayesian Flow16 Dec 2024
- 2024Diffusion Twigs with Loop Guidance for Conditional Graph Generation31 Oct 2024
- 2024G2D2: Gradient-Guided Discrete Diffusion for Inverse Problem Solving9 Oct 2024
- 2024Chemistry-Inspired Diffusion with Non-Differentiable Guidance9 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2025Diffusion Models for Molecules: A Survey of Methods and Tasks
- 2024Diffusion Models in textitDe Novo Drug Design
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material
- 2025Neuro-Symbolic Generative Diffusion Models for Physically Grounded, Robust, and Safe Generation
- 2025Composable Score-based Graph Diffusion Model for Multi-Conditional Molecular Generation
- 2025Graph Diffusion Transformers are In-Context Molecular Designers
- 2023Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generation
- 2024Training-Free Guidance for Discrete Diffusion Models for Molecular Generation