mlsanityData to 7 Oct 2026

Context-Guided Diffusion for Out-of-Distribution Molecular and Protein Design

arXiv 2407.11942 ↗First posted 16 Jul 2024q-bio.BM cs.LG stat.MLcited by 11

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Generative models have the potential to accelerate key steps in the discovery of novel molecular therapeutics and materials. Diffusion models have recently emerged as a powerful approach, excelling at unconditional sample generation and, with data-driven guidance, conditional generation within their training domain. Reliably sampling from high-value regions beyond the training data, however, remains an open challenge -- with current methods predominantly focusing on modifying the diffusion process itself. In this paper, we develop context-guided diffusion (CGD), a simple plug-and-play method that leverages unlabeled data and smoothness constraints to improve the out-of-distribution generalization of guided diffusion models. We demonstrate that this approach leads to substantial performance gains across various settings, including continuous, discrete, and graph-structured diffusion processes with applications across drug discovery, materials science, and protein design.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 58 of its 105 references that are in the map. First posted on arXiv 16 Jul 2024.

Builds on

58 of 105 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024DecompDiff: Diffusion Models with Decomposed Priors for Structure-Based Drug Design26 Feb
  2. 2023Protein Design with Guided Discrete Diffusion31 May
  3. 2023Geometric Latent Diffusion Models for 3D Molecule Generation2 May
  4. 2022Equivariant Diffusion for Molecule Generation in 3D31 Mar
  5. 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equations5 Feb

Other references · 53

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  11. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  12. 2022Classifier-Free Diffusion Guidancecited by 5,717
38 more
  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  2. 2013Intriguing properties of neural networkscited by 5,114
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  4. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  7. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  8. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  9. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  10. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  11. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
  12. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  13. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
  14. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
  15. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  16. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
  17. 2021E(n) Equivariant Graph Neural Networkscited by 951
  18. 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
  19. 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
  20. 2019Contrastive Adaptation Network for Unsupervised Domain Adaptationcited by 407
  21. 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
  22. 2022DiffDock: Diffusion Steps, Twists, and Turns for Molecular Dockingcited by 307
  23. 2022Torsional Diffusion for Molecular Conformer Generationcited by 262
  24. 2022Riemannian Score-Based Generative Modellingcited by 216
  25. 2015Simultaneous Deep Transfer Across Domains and Taskscited by 205
  26. 2023Generalization in diffusion models arises from geometry-adaptive harmonic representationscited by 179
  27. 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
  28. 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
  29. 2022Riemannian Diffusion Modelscited by 120
  30. 2022Plex: Towards Reliability using Pretrained Large Model Extensionscited by 102
  31. 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
  32. 2023Reflected Diffusion Modelscited by 81
  33. 2021Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristicscited by 67
  34. 2023MolDiff: Addressing the Atom-Bond Inconsistency Problem in 3D Molecule Diffusion Generationcited by 65
  35. 2023Diffusion Models for Constrained Domainscited by 60
  36. 2022Benchmarking Bayesian Deep Learning on Diabetic Retinopathy Detection Taskscited by 49
  37. 2023Tractable Function-Space Variational Inference in Bayesian Neural Networkscited by 41
  38. 2023Metropolis Sampling for Constrained Diffusion Modelscited by 28

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 5; 2026: 2.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Diffusion Models for Molecules: A Survey of Methods and Tasks
  2. 2024Diffusion Models in textitDe Novo Drug Design
  3. 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material
  4. 2025Neuro-Symbolic Generative Diffusion Models for Physically Grounded, Robust, and Safe Generation
  5. 2025Composable Score-based Graph Diffusion Model for Multi-Conditional Molecular Generation
  6. 2025Graph Diffusion Transformers are In-Context Molecular Designers
  7. 2023Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generation
  8. 2024Training-Free Guidance for Discrete Diffusion Models for Molecular Generation