mlsanityData to 14 Oct 2026

SubGDiff: A Subgraph Diffusion Model to Improve Molecular Representation Learning

arXiv 2405.05665 ↗First posted 9 May 2024cs.LG q-bio.QMcited by 4

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Molecular representation learning has shown great success in advancing AI-based drug discovery. The core of many recent works is based on the fact that the 3D geometric structure of molecules provides essential information about their physical and chemical characteristics. Recently, denoising diffusion probabilistic models have achieved impressive performance in 3D molecular representation learning. However, most existing molecular diffusion models treat each atom as an independent entity, overlooking the dependency among atoms within the molecular substructures. This paper introduces a novel approach that enhances molecular representation learning by incorporating substructural information within the diffusion process. We propose a novel diffusion model termed SubGDiff for involving the molecular subgraph information in diffusion. Specifically, SubGDiff adopts three vital techniques: i) subgraph prediction, ii) expectation state, and iii) k-step same subgraph diffusion, to enhance the perception of molecular substructure in the denoising network. Experimentally, extensive downstream tasks demonstrate the superior performance of our approach. The code is available at https://github.com/youjibiying/SubGDiff.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 46 of its 61 references that are in the map. First posted on arXiv 9 May 2024.

Builds on

46 of 61 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024ControlMol: Adding Substructure Control To Molecule Diffusion Models22 Apr
  2. 2023Equivariant Flow Matching with Hybrid Probability Transport12 Dec
  3. 2023Autoregressive Diffusion Model for Graph Generation17 Jul
  4. 2023DiffPack: A Torsional Diffusion Model for Autoregressive Protein Side-Chain Packing1 Jun
  5. 2022Diffusion Models for Graphs Benefit From Discrete State Spaces4 Oct
  6. 2022Equivariant Diffusion for Molecule Generation in 3D31 Mar
  7. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation6 Mar
  8. 2020Permutation Invariant Graph Generation via Score-Based Generative Modeling2 Mar

Other references · 38

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2018How Powerful are Graph Neural Networks?cited by 4,393
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  8. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  9. 2019Strategies for Pre-training Graph Neural Networkscited by 971
  10. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
  11. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  12. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
26 more
  1. 2022Torsional Diffusion for Molecular Conformer Generationcited by 263
  2. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  3. 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 243
  4. 2020Hierarchical Generation of Molecular Graphs using Structural Motifscited by 208
  5. 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
  6. 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
  7. 2021Learning Gradient Fields for Molecular Conformation Generationcited by 163
  8. 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
  9. 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
  10. 2021GeoMol: Torsional Geometric Generation of Molecular 3D Conformer Ensemblescited by 107
  11. 2018N-Gram Graph: Simple Unsupervised Representation for Graphs, with Applications to Moleculescited by 93
  12. 2019Molecular geometry prediction using a deep generative graph neural networkcited by 91
  13. 2021Learning Neural Generative Dynamics for Molecular Conformation Generationcited by 88
  14. 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
  15. 2019A Generative Model for Molecular Distance Geometrycited by 73
  16. 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 68
  17. 2021An End-to-End Framework for Molecular Conformation Generation via Bilevel Programmingcited by 59
  18. 2022Improving Molecular Contrastive Learning via Faulty Negative Mitigation and Decomposed Fragment Contrastcited by 37
  19. 2023A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretrainingcited by 32
  20. 2021Molecule3D: A Benchmark for Predicting 3D Geometries from Molecular Graphscited by 31
  21. 2023Functional-Group-Based Diffusion for Pocket-Specific Molecule Generation and Elaborationcited by 30
  22. 2022Molecular Representation Learning via Heterogeneous Motif Graph Neural Networkscited by 23
  23. 2024MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehensioncited by 22
  24. 2022Fine-Tuning Graph Neural Networks via Graph Topology induced Optimal Transportcited by 19
  25. 2022Hypergraph Convolutional Networks via Equivalency between Hypergraphs and Undirected Graphscited by 16
  26. 2023Masked Diffusion as Self-supervised Representation Learnercited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Geometric-Facilitated Denoising Diffusion Model for 3D Molecule Generation
  2. 2023Geometry-Complete Diffusion for 3D Molecule Generation and Optimization
  3. 2024Diffusion Models in textitDe Novo Drug Design
  4. 2024Instruction-Based Molecular Graph Generation with Unified Text-Graph Diffusion Model
  5. 2025Graph Diffusion Transformers are In-Context Molecular Designers
  6. 2023Conditional Diffusion Based on Discrete Graph Structures for Molecular Graph Generation
  7. 2024Graph Diffusion Transformers for Multi-Conditional Molecular Generation
  8. 20233D Denoisers are Good 2D Teachers: Molecular Pretraining via Denoising and Cross-Modal Distillation