mlsanityData to 7 Oct 2026

Geometric Representation Condition Improves Equivariant Molecule Generation

arXiv 2410.03655 ↗First posted 4 Oct 2024cs.LG cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

Recent advances in molecular generative models have demonstrated great promise for accelerating scientific discovery, particularly in drug design. However, these models often struggle to generate high-quality molecules, especially in conditional scenarios where specific molecular properties must be satisfied. In this work, we introduce GeoRCG, a general framework to improve molecular generative models by integrating geometric representation conditions with provable theoretical guarantees. We decompose the generation process into two stages: first, generating an informative geometric representation; second, generating a molecule conditioned on the representation. Compared with single-stage generation, the easy-to-generate representation in the first stage guides the second stage generation toward a high-quality molecule in a goal-oriented way. Leveraging EDM and SemlaFlow as base generators, we observe significant quality improvements in unconditional molecule generation on the widely used QM9 and GEOM-DRUG datasets. More notably, in the challenging conditional molecular generation task, our framework achieves an average 50% performance improvement over state-of-the-art approaches, highlighting the superiority of conditioning on semantically rich geometric representations. Furthermore, with such representation guidance, the number of diffusion steps can be reduced to as small as 100 while largely preserving the generation quality achieved with 1,000 steps, thereby significantly reducing the generation iterations needed. Code is available at https://github.com/GraphPKU/GeoRCG.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 52 of its 72 references that are in the map. First posted on arXiv 4 Oct 2024.

Builds on

52 of 72 references.

References · 52

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2022Flow Matching for Generative Modelingcited by 5,426
  11. 2017Neural Discrete Representation Learningcited by 4,650
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
38 more
  1. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  2. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  3. 2021E(n) Equivariant Graph Neural Networkscited by 951
  4. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  5. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
  6. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
  7. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
  8. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 440
  9. 2019Cormorant: Covariant Molecular Neural Networkscited by 262
  10. 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 238
  11. 2022Convergence of denoising diffusion models under the manifold hypothesiscited by 237
  12. 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
  13. 2019Diagnosing and Enhancing VAE Modelscited by 192
  14. 2023Geometric Latent Diffusion Models for 3D Molecule Generationcited by 185
  15. 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 179
  16. 2019Symmetry-adapted generation of 3d point sets for the targeted discovery of moleculescited by 171
  17. 2021E(n) Equivariant Normalizing Flowscited by 165
  18. 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
  19. 2022Diffusion-based Molecule Generation with Informative Prior Bridgescited by 104
  20. 2023Guided Flows for Generative Modeling and Decision Makingcited by 99
  21. 2023MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generationcited by 96
  22. 2021Inverse design of 3d molecular structures with conditional generative neural networkscited by 93
  23. 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
  24. 2020A Contrastive Learning Approach for Training Variational Autoencoder Priorscited by 65
  25. 2023Equivariant Flow Matching with Hybrid Probability Transportcited by 59
  26. 2023Graph Generation with Diffusion Mixturecited by 52
  27. 2023Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generationcited by 50
  28. 2023Reward-Directed Conditional Diffusion: Provable Distribution Estimation and Reward Improvementcited by 49
  29. 2022Energy-Motivated Equivariant Pretraining for 3D Molecular Graphscited by 37
  30. 2021Top-N: Equivariant set and graph generation without exchangeabilitycited by 36
  31. 2022Fast Graph Generation via Spectral Diffusioncited by 36
  32. 2023Geometry-Complete Diffusion for 3D Molecule Generation and Optimizationcited by 36
  33. 2023Fractional Denoising for 3D Molecular Pre-trainingcited by 33
  34. 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusioncited by 24
  35. 2023Is Distance Matrix Enough for Geometric Deep Learning?cited by 22
  36. 2024Unified Generative Modeling of 3D Molecules via Bayesian Flow Networkscited by 18
  37. 2024Pre-training with Fractional Denoising to Enhance Molecular Property Predictioncited by 14
  38. 2024On the Completeness of Invariant Geometric Deep Learning Modelscited by 11

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 6.

13 papers.

Sort:

By area: