Geometric Representation Condition Improves Equivariant Molecule Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in molecular generative models have demonstrated great promise for accelerating scientific discovery, particularly in drug design. However, these models often struggle to generate high-quality molecules, especially in conditional scenarios where specific molecular properties must be satisfied. In this work, we introduce GeoRCG, a general framework to improve molecular generative models by integrating geometric representation conditions with provable theoretical guarantees. We decompose the generation process into two stages: first, generating an informative geometric representation; second, generating a molecule conditioned on the representation. Compared with single-stage generation, the easy-to-generate representation in the first stage guides the second stage generation toward a high-quality molecule in a goal-oriented way. Leveraging EDM and SemlaFlow as base generators, we observe significant quality improvements in unconditional molecule generation on the widely used QM9 and GEOM-DRUG datasets. More notably, in the challenging conditional molecular generation task, our framework achieves an average 50% performance improvement over state-of-the-art approaches, highlighting the superiority of conditioning on semantically rich geometric representations. Furthermore, with such representation guidance, the number of diffusion steps can be reduced to as small as 100 while largely preserving the generation quality achieved with 1,000 steps, thereby significantly reducing the generation iterations needed. Code is available at https://github.com/GraphPKU/GeoRCG.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 52 of its 72 references that are in the map. First posted on arXiv 4 Oct 2024.
Builds on
52 of 72 references.
References · 52
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Neural Discrete Representation Learningcited by 4,650
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
38 more
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
- 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 440
- 2019Cormorant: Covariant Molecular Neural Networkscited by 262
- 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 238
- 2022Convergence of denoising diffusion models under the manifold hypothesiscited by 237
- 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
- 2019Diagnosing and Enhancing VAE Modelscited by 192
- 2023Geometric Latent Diffusion Models for 3D Molecule Generationcited by 185
- 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 179
- 2019Symmetry-adapted generation of 3d point sets for the targeted discovery of moleculescited by 171
- 2021E(n) Equivariant Normalizing Flowscited by 165
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2022Diffusion-based Molecule Generation with Informative Prior Bridgescited by 104
- 2023Guided Flows for Generative Modeling and Decision Makingcited by 99
- 2023MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generationcited by 96
- 2021Inverse design of 3d molecular structures with conditional generative neural networkscited by 93
- 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
- 2020A Contrastive Learning Approach for Training Variational Autoencoder Priorscited by 65
- 2023Equivariant Flow Matching with Hybrid Probability Transportcited by 59
- 2023Graph Generation with Diffusion Mixturecited by 52
- 2023Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generationcited by 50
- 2023Reward-Directed Conditional Diffusion: Provable Distribution Estimation and Reward Improvementcited by 49
- 2022Energy-Motivated Equivariant Pretraining for 3D Molecular Graphscited by 37
- 2021Top-N: Equivariant set and graph generation without exchangeabilitycited by 36
- 2022Fast Graph Generation via Spectral Diffusioncited by 36
- 2023Geometry-Complete Diffusion for 3D Molecule Generation and Optimizationcited by 36
- 2023Fractional Denoising for 3D Molecular Pre-trainingcited by 33
- 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusioncited by 24
- 2023Is Distance Matrix Enough for Geometric Deep Learning?cited by 22
- 2024Unified Generative Modeling of 3D Molecules via Bayesian Flow Networkscited by 18
- 2024Pre-training with Fractional Denoising to Enhance Molecular Property Predictioncited by 14
- 2024On the Completeness of Invariant Geometric Deep Learning Modelscited by 11
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 7; 2026: 6.
13 papers.
Sort:
By area:
- 2025Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasonercited by 28
- 2025Flow Matching Meets Biology and Life Science: A Surveycited by 14
- 2025Learning Diffusion Models with Flexible Representation Guidancecited by 12
- 2025Straight-Line Diffusion Model for Efficient 3D Molecular Generationcited by 8
- 2025Scalable Autoregressive 3D Molecule Generationcited by 7
- 2026Rethinking Diffusion Models with Symmetries through Canonicalization with Applications to Molecular Graph Generationcited by 5
- 2025Universally Invariant Learning in Equivariant GNNscited by 3
- 2026Self-Conditioned Denoising for Atomistic Representation Learningcited by 3
- 2025Geometric Mixture Models for Electrolyte Conductivity Predictioncited by 2
- 2026FlashMol: High-Quality Molecule Generation in as Few as Four Stepscited by 1
- 2026Toward Better Geometric Representations for Molecule Generative Modelscited by 1
- 2026Representations from Pretrained Machine-Learning Interatomic Potentials as Coarse Coordinates for Material Generation and Evaluationcited by 0
- 2026SurfSpec: Enhancing Off-Target-Agnostic Specificity by Bounding Pocket-Ligand Geometric Mismatch2 Sep 2026
- 2026Representations from Pretrained Machine-Learning Interatomic Potentials as Coarse Coordinates for Material Generation and Evaluation30 Jul 2026
- 2026Toward Better Geometric Representations for Molecule Generative Models8 May 2026
- 2026FlashMol: High-Quality Molecule Generation in as Few as Four Steps7 May 2026
- 2026Self-Conditioned Denoising for Atomistic Representation Learning17 Mar 2026
- 2026Rethinking Diffusion Models with Symmetries through Canonicalization with Applications to Molecular Graph Generation16 Feb 2026
- 2025Geometric Mixture Models for Electrolyte Conductivity Prediction17 Oct 2025
- 2025Universally Invariant Learning in Equivariant GNNs15 Oct 2025
- 2025Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasoner3 Oct 2025
- 2025Flow Matching Meets Biology and Life Science: A Survey23 Jul 2025
- 2025Learning Diffusion Models with Flexible Representation Guidance11 Jul 2025
- 2025Scalable Autoregressive 3D Molecule Generation20 May 2025
1 more
- 2025Flow Matching Meets Biology and Life Science: A Surveycited by 14
- 2025Learning Diffusion Models with Flexible Representation Guidancecited by 12
- 2025Straight-Line Diffusion Model for Efficient 3D Molecular Generationcited by 8
- 2025Scalable Autoregressive 3D Molecule Generationcited by 7
- 2026Rethinking Diffusion Models with Symmetries through Canonicalization with Applications to Molecular Graph Generationcited by 5
- 2026Rethinking Diffusion Models with Symmetries through Canonicalization with Applications to Molecular Graph Generation16 Feb 2026
- 2025Flow Matching Meets Biology and Life Science: A Survey23 Jul 2025
- 2025Learning Diffusion Models with Flexible Representation Guidance11 Jul 2025
- 2025Scalable Autoregressive 3D Molecule Generation20 May 2025
- 2025Straight-Line Diffusion Model for Efficient 3D Molecular Generation4 Mar 2025
- 2025Universally Invariant Learning in Equivariant GNNscited by 3
- 2026Self-Conditioned Denoising for Atomistic Representation Learningcited by 3
- 2025Geometric Mixture Models for Electrolyte Conductivity Predictioncited by 2
- 2026FlashMol: High-Quality Molecule Generation in as Few as Four Stepscited by 1
- 2026Toward Better Geometric Representations for Molecule Generative Modelscited by 1
- 2026Representations from Pretrained Machine-Learning Interatomic Potentials as Coarse Coordinates for Material Generation and Evaluationcited by 0
- 2026SurfSpec: Enhancing Off-Target-Agnostic Specificity by Bounding Pocket-Ligand Geometric Mismatchcited by 0
- 2026SurfSpec: Enhancing Off-Target-Agnostic Specificity by Bounding Pocket-Ligand Geometric Mismatch2 Sep 2026
- 2026Representations from Pretrained Machine-Learning Interatomic Potentials as Coarse Coordinates for Material Generation and Evaluation30 Jul 2026
- 2026Toward Better Geometric Representations for Molecule Generative Models8 May 2026
- 2026FlashMol: High-Quality Molecule Generation in as Few as Four Steps7 May 2026
- 2026Self-Conditioned Denoising for Atomistic Representation Learning17 Mar 2026
- 2025Geometric Mixture Models for Electrolyte Conductivity Prediction17 Oct 2025
- 2025Universally Invariant Learning in Equivariant GNNs15 Oct 2025