# GEOM-Drugs Revisited: Toward More Chemically Accurate Benchmarks for 3D Molecule Generation

arXiv: https://arxiv.org/abs/2505.00169 · HTML: https://mlsanity.com/paper/2505.00169/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 14 of its 33 references that are in the map.
- First posted on arXiv 30 Apr 2025.

## Builds on (most cited first, 14 of 14)

- [Equivariant Diffusion for Molecule Generation in 3D](https://mlsanity.com/paper/2203.17003/) (2022)
- [GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation](https://mlsanity.com/paper/2203.02923/) (2022)
- [GEOM: Energy-annotated molecular conformations for property prediction and molecular generation](https://mlsanity.com/paper/2006.05531/) (2020)
- [E(n) Equivariant Normalizing Flows](https://mlsanity.com/paper/2105.09016/) (2021)
- [A 3D Generative Model for Structure-Based Drug Design](https://mlsanity.com/paper/2203.10446/) (2022)
- [MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generation](https://mlsanity.com/paper/2302.09048/) (2023)
- [Mixed Continuous and Categorical Flow Matching for 3D De Novo Molecule Generation](https://mlsanity.com/paper/2404.19739/) (2024)
- [Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generation](https://mlsanity.com/paper/2309.17296/) (2023)
- [SemlaFlow -- Efficient 3D Molecular Generation with Latent Attention and Equivariant Flow Matching](https://mlsanity.com/paper/2406.07266/) (2024)
- [Geometry-Complete Diffusion for 3D Molecule Generation and Optimization](https://mlsanity.com/paper/2302.04313/) (2023)
- [PILOT: Equivariant diffusion for pocket conditioned de novo ligand generation with multi-objective guidance via importance sampling](https://mlsanity.com/paper/2405.14925/) (2024)
- [NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation](https://mlsanity.com/paper/2502.12638/) (2025)
- [Geometric-Facilitated Denoising Diffusion Model for 3D Molecule Generation](https://mlsanity.com/paper/2401.02683/) (2024)
- [Exploring Discrete Flow Matching for 3D De Novo Molecule Generation](https://mlsanity.com/paper/2411.16644/) (2024)

## Built on by (most cited first, 8 of 8)

- [FlowMol3: Flow Matching for 3D De Novo Small-Molecule Generation](https://mlsanity.com/paper/2508.12629/) (2025)
- [Agentic AI Scientists Are Not Built For Autonomous Scientific Discovery](https://mlsanity.com/paper/2605.08956/) (2026)
- [Boltzmann-Expected Molecular Design with Decoupled Annealing Flows](https://mlsanity.com/paper/2607.19519/) (2026)
- [VEDA: 3D Molecular Generation via Variance-Exploding Diffusion with Annealing](https://mlsanity.com/paper/2511.09568/) (2025)
- [OMTRA: A Multi-Task Generative Model for Structure-Based Drug Design](https://mlsanity.com/paper/2512.05080/) (2025)
- [Hierarchy-Guided Topology Latent Flow for Molecular Graph Generation](https://mlsanity.com/paper/2603.27113/) (2026)
- [Generating Physically Consistent Molecules with Energy-Based Models](https://mlsanity.com/paper/2605.18381/) (2026)
- [PocketVE: Stable and Property-Guided Structure-Based Drug Design with Variance-Exploding Diffusion](https://mlsanity.com/paper/2609.08101/) (2026)

## Abstract (arXiv)

Deep generative models have shown significant promise in generating valid 3D molecular structures, with the GEOM-Drugs dataset serving as a key benchmark. However, current evaluation protocols suffer from critical flaws, including incorrect valency definitions, bugs in bond order calculations, and reliance on force fields inconsistent with the reference data. In this work, we revisit GEOM-Drugs and propose a corrected evaluation framework: we identify and fix issues in data preprocessing, construct chemically accurate valency tables, and introduce a GFN2-xTB-based geometry and energy benchmark. We retrain and re-evaluate several leading models under this framework, providing updated performance metrics and practical recommendations for future benchmarking. Our results underscore the need for chemically rigorous evaluation practices in 3D molecular generation. Our recommended evaluation methods and GEOM-Drugs processing scripts are available at https://github.com/isayevlab/geom-drugs-3dgen-evaluation.
