Retrieval-based Controllable Molecule Generation
Not on the map. Why?
Abstract (arXiv)
Generating new molecules with specified chemical and biological properties via generative models has emerged as a promising direction for drug discovery. However, existing methods require extensive training/fine-tuning with a large dataset, often unavailable in real-world generation tasks. In this work, we propose a new retrieval-based framework for controllable molecule generation. We use a small set of exemplar molecules, i.e., those that (partially) satisfy the design criteria, to steer the pre-trained generative model towards synthesizing molecules that satisfy the given design criteria. We design a retrieval mechanism that retrieves and fuses the exemplar molecules with the input molecule, which is trained by a new self-supervised objective that predicts the nearest neighbor of the input molecule. We also propose an iterative refinement process to dynamically update the generated molecules and retrieval database for better generalization. Our approach is agnostic to the choice of generative models and requires no task-specific fine-tuning. On various tasks ranging from simple design criteria to a challenging real-world scenario for designing lead compounds that bind to the SARS-CoV-2 main protease, we demonstrate our approach extrapolates well beyond the retrieval database, and achieves better performance and wider applicability than previous methods. Code is available at https://github.com/NVlabs/RetMol.
Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). Builds on 43 of its 100 references that are in the map. First posted on arXiv 23 Aug 2022.
Builds on
43 of 100 references.
References · 43
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 652
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 648
- 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 632
31 more
- 2018Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generationcited by 364
- 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 297
- 2017Grammar Variational Autoencodercited by 285
- 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 267
- 2022Memorizing Transformerscited by 226
- 2018Optimization of Molecules via Deep Reinforcement Learningcited by 200
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 171
- 2021Constrained Language Models Yield Few-Shot Semantic Parserscited by 163
- 2017Deep Reinforcement Learning for De-Novo Drug Designcited by 161
- 2022A Survey on Retrieval-Augmented Text Generationcited by 158
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2021Instance-Conditioned GANcited by 121
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2018Multi-Objective De Novo Drug Design with Conditional Graph Generative Modelcited by 101
- 2018Learning Multimodal Graph-to-Graph Translation for Molecular Optimizationcited by 88
- 2020MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Modelscited by 74
- 2018Molecular generative model based on conditional variational autoencoder for de novo molecular designcited by 73
- 2021Learning to Extend Molecular Scaffolds with Structural Motifscited by 71
- 2019Mol-CycleGAN - a generative model for molecular optimizationcited by 66
- 2019Augmenting Genetic Algorithms with Deep Neural Networks for Exploring the Chemical Spacecited by 66
- 2020Optimizing Molecules using Efficient Queries from Property Evaluationscited by 50
- 2021Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Designcited by 44
- 2021Mention Memory: incorporating textual knowledge into Transformers through entity mention attentioncited by 43
- 2018Retrieval-Based Neural Code Generationcited by 41
- 2020RetrieveGAN: Image Synthesis via Differentiable Patch Retrievalcited by 35
- 2022Relational Memory Augmented Language Modelscited by 24
- 2020Generative chemistry: drug discovery with deep learning generative modelscited by 22
- 2020Scaffold-constrained molecular generationcited by 18
- 2017Generating Focussed Molecule Libraries for Drug Discovery with Recurrent Neural Networkscited by 12
- 2020A deep-learning view of chemical space designed to facilitate drug discoverycited by 7
- 2020Controlled Molecule Generator for Optimizing Multiple Chemical Propertiescited by 6
Built on by
Citing papers per year: 2022: 2; 2023: 9; 2024: 16; 2025: 9; 2026: 8.
44 papers.
Sort:
By area:
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
- 2023MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generationcited by 98
- 2024Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Modelscited by 91
- 2024Reliable, Adaptable, and Attributable Language Models with Retrievalcited by 73
- 2025ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templatescited by 63
- 2025GenMol: A Drug Discovery Generalist with Discrete Diffusioncited by 50
- 2023RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarioscited by 46
- 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Modelscited by 37
- 2022Computer-Aided Multi-Objective Optimization in Small Molecule Discoverycited by 31
- 2023ChatGPT-powered Conversational Drug Editing Using Retrieval and Domain Feedbackcited by 31
32 more
- 2024UniMoT: Unified Molecule-Text Language Model with Discrete Token Representationcited by 23
- 2024Molecule Generation with Fragment Retrieval Augmentationcited by 23
- 2023Domain-Agnostic Molecular Generation with Chemical Feedbackcited by 22
- 2023Drug Discovery with Dynamic Goal-aware Fragmentscited by 19
- 2025RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddingscited by 19
- 2024Retrieval Augmented Diffusion Model for Structure-informed Antibody Design and Optimizationcited by 9
- 2024Retrieval-Retro: Retrieval-based Inorganic Retrosynthesis with Expert Knowledgecited by 9
- 20243M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generationcited by 8
- 2024Source Code Foundation Models are Transferable Binary Analysis Knowledge Basescited by 8
- 2023PrefixMol: Target- and Chemistry-aware Molecule Design via Prefix Embeddingcited by 7
- 2024Small Molecule Optimization with Large Language Modelscited by 6
- 2024Retrieval-augmented Generation for GenAI-enabled Semantic Communicationscited by 5
- 2023GraphVF: Controllable Protein-Specific 3D Molecule Generation with Variational Flowcited by 4
- 2024Diffusion Twigs with Loop Guidance for Conditional Graph Generationcited by 4
- 2025BioMol-MQA: A Multi-Modal Question Answering Dataset For LLM Reasoning Over Bio-Molecular Interactionscited by 4
- 2025REIS: A High-Performance and Energy-Efficient Retrieval System with In-Storage Processingcited by 4
- 2025LLMs for Supply Chain Managementcited by 3
- 2025Toward Closed-loop Molecular Discovery via Language Model, Property Alignment and Strategic Searchcited by 3
- 2024Unsupervised Discovery of Steerable Factors When Graph Deep Generative Models Are Entangledcited by 2
- 2025InversionGNN: A Dual Path Network for Multi-Property Molecular Optimizationcited by 2
- 2024Semantic Feature Learning for Universal Unsupervised Cross-Domain Retrievalcited by 1
- 2026Agents on a Tree: Pathwise Coordination for Multi-Objective Molecular Optimizationcited by 1
- 2023On the Equivalence of Graph Convolution and Mixupcited by 0
- 2024MolPLA: A Molecular Pretraining Framework for Learning Cores, R-Groups and their Linker Jointscited by 0
- 2025Accelerating Causal Network Discovery of Alzheimer Disease Biomarkers via Scientific Literature-based Retrieval Augmented Generationcited by 0
- 2026From Tokens to Blocks: A Block-Diffusion Perspective on Molecular Generationcited by 0
- 2026INDIBATOR: Diverse and Fact-Grounded Individuality for Multi-Agent Debate in Molecular Discoverycited by 0
- 2026Amortized Molecular Optimization via Group Relative Policy Optimizationcited by 0
- 2026MolWorld: Molecule World Models for Actionable Molecular Optimizationcited by 0
- 2026FORGE: Fragment-Oriented Ranking and Generation for Context-Aware Molecular Optimizationcited by 0
- 2026Adopting Reinforcement Learning with Verifiable Rewards for Molecular Generationcited by 0
- 2026RAGMesh with FaME-G2E: Long-Form Text-Driven 3D Face Generation and Editingcited by 0
- 2026RAGMesh with FaME-G2E: Long-Form Text-Driven 3D Face Generation and Editing10 Aug 2026
- 2026Adopting Reinforcement Learning with Verifiable Rewards for Molecular Generation21 Jul 2026
- 2026FORGE: Fragment-Oriented Ranking and Generation for Context-Aware Molecular Optimization11 May 2026
- 2026MolWorld: Molecule World Models for Actionable Molecular Optimization9 May 2026
- 2026Agents on a Tree: Pathwise Coordination for Multi-Objective Molecular Optimization27 Mar 2026
- 2026Amortized Molecular Optimization via Group Relative Policy Optimization12 Feb 2026
- 2026INDIBATOR: Diverse and Fact-Grounded Individuality for Multi-Agent Debate in Molecular Discovery2 Feb 2026
- 2026From Tokens to Blocks: A Block-Diffusion Perspective on Molecular Generation29 Jan 2026
- 2025Toward Closed-loop Molecular Discovery via Language Model, Property Alignment and Strategic Search10 Dec 2025
- 2025REIS: A High-Performance and Energy-Efficient Retrieval System with In-Storage Processing19 Jun 2025
- 2025BioMol-MQA: A Multi-Modal Question Answering Dataset For LLM Reasoning Over Bio-Molecular Interactions6 Jun 2025
- 2025LLMs for Supply Chain Management24 May 2025
32 more
- 2025Accelerating Causal Network Discovery of Alzheimer Disease Biomarkers via Scientific Literature-based Retrieval Augmented Generation1 Apr 2025
- 2025InversionGNN: A Dual Path Network for Multi-Property Molecular Optimization3 Mar 2025
- 2025RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings27 Feb 2025
- 2025ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templates10 Feb 2025
- 2025GenMol: A Drug Discovery Generalist with Discrete Diffusion10 Jan 2025
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)31 Dec 2024
- 2024Retrieval-augmented Generation for GenAI-enabled Semantic Communications27 Dec 2024
- 2024Molecule Generation with Fragment Retrieval Augmentation18 Nov 2024
- 2024Diffusion Twigs with Loop Guidance for Conditional Graph Generation31 Oct 2024
- 2024Retrieval-Retro: Retrieval-based Inorganic Retrosynthesis with Expert Knowledge28 Oct 2024
- 2024Retrieval Augmented Diffusion Model for Structure-informed Antibody Design and Optimization19 Oct 2024
- 2024UniMoT: Unified Molecule-Text Language Model with Discrete Token Representation1 Aug 2024
- 2024Small Molecule Optimization with Large Language Models26 Jul 2024
- 2024Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models6 Jun 2024
- 2024Source Code Foundation Models are Transferable Binary Analysis Knowledge Bases30 May 2024
- 20243M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generation11 Mar 2024
- 2024Semantic Feature Learning for Universal Unsupervised Cross-Domain Retrieval8 Mar 2024
- 2024Reliable, Adaptable, and Attributable Language Models with Retrieval5 Mar 2024
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey29 Feb 2024
- 2024MolPLA: A Molecular Pretraining Framework for Learning Cores, R-Groups and their Linker Joints30 Jan 2024
- 2024Unsupervised Discovery of Steerable Factors When Graph Deep Generative Models Are Entangled29 Jan 2024
- 2023RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarios19 Dec 2023
- 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Models6 Oct 2023
- 2023Drug Discovery with Dynamic Goal-aware Fragments2 Oct 2023
- 2023On the Equivalence of Graph Convolution and Mixup29 Sep 2023
- 2023ChatGPT-powered Conversational Drug Editing Using Retrieval and Domain Feedback29 May 2023
- 2023GraphVF: Controllable Protein-Specific 3D Molecule Generation with Variational Flow23 Feb 2023
- 2023MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generation17 Feb 2023
- 2023PrefixMol: Target- and Chemistry-aware Molecule Design via Prefix Embedding14 Feb 2023
- 2023Domain-Agnostic Molecular Generation with Chemical Feedback26 Jan 2023
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editing21 Dec 2022
- 2022Computer-Aided Multi-Objective Optimization in Small Molecule Discovery13 Oct 2022
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2024Reliable, Adaptable, and Attributable Language Models with Retrievalcited by 73
- 2023RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarioscited by 46
- 2024Retrieval-augmented Generation for GenAI-enabled Semantic Communicationscited by 5
- 2025Accelerating Causal Network Discovery of Alzheimer Disease Biomarkers via Scientific Literature-based Retrieval Augmented Generationcited by 0
- 2025Accelerating Causal Network Discovery of Alzheimer Disease Biomarkers via Scientific Literature-based Retrieval Augmented Generation1 Apr 2025
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)31 Dec 2024
- 2024Retrieval-augmented Generation for GenAI-enabled Semantic Communications27 Dec 2024
- 2024Reliable, Adaptable, and Attributable Language Models with Retrieval5 Mar 2024
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey29 Feb 2024
- 2023RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarios19 Dec 2023
- 2024Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Modelscited by 91
- 2025ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templatescited by 63
- 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Modelscited by 37
- 2025BioMol-MQA: A Multi-Modal Question Answering Dataset For LLM Reasoning Over Bio-Molecular Interactionscited by 4
- 2025BioMol-MQA: A Multi-Modal Question Answering Dataset For LLM Reasoning Over Bio-Molecular Interactions6 Jun 2025
- 2025ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templates10 Feb 2025
- 2024Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models6 Jun 2024
- 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Models6 Oct 2023
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
- 2022Computer-Aided Multi-Objective Optimization in Small Molecule Discoverycited by 31
- 2023ChatGPT-powered Conversational Drug Editing Using Retrieval and Domain Feedbackcited by 31
- 2024UniMoT: Unified Molecule-Text Language Model with Discrete Token Representationcited by 23
- 2024Molecule Generation with Fragment Retrieval Augmentationcited by 23
- 2023Domain-Agnostic Molecular Generation with Chemical Feedbackcited by 22
- 2023Drug Discovery with Dynamic Goal-aware Fragmentscited by 19
- 2025RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddingscited by 19
- 2024Retrieval-Retro: Retrieval-based Inorganic Retrosynthesis with Expert Knowledgecited by 9
- 20243M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generationcited by 8
- 2024Source Code Foundation Models are Transferable Binary Analysis Knowledge Basescited by 8
- 2023PrefixMol: Target- and Chemistry-aware Molecule Design via Prefix Embeddingcited by 7
12 most cited of 30 All 30 (JSON)
- 2026RAGMesh with FaME-G2E: Long-Form Text-Driven 3D Face Generation and Editing10 Aug 2026
- 2026Adopting Reinforcement Learning with Verifiable Rewards for Molecular Generation21 Jul 2026
- 2026FORGE: Fragment-Oriented Ranking and Generation for Context-Aware Molecular Optimization11 May 2026
- 2026MolWorld: Molecule World Models for Actionable Molecular Optimization9 May 2026
- 2026Agents on a Tree: Pathwise Coordination for Multi-Objective Molecular Optimization27 Mar 2026
- 2026Amortized Molecular Optimization via Group Relative Policy Optimization12 Feb 2026
- 2026From Tokens to Blocks: A Block-Diffusion Perspective on Molecular Generation29 Jan 2026
- 2025Toward Closed-loop Molecular Discovery via Language Model, Property Alignment and Strategic Search10 Dec 2025
- 2025REIS: A High-Performance and Energy-Efficient Retrieval System with In-Storage Processing19 Jun 2025
- 2025LLMs for Supply Chain Management24 May 2025
- 2025InversionGNN: A Dual Path Network for Multi-Property Molecular Optimization3 Mar 2025
- 2025RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings27 Feb 2025
12 newest of 30 All 30 (JSON)