Automated patent extraction powers generative modeling in focused chemical spaces
Not on the map. Why?
Abstract (arXiv)
Deep generative models have emerged as an exciting avenue for inverse molecular design, with progress coming from the interplay between training algorithms and molecular representations. One of the key challenges in their applicability to materials science and chemistry has been the lack of access to sizeable training datasets with property labels. Published patents contain the first disclosure of new materials prior to their publication in journals, and are a vast source of scientific knowledge that has remained relatively untapped in the field of data-driven molecular design. Because patents are filed seeking to protect specific uses, molecules in patents can be considered to be weakly labeled into application classes. Furthermore, patents published by the US Patent and Trademark Office (USPTO) are downloadable and have machine-readable text and molecular structures. In this work, we train domain-specific generative models using patent data sources by developing an automated pipeline to go from USPTO patent digital files to the generation of novel candidates with minimal human intervention. We test the approach on two in-class extracted datasets, one in organic electronics and another in tyrosine kinase inhibitors. We then evaluate the ability of generative models trained on these in-class datasets on two categories of tasks (distribution learning and property optimization), identify strengths and limitations, and suggest possible explanations and remedies that could be used to overcome these in practice.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 24 of its 64 references that are in the map. First posted on arXiv 14 Mar 2023.
Builds on
24 of 64 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
- 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 294
- 2017Grammar Variational Autoencodercited by 283
- 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 270
- 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 264
- 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 191
12 more
- 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 151
- 2018Interactive Supercomputing on 40,000 Cores for Machine Learning and Data Analysiscited by 110
- 2020Molecule Attention Transformercited by 92
- 2021Keeping it Simple: Language Models can learn Complex Molecular Distributionscited by 68
- 2020Reinforcement Learning for Molecular Design Guided by Quantum Mechanicscited by 51
- 2021Improving black-box optimization in VAE latent space using decoder uncertaintycited by 51
- 2022LIMO: Latent Inceptionism for Targeted Molecule Generationcited by 40
- 2019Deep learning for molecular design - a review of the state of the artcited by 38
- 2017Molecular Generation with Recurrent Neural Networks (RNNs)cited by 36
- 2019Generative Models for Automatic Chemical Designcited by 23
- 2022Biases in In Silico Evaluation of Molecular Optimization Methods and Bias-Reduced Evaluation Methodologycited by 1
- 2023mkite: A distributed computing platform for high-throughput materials simulationscited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 2.
4 papers.
- 2024InstructPatentGPT: Training patent language models to follow instructions with human feedbackcited by 17
- 2023Mining Patents with Large Language Models Elucidates the Chemical Function Landscapecited by 4
- 2023Generative Marginalization Modelscited by 4
- 2024Efficient Generation of Molecular Clusters with Dual-Scale Equivariant Flow Matchingcited by 0
- 2024Efficient Generation of Molecular Clusters with Dual-Scale Equivariant Flow Matching10 Oct 2024
- 2024InstructPatentGPT: Training patent language models to follow instructions with human feedback25 May 2024
- 2023Generative Marginalization Models19 Oct 2023
- 2023Mining Patents with Large Language Models Elucidates the Chemical Function Landscape15 Sep 2023