Implicit Geometry and Interaction Embeddings Improve Few-Shot Molecular Property Prediction
Not on the map. Why?
Abstract (arXiv)
Few-shot learning is a promising approach to molecular property prediction as supervised data is often very limited. However, many important molecular properties depend on complex molecular characteristics -- such as the various 3D geometries a molecule may adopt or the types of chemical interactions it can form -- that are not explicitly encoded in the feature space and must be approximated from low amounts of data. Learning these characteristics can be difficult, especially for few-shot learning algorithms that are designed for fast adaptation to new tasks. In this work, we develop molecular embeddings that encode complex molecular characteristics to improve the performance of few-shot molecular property prediction. Our approach leverages large amounts of synthetic data, namely the results of molecular docking calculations, and a multi-task learning paradigm to structure the embedding space. On multiple molecular property prediction benchmarks, training from the embedding space substantially improves Multi-Task, MAML, and Prototypical Network few-shot learning performance. Our code is available at https://github.com/cfifty/IGNITE.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 4 Feb 2023.
Builds on
27 of 43 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2021Going deeper with Image Transformerscited by 759
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
15 more
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
- 2018How to train your MAMLcited by 306
- 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 260
- 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
- 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 123
- 2020Molecule Attention Transformercited by 92
- 2016Low Data Drug Discovery with One-shot Learningcited by 91
- 2021GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Predictioncited by 61
- 2022Does GNN Pretraining Help Molecular Representation?cited by 59
- 2021Property-Aware Relation Networks for Few-Shot Molecular Property Predictioncited by 41
- 2022Energy-Motivated Equivariant Pretraining for 3D Molecular Graphscited by 37
- 2019Single Headed Attention RNN: Stop Thinking With Your Headcited by 25
Built on by
Not cited yet.