mlsanityData to 7 Oct 2026

Implicit Geometry and Interaction Embeddings Improve Few-Shot Molecular Property Prediction

arXiv 2302.02055 ↗First posted 4 Feb 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Few-shot learning is a promising approach to molecular property prediction as supervised data is often very limited. However, many important molecular properties depend on complex molecular characteristics -- such as the various 3D geometries a molecule may adopt or the types of chemical interactions it can form -- that are not explicitly encoded in the feature space and must be approximated from low amounts of data. Learning these characteristics can be difficult, especially for few-shot learning algorithms that are designed for fast adaptation to new tasks. In this work, we develop molecular embeddings that encode complex molecular characteristics to improve the performance of few-shot molecular property prediction. Our approach leverages large amounts of synthetic data, namely the results of molecular docking calculations, and a multi-task learning paradigm to structure the embedding space. On multiple molecular property prediction benchmarks, training from the embedding space substantially improves Multi-Task, MAML, and Prototypical Network few-shot learning performance. Our code is available at https://github.com/cfifty/IGNITE.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 4 Feb 2023.

Builds on

27 of 43 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  4. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  5. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  6. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  7. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  8. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  9. 2020On Layer Normalization in the Transformer Architecturecited by 906
  10. 2021Going deeper with Image Transformerscited by 759
  11. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  12. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
15 more
  1. 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
  2. 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
  3. 2018How to train your MAMLcited by 306
  4. 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 260
  5. 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
  6. 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
  7. 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
  8. 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 123
  9. 2020Molecule Attention Transformercited by 92
  10. 2016Low Data Drug Discovery with One-shot Learningcited by 91
  11. 2021GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Predictioncited by 61
  12. 2022Does GNN Pretraining Help Molecular Representation?cited by 59
  13. 2021Property-Aware Relation Networks for Few-Shot Molecular Property Predictioncited by 41
  14. 2022Energy-Motivated Equivariant Pretraining for 3D Molecular Graphscited by 37
  15. 2019Single Headed Attention RNN: Stop Thinking With Your Headcited by 25

Built on by

Not cited yet.