mlsanityData to 14 Oct 2026

Contextual Representation Anchor Network to Alleviate Selection Bias in Few-Shot Drug Discovery

arXiv 2410.20711 ↗First posted 28 Oct 2024cs.LG cs.AI q-bio.BMcited by 0

Not on the map. Why?

Abstract (arXiv)

In the drug discovery process, the low success rate of drug candidate screening often leads to insufficient labeled data, causing the few-shot learning problem in molecular property prediction. Existing methods for few-shot molecular property prediction overlook the sample selection bias, which arises from non-random sample selection in chemical experiments. This bias in data representativeness leads to suboptimal performance. To overcome this challenge, we present a novel method named contextual representation anchor Network (CRA), where an anchor refers to a cluster center of the representations of molecules and serves as a bridge to transfer enriched contextual knowledge into molecular representations and enhance their expressiveness. CRA introduces a dual-augmentation mechanism that includes context augmentation, which dynamically retrieves analogous unlabeled molecules and captures their task-specific contextual knowledge to enhance the anchors, and anchor augmentation, which leverages the anchors to augment the molecular representations. We evaluate our approach on the MoleculeNet and FS-Mol benchmarks, as well as in domain transfer experiments. The results demonstrate that CRA outperforms the state-of-the-art by 2.60% and 3.28% in AUC and DeltaAUC-PR metrics, respectively, and exhibits superior generalization capabilities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 80 references that are in the map. First posted on arXiv 28 Oct 2024.

Builds on

28 of 80 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  4. 2018How Powerful are Graph Neural Networks?cited by 4,393
  5. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  6. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  7. 2019Strategies for Pre-training Graph Neural Networkscited by 971
  8. 2020Meta-Learning in Neural Networks: A Surveycited by 950
  9. 2020Hopfield Networks is All You Needcited by 475
  10. 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
  11. 2019Analyzing Learned Molecular Representations for Property Predictioncited by 375
  12. 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
16 more
  1. 2018Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learningcited by 211
  2. 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
  3. 2018Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relationscited by 201
  4. 2019SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learningcited by 195
  5. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
  6. 2019Edge-labeling Graph Neural Network for Few-shot Learningcited by 114
  7. 2020Molecule Attention Transformercited by 92
  8. 2016Low Data Drug Discovery with One-shot Learningcited by 91
  9. 2021Few-Shot Graph Learning for Molecular Property Predictioncited by 81
  10. 2021Property-Aware Relation Networks for Few-Shot Molecular Property Predictioncited by 41
  11. 2022Debiased Graph Neural Networks with Agnostic Label Selection Biascited by 25
  12. 2023Context-enriched molecule representations improve few-shot drug discoverycited by 24
  13. 2022Meta-learning Adaptive Deep Kernel Gaussian Processes for Molecular Property Predictioncited by 21
  14. 2022Alleviating the Sample Selection Bias in Few-shot Learning by Removing Projection to the Centroidcited by 20
  15. 2023Uncertainty-Aware Distillation for Semi-Supervised Few-Shot Class-Incremental Learningcited by 16
  16. 2022Powering Finetuning in Few-Shot Learning: Domain-Agnostic Bias Reduction with Selected Samplingcited by 8

Built on by

Not cited yet.