mlsanityData to 7 Oct 2026

Learning Topology-Specific Experts for Molecular Property Prediction

arXiv 2302.13693 ↗First posted 27 Feb 2023cs.LG q-bio.QMcited by 15

Not on the map. Why?

Abstract (arXiv)

Recently, graph neural networks (GNNs) have been successfully applied to predicting molecular properties, which is one of the most classical cheminformatics tasks with various applications. Despite their effectiveness, we empirically observe that training a single GNN model for diverse molecules with distinct structural patterns limits its prediction performance. In this paper, motivated by this observation, we propose TopExpert to leverage topology-specific prediction models (referred to as experts), each of which is responsible for each molecular group sharing similar topological semantics. That is, each expert learns topology-specific discriminative features while being trained with its corresponding topological group. To tackle the key challenge of grouping molecules by their topological patterns, we introduce a clustering-based gating module that assigns an input molecule into one of the clusters and further optimizes the gating module with two different types of self-supervision: topological semantics induced by GNNs and molecular scaffolds, respectively. Extensive experiments demonstrate that TopExpert has boosted the performance for molecular property prediction and also achieved better generalization for new molecules with unseen scaffolds than baselines. The code is available at https://github.com/kimsu55/ToxExpert.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 27 Feb 2023.

Builds on

33 of 52 references.

References · 33

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  7. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  8. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  9. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  10. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  11. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  12. 2019Strategies for Pre-training Graph Neural Networkscited by 964
21 more
  1. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 763
  2. 2020Directional Message Passing for Molecular Graphscited by 556
  3. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  4. 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
  5. 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
  6. 2019Concrete Autoencoders for Differentiable Feature Selection and Reconstructioncited by 90
  7. 2020Factorizable Graph Convolutional Networkscited by 79
  8. 2019Mixture Models for Diverse Machine Translation: Tricks of the Tradecited by 77
  9. 2019GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulationcited by 75
  10. 2019Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspectivecited by 73
  11. 2020Hierarchical Inter-Message Passing for Learning on Molecular Graphscited by 59
  12. 2016Network of Experts for Large-Scale Image Categorizationcited by 54
  13. 2020Rethinking Graph Regularization for Graph Neural Networkscited by 36
  14. 2020DE-RRD: A Knowledge Distillation Framework for Recommender Systemcited by 28
  15. 2021Topology Distillation for Recommender Systemcited by 24
  16. 2022Molecular Representation Learning via Heterogeneous Motif Graph Neural Networkscited by 23
  17. 2020Deep Learning of High-Order Interactions for Protein Interface Predictioncited by 22
  18. 2021Graph Classification by Mixture of Diverse Expertscited by 16
  19. 2021Learnable Structural Semantic Readout for Graph Classificationcited by 13
  20. 2022Toward Interpretable Semantic Textual Similarity via Optimal Transport-based Contrastive Sentence Learningcited by 13
  21. 2019Unsupervised Learning of Graph Hierarchical Abstractions with Differentiable Coarsening and Optimal Transportcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 7; 2026: 2.

15 papers.

Sort:

By area: