Learning Topology-Specific Experts for Molecular Property Prediction
Not on the map. Why?
Abstract (arXiv)
Recently, graph neural networks (GNNs) have been successfully applied to predicting molecular properties, which is one of the most classical cheminformatics tasks with various applications. Despite their effectiveness, we empirically observe that training a single GNN model for diverse molecules with distinct structural patterns limits its prediction performance. In this paper, motivated by this observation, we propose TopExpert to leverage topology-specific prediction models (referred to as experts), each of which is responsible for each molecular group sharing similar topological semantics. That is, each expert learns topology-specific discriminative features while being trained with its corresponding topological group. To tackle the key challenge of grouping molecules by their topological patterns, we introduce a clustering-based gating module that assigns an input molecule into one of the clusters and further optimizes the gating module with two different types of self-supervision: topological semantics induced by GNNs and molecular scaffolds, respectively. Extensive experiments demonstrate that TopExpert has boosted the performance for molecular property prediction and also achieved better generalization for new molecules with unseen scaffolds than baselines. The code is available at https://github.com/kimsu55/ToxExpert.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 27 Feb 2023.
Builds on
33 of 52 references.
References · 33
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
21 more
- 2015Unsupervised Deep Embedding for Clustering Analysiscited by 763
- 2020Directional Message Passing for Molecular Graphscited by 556
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
- 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
- 2019Concrete Autoencoders for Differentiable Feature Selection and Reconstructioncited by 90
- 2020Factorizable Graph Convolutional Networkscited by 79
- 2019Mixture Models for Diverse Machine Translation: Tricks of the Tradecited by 77
- 2019GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulationcited by 75
- 2019Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspectivecited by 73
- 2020Hierarchical Inter-Message Passing for Learning on Molecular Graphscited by 59
- 2016Network of Experts for Large-Scale Image Categorizationcited by 54
- 2020Rethinking Graph Regularization for Graph Neural Networkscited by 36
- 2020DE-RRD: A Knowledge Distillation Framework for Recommender Systemcited by 28
- 2021Topology Distillation for Recommender Systemcited by 24
- 2022Molecular Representation Learning via Heterogeneous Motif Graph Neural Networkscited by 23
- 2020Deep Learning of High-Order Interactions for Protein Interface Predictioncited by 22
- 2021Graph Classification by Mixture of Diverse Expertscited by 16
- 2021Learnable Structural Semantic Readout for Graph Classificationcited by 13
- 2022Toward Interpretable Semantic Textual Similarity via Optimal Transport-based Contrastive Sentence Learningcited by 13
- 2019Unsupervised Learning of Graph Hierarchical Abstractions with Differentiable Coarsening and Optimal Transportcited by 12
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 7; 2026: 2.
15 papers.
Sort:
By area:
- 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modelingcited by 63
- 2024Graph Sparsification via Mixture of Graphscited by 17
- 2024GALA: Graph Diffusion-based Alignment with Jigsaw for Source-free Domain Adaptationcited by 8
- 2024Rank and Align: Towards Effective Source-free Graph Domain Adaptationcited by 7
- 2025Cooperation of Experts: Fusing Heterogeneous Information with Large Margincited by 6
- 2025Graph-structured Small Molecule Drug Discovery Through Deep Learning: Progress, Challenges, and Opportunitiescited by 5
- 2024Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Predictioncited by 4
- 2025Modeling Expert Interactions in Sparse Mixture of Experts via Graph Structurescited by 3
- 2025Sparse Causal Discovery with Generative Intervention for Unsupervised Graph Domain Adaptationcited by 2
- 2025A Scalable Pretraining Framework for Link Prediction with Efficient Adaptationcited by 2
- 2025Explainable Attention-Guided Stacked Graph Neural Networks for Malware Detectioncited by 2
- 2026Topology-Aware Multiscale Mixture of Experts for Efficient Molecular Property Predictioncited by 1
- 2026Routing-Aware Explanations for Mixture of Experts Graph Models in Malware Detection22 Feb 2026
- 2026Topology-Aware Multiscale Mixture of Experts for Efficient Molecular Property Prediction19 Jan 2026
- 2025Modeling Expert Interactions in Sparse Mixture of Experts via Graph Structures18 Oct 2025
- 2025Explainable Attention-Guided Stacked Graph Neural Networks for Malware Detection13 Aug 2025
- 2025A Scalable Pretraining Framework for Link Prediction with Efficient Adaptation6 Aug 2025
- 2025Sparse Causal Discovery with Generative Intervention for Unsupervised Graph Domain Adaptation10 Jul 2025
- 2025Cooperation of Experts: Fusing Heterogeneous Information with Large Margin27 May 2025
- 2025Adaptive Substructure-Aware Expert Model for Molecular Property Prediction8 Apr 2025
- 2025Graph-structured Small Molecule Drug Discovery Through Deep Learning: Progress, Challenges, and Opportunities13 Feb 2025
- 2024Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Prediction2 Nov 2024
- 2024GALA: Graph Diffusion-based Alignment with Jigsaw for Source-free Domain Adaptation22 Oct 2024
- 2024Rank and Align: Towards Effective Source-free Graph Domain Adaptation22 Aug 2024
3 more
- 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modelingcited by 63
- 2024Graph Sparsification via Mixture of Graphscited by 17
- 2025Modeling Expert Interactions in Sparse Mixture of Experts via Graph Structurescited by 3
- 2025A Scalable Pretraining Framework for Link Prediction with Efficient Adaptationcited by 2
- 2026Topology-Aware Multiscale Mixture of Experts for Efficient Molecular Property Predictioncited by 1
- 2025Adaptive Substructure-Aware Expert Model for Molecular Property Predictioncited by 0
- 2026Routing-Aware Explanations for Mixture of Experts Graph Models in Malware Detectioncited by 0
- 2026Routing-Aware Explanations for Mixture of Experts Graph Models in Malware Detection22 Feb 2026
- 2026Topology-Aware Multiscale Mixture of Experts for Efficient Molecular Property Prediction19 Jan 2026
- 2025Modeling Expert Interactions in Sparse Mixture of Experts via Graph Structures18 Oct 2025
- 2025A Scalable Pretraining Framework for Link Prediction with Efficient Adaptation6 Aug 2025
- 2025Adaptive Substructure-Aware Expert Model for Molecular Property Prediction8 Apr 2025
- 2024Graph Sparsification via Mixture of Graphs23 May 2024
- 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modeling6 Apr 2023
- 2024Rank and Align: Towards Effective Source-free Graph Domain Adaptationcited by 7
- 2025Cooperation of Experts: Fusing Heterogeneous Information with Large Margincited by 6
- 2025Graph-structured Small Molecule Drug Discovery Through Deep Learning: Progress, Challenges, and Opportunitiescited by 5
- 2024Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Predictioncited by 4
- 2025Sparse Causal Discovery with Generative Intervention for Unsupervised Graph Domain Adaptationcited by 2
- 2025Explainable Attention-Guided Stacked Graph Neural Networks for Malware Detectioncited by 2
- 2024Fragment-Masked Diffusion for Molecular Optimizationcited by 0
- 2025Explainable Attention-Guided Stacked Graph Neural Networks for Malware Detection13 Aug 2025
- 2025Sparse Causal Discovery with Generative Intervention for Unsupervised Graph Domain Adaptation10 Jul 2025
- 2025Cooperation of Experts: Fusing Heterogeneous Information with Large Margin27 May 2025
- 2025Graph-structured Small Molecule Drug Discovery Through Deep Learning: Progress, Challenges, and Opportunities13 Feb 2025
- 2024Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Prediction2 Nov 2024
- 2024Rank and Align: Towards Effective Source-free Graph Domain Adaptation22 Aug 2024
- 2024Fragment-Masked Diffusion for Molecular Optimization17 Aug 2024