MEGA-CL: A Molecular Foundation Model for Generalizable ADMET Prediction through Graph External Attention and Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Predicting the absorption, distribution, metabolism, excretion and toxicity (ADMET) properties of small molecules remains a major challenge in drug discovery. Here, we present MEGA-CL, a foundation graph neural network framework for universal molecular ADMET prediction. MEGA-CL integrates self-supervised contrastive learning with a multi-head external attention mechanism and an enhanced message-passing architecture, enabling simultaneous modeling of local chemical substructures and global inter-graph relationships while mitigating over-smoothing effects commonly observed in deep graph networks. Across 13 benchmark datasets and 21 downstream ADMET tasks, MEGA-CL consistently outperforms state-of-the-art baseline models. In particular, the framework demonstrates robust performance on challenging regression tasks, including clearance (CL) and steady-state volume of distribution (VDss), while maintaining strong generalization ability in independent external validation. Clinically relevant predictive accuracy was achieved, with more than 75% of predictions falling within a 3-fold error range. In an external evaluation on 18 novel compounds derived from recently approved FDA drugs, over 50% of human liver microsome clearance (HLMC) predictions were within a 2-fold error range. To further assess its practical applicability, MEGA-CL was prospectively evaluated on three preclinical drug candidates using in vitro hepatic microsomal metabolism assays and CYP450 inhibition assays guided by model predictions. The predicted HLMC values for all candidates were within 2.5-fold of the experimentally measured values, and 73.3% of CYP450 inhibition endpoints (11/15) were correctly classified. These results demonstrate the potential of MEGA-CL as a generalizable framework for accelerating in silico ADMET evaluation and early-stage drug candidate optimization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 61 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
20 of 61 references.
References · 20
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2016TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systemscited by 660
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
- 2019A Fair Comparison of Graph Neural Networks for Graph Classificationcited by 244
8 more
- 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
- 2018N-Gram Graph: Simple Unsupervised Representation for Graphs, with Applications to Moleculescited by 93
- 2019Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspectivecited by 73
- 2022Graph-based Molecular Representation Learningcited by 51
- 2021Simple GNN Regularisation for 3D Molecular Property Prediction & Beyondcited by 44
- 2023Molecular Property Prediction Based on Graph Structure Learningcited by 13
- 2023Neural Atoms: Propagating Long-range Interaction in Molecular Graphs through Efficient Communication Channelcited by 10
- 2023Bridging the Gap between Chemical Reaction Pretraining and Conditional Molecule Generation with a Unified Modelcited by 4
Built on by
Not cited yet.