Instructor-inspired Machine Learning for Robust Molecular Property Prediction
Not on the map. Why?
Abstract (arXiv)
Machine learning catalyzes a revolution in chemical and biological science. However, its efficacy heavily depends on the availability of labeled data, and annotating biochemical data is extremely laborious. To surmount this data sparsity challenge, we present an instructive learning algorithm named InstructMol to measure pseudo-labels' reliability and help the target model leverage large-scale unlabeled data. InstructMol does not require transferring knowledge between multiple domains, which avoids the potential gap between the pretraining and fine-tuning stages. We demonstrated the high accuracy of InstructMol on several real-world molecular datasets and out-of-distribution (OOD) benchmarks. Code is available at~ https://github.com/smiles724/InstructMol.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 47 of its 82 references that are in the map. First posted on arXiv 8 Apr 2023.
Builds on
47 of 82 references.
References · 47
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2022Generative Adversarial Networkscited by 5,627
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2019Invariant Risk Minimizationcited by 1,854
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
35 more
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2019Strategies for Pre-training Graph Neural Networkscited by 971
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 742
- 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 510
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 436
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 375
- 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 303
- 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
- 2019Label Propagation for Deep Semi-supervised Learningcited by 289
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
- 2022Discovering Invariant Rationales for Graph Neural Networkscited by 188
- 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 141
- 2020An Overview of Deep Semi-Supervised Learningcited by 121
- 2016Semi-Supervised Learning with Generative Adversarial Networkscited by 103
- 2018N-Gram Graph: Simple Unsupervised Representation for Graphs, with Applications to Moleculescited by 93
- 2018Less is more: sampling chemical space with active learningcited by 82
- 2022One Transformer Can Understand Both 2D & 3D Molecular Datacited by 77
- 2019Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspectivecited by 73
- 2021MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graphcited by 65
- 2019DScribe: Library of Descriptors for Machine Learning in Materials Sciencecited by 63
- 2022Does GNN Pretraining Help Molecular Representation?cited by 60
- 2021Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphscited by 44
- 2022Contrastive Representation Learning for 3D Protein Structurescited by 30
- 2022DiffMD: A Geometric Diffusion Model for Molecular Dynamics Simulationscited by 24
- 2016Infinite Variational Autoencoder for Semi-Supervised Learningcited by 23
- 2022Pre-training of Equivariant Graph Matching Networks with Conformation Flexibility for Drug Bindingcited by 15
- 2022Improving Molecular Representation Learning with Metric Learning-enhanced Optimal Transportcited by 9
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 2; 2026: 2.
8 papers.
- 2023A Hierarchical Training Paradigm for Antibody Structure-sequence Co-designcited by 13
- 2025PoseX: AI Defeats Physics Approaches on Protein-Ligand Cross Dockingcited by 7
- 2023Multi-channel learning for integrating structural hierarchies into context-dependent molecular representationcited by 6
- 2024Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Surveycited by 6
- 2025Graph-structured Small Molecule Drug Discovery Through Deep Learning: Progress, Challenges, and Opportunitiescited by 5
- 2024MaskMol: Knowledge-guided Molecular Image Pre-Training Framework for Activity Cliffscited by 2
- 2026Conformal Prediction for Molecular Properties under Label Shiftcited by 2
- 2026Chem-GMNet: A Sphere-Native Geometric Transformer for Molecular Property Predictioncited by 0
- 2026Conformal Prediction for Molecular Properties under Label Shift18 Aug 2026
- 2026Chem-GMNet: A Sphere-Native Geometric Transformer for Molecular Property Prediction13 May 2026
- 2025PoseX: AI Defeats Physics Approaches on Protein-Ligand Cross Docking3 May 2025
- 2025Graph-structured Small Molecule Drug Discovery Through Deep Learning: Progress, Challenges, and Opportunities13 Feb 2025
- 2024MaskMol: Knowledge-guided Molecular Image Pre-Training Framework for Activity Cliffs2 Sep 2024
- 2024Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Survey11 Feb 2024
- 2023Multi-channel learning for integrating structural hierarchies into context-dependent molecular representation5 Nov 2023
- 2023A Hierarchical Training Paradigm for Antibody Structure-sequence Co-design30 Oct 2023