Hierarchical Molecular Representation Learning via Fragment-Based Self-Supervised Embedding Prediction
Not on the map. Why?
Abstract (arXiv)
Graph self-supervised learning (GSSL) has demonstrated strong potential for generating expressive graph embeddings without the need for human annotations, making it particularly valuable in domains with high labeling costs such as molecular graph analysis. However, existing GSSL methods mostly focus on node- or edge-level information, often ignoring chemically relevant substructures which strongly influence molecular properties. In this work, we propose Graph Semantic Predictive Network (GraSPNet), a hierarchical self-supervised framework that explicitly models both atomic-level and fragment-level semantics. GraSPNet decomposes molecular graphs into chemically meaningful fragments without predefined vocabularies and learns node- and fragment-level representations through multi-level message passing with masked semantic prediction at both levels. This hierarchical semantic supervision enables GraSPNet to learn multi-resolution structural information that is both expressive and transferable. Extensive experiments on multiple molecular property prediction benchmarks demonstrate that GraSPNet learns chemically meaningful representations and consistently outperforms state-of-the-art GSSL methods in transfer learning settings.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 61 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
38 of 61 references.
References · 38
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
26 more
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2020Self-supervised Learning: Generative or Contrastivecited by 693
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2021Graph Contrastive Learning Automatedcited by 287
- 2020Hierarchical Generation of Molecular Graphs using Structural Motifscited by 204
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
- 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 138
- 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 131
- 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2019A Gentle Introduction to Deep Learning for Graphscited by 107
- 2019Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learningcited by 94
- 2022What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoderscited by 82
- 2024Learning and Leveraging World Models in Visual Representation Learningcited by 71
- 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
- 2020RetroXpert: Decompose Retrosynthesis Prediction like a Chemistcited by 66
- 2022Graph-based Molecular Representation Learningcited by 51
- 2023A-JEPA: Joint-Embedding Predictive Architecture Can Listencited by 50
- 2023Rethinking Tokenizer and Decoder in Masked Graph Modeling for Moleculescited by 49
- 2021DPT: Deformable Patch-based Transformer for Visual Recognitioncited by 43
- 2019Graph Attention Auto-Encoderscited by 41
- 2020SAIL: Self-Augmented Graph Contrastive Learningcited by 20
- 2024Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneckcited by 11
- 2024Expressivity and Generalization: Fragment-Biases for Molecular GNNscited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.