mlsanityData to 7 Oct 2026

Hierarchical Molecular Representation Learning via Fragment-Based Self-Supervised Embedding Prediction

arXiv 2602.20344 ↗First posted 23 Feb 2026cs.LG cs.AI q-bio.QMcited by 1

Not on the map. Why?

Abstract (arXiv)

Graph self-supervised learning (GSSL) has demonstrated strong potential for generating expressive graph embeddings without the need for human annotations, making it particularly valuable in domains with high labeling costs such as molecular graph analysis. However, existing GSSL methods mostly focus on node- or edge-level information, often ignoring chemically relevant substructures which strongly influence molecular properties. In this work, we propose Graph Semantic Predictive Network (GraSPNet), a hierarchical self-supervised framework that explicitly models both atomic-level and fragment-level semantics. GraSPNet decomposes molecular graphs into chemically meaningful fragments without predefined vocabularies and learns node- and fragment-level representations through multi-level message passing with masked semantic prediction at both levels. This hierarchical semantic supervision enables GraSPNet to learn multi-resolution structural information that is both expressive and transferable. Extensive experiments on multiple molecular property prediction benchmarks demonstrate that GraSPNet learns chemically meaningful representations and consistently outperforms state-of-the-art GSSL methods in transfer learning settings.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 61 references that are in the map. First posted on arXiv 23 Feb 2026.

Builds on

38 of 61 references.

References · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2017Inductive Representation Learning on Large Graphscited by 6,284
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  8. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  9. 2016Variational Graph Auto-Encoderscited by 1,373
  10. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  11. 2018Deep Graph Infomaxcited by 1,101
  12. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
26 more
  1. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  2. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  3. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  4. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  5. 2021Graph Contrastive Learning Automatedcited by 287
  6. 2020Hierarchical Generation of Molecular Graphs using Structural Motifscited by 204
  7. 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
  8. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
  9. 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 138
  10. 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 131
  11. 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
  12. 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
  13. 2019A Gentle Introduction to Deep Learning for Graphscited by 107
  14. 2019Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learningcited by 94
  15. 2022What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoderscited by 82
  16. 2024Learning and Leveraging World Models in Visual Representation Learningcited by 71
  17. 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
  18. 2020RetroXpert: Decompose Retrosynthesis Prediction like a Chemistcited by 66
  19. 2022Graph-based Molecular Representation Learningcited by 51
  20. 2023A-JEPA: Joint-Embedding Predictive Architecture Can Listencited by 50
  21. 2023Rethinking Tokenizer and Decoder in Masked Graph Modeling for Moleculescited by 49
  22. 2021DPT: Deformable Patch-based Transformer for Visual Recognitioncited by 43
  23. 2019Graph Attention Auto-Encoderscited by 41
  24. 2020SAIL: Self-Augmented Graph Contrastive Learningcited by 20
  25. 2024Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneckcited by 11
  26. 2024Expressivity and Generalization: Fragment-Biases for Molecular GNNscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.