mlsanityData to 7 Oct 2026

FragmentNet: Adaptive Graph Fragmentation for Graph-to-Sequence Molecular Representation Learning

arXiv 2502.01184 ↗First posted 3 Feb 2025cs.LG cs.AI physics.chem-phcited by 3

Not on the map. Why?

Abstract (arXiv)

Molecular representation learning methods typically tokenize molecules as individual atoms or use rigid, rule-based fragment decompositions, limiting their ability to capture meaningful chemical substructure context. We introduce FragmentNet, a graph-to-sequence model built around a novel adaptive, learned tokenizer that decomposes molecular graphs into chemically valid fragments of adjustable granularity, complemented by chemically aware spatial positional encodings that preserve molecular topology in the resulting sequence. Extending masked pre-training strategies from natural language processing to the molecular domain, we mask and reconstruct molecules at the level of chemically meaningful fragments rather than individual atoms. Evaluating across multiple property prediction benchmarks, we find that pre-training at fragment granularity leads to improved downstream performance on the majority of tasks, demonstrating that tokenization granularity is an important design choice for molecular representation learning.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 3 Feb 2025.

Builds on

13 of 28 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Neural Discrete Representation Learningcited by 4,650
  3. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  6. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  7. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
  8. 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 225
  9. 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 203
  10. 2020Graph-Bert: Only Attention is Needed for Learning Graph Representationscited by 176
  11. 2022Should You Mask 15% in Masked Language Modeling?cited by 117
  12. 2023Rethinking Tokenizer and Decoder in Masked Graph Modeling for Moleculescited by 49
1 more
  1. 2024UniCorn: A Unified Contrastive Learning Approach for Multi-view Molecular Representation Learningcited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.