FragmentNet: Adaptive Graph Fragmentation for Graph-to-Sequence Molecular Representation Learning
Not on the map. Why?
Abstract (arXiv)
Molecular representation learning methods typically tokenize molecules as individual atoms or use rigid, rule-based fragment decompositions, limiting their ability to capture meaningful chemical substructure context. We introduce FragmentNet, a graph-to-sequence model built around a novel adaptive, learned tokenizer that decomposes molecular graphs into chemically valid fragments of adjustable granularity, complemented by chemically aware spatial positional encodings that preserve molecular topology in the resulting sequence. Extending masked pre-training strategies from natural language processing to the molecular domain, we mask and reconstruct molecules at the level of chemically meaningful fragments rather than individual atoms. Evaluating across multiple property prediction benchmarks, we find that pre-training at fragment granularity leads to improved downstream performance on the majority of tasks, demonstrating that tokenization granularity is an important design choice for molecular representation learning.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 3 Feb 2025.
Builds on
13 of 28 references.
References · 13
- 2017Attention Is All You Needcited by 59,932
- 2017Neural Discrete Representation Learningcited by 4,650
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
- 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 225
- 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 203
- 2020Graph-Bert: Only Attention is Needed for Learning Graph Representationscited by 176
- 2022Should You Mask 15% in Masked Language Modeling?cited by 117
- 2023Rethinking Tokenizer and Decoder in Masked Graph Modeling for Moleculescited by 49
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.