mlsanityData to 7 Oct 2026

FARM: Enhancing Molecular Representations with Functional Group Awareness

arXiv 2410.02082 ↗First posted 2 Oct 2024cs.LG q-bio.QMcited by 2

Not on the map. Why?

Abstract (arXiv)

We introduce Functional Group-Aware Representations for Small Molecules (FARM), a novel foundation model designed to bridge the gap between SMILES, natural language, and molecular graphs. The key idea behind FARM is the incorporation of functional group (FG) annotations at the atomic level, enabling both FG-enhanced SMILES and FG graphs. In this representation, SMILES strings are enriched with functional group information that identifies the group membership of each atom, while the FG graph captures molecular structure by representing how functional groups are connected. This tokenization injects chemical knowledge into SMILES and expands the effective molecular vocabulary, making the representation more suitable for Transformer-based models and more aligned with natural language structure. FARM learns molecular representations from two complementary perspectives to jointly encode functional and structural information. Masked language modeling on FG-enhanced SMILES captures atom-level features enriched with functional context, while graph neural networks model higher-level molecular topology through functional group connectivity. Contrastive learning is then used to align these two views into a unified embedding space, ensuring that both atom-level detail and functional group structure are jointly represented. We evaluate FARM on the MoleculeNet benchmark and achieve state-of-the-art performance on 8 out of 13 tasks. We further validate its generalization ability on a photostability dataset for quantum mechanical properties. These results demonstrate that FARM improves molecular representation learning, supports strong transfer learning across drug discovery and materials science, and enables broad applications in pharmaceutical research and functional material design.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 44 references that are in the map. First posted on arXiv 2 Oct 2024.

Builds on

15 of 44 references.

References · 15

  1. 2017Graph Attention Networkscited by 8,854
  2. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  3. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  4. 2016Complex Embeddings for Simple Link Predictioncited by 897
  5. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  6. 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
  7. 2022Translation between Molecules and Natural Languagecited by 173
  8. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
  9. 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
  10. 2021Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphscited by 44
  11. 2021Chemical-Reaction-Aware Molecule Representation Learningcited by 36
  12. 2022Molecular Representation Learning via Heterogeneous Motif Graph Neural Networkscited by 23
3 more
  1. 2024L+M-24: Building a Dataset for Language + Molecules @ ACL 2024cited by 21
  2. 2023SynerGPT: In-Context Learning for Personalized Drug Synergy Prediction and Drug Designcited by 13
  3. 2022Motif-based Graph Representation Learning with Application to Chemical Moleculescited by 9

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.