mlsanityData to 7 Oct 2026

AdaMR: Adaptable Molecular Representation for Unified Pre-training Strategy

arXiv 2401.06166 ↗First posted 28 Dec 2023q-bio.BM cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose Adjustable Molecular Representation (AdaMR), a new large-scale uniform pre-training strategy for small-molecule drugs, as a novel unified pre-training strategy. AdaMR utilizes a granularity-adjustable molecular encoding strategy, which is accomplished through a pre-training job termed molecular canonicalization, setting it apart from recent large-scale molecular models. This adaptability in granularity enriches the model's learning capability at multiple levels and improves its performance in multi-task scenarios. Specifically, the substructure-level molecular representation preserves information about specific atom groups or arrangements, influencing chemical properties and functionalities. This proves advantageous for tasks such as property prediction. Simultaneously, the atomic-level representation, combined with generative molecular canonicalization pre-training tasks, enhances validity, novelty, and uniqueness in generative tasks. All of these features work together to give AdaMR outstanding performance on a range of downstream tasks. We fine-tuned our proposed pre-trained model on six molecular property prediction tasks (MoleculeNet datasets) and two generative tasks (ZINC250K datasets), achieving state-of-the-art (SOTA) results on five out of eight tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 3 of its 10 references that are in the map. First posted on arXiv 28 Dec 2023.

Builds on

3 of 10 references.

References · 3

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
  3. 2022Regression Transformer: Concurrent sequence regression and generation for molecular language modelingcited by 49

Built on by

Not cited yet.