mlsanityData to 14 Oct 2026

MoTIF-X: A Multimodal Tokenized Framework for Interpretable and Extensible Molecular Representation Learning

arXiv 2609.37384 ↗First posted 29 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Molecular representation learning is central to computer-aided drug discovery. Molecular graphs, SMILES strings, and 3D conformations provide complementary structural information, yet many multimodal approaches encode these views independently and align them only at a later stage, limiting fine-grained cross-modal interaction and substructure-level interpretability. To address these limitations, we introduce MoTIF-X, a motif-centered framework that uses graph-grounded chemical motifs as shared anchors for multimodal integration and interpretation. Its first pretraining stage learns motif representations through hierarchical contrastive learning across atomic, motif, and molecular scales. The second stage contextualizes these representations with SMILES and torsion-angle tokens through multimodal masked token modeling. After pretraining on drug-like molecules with multiple conformers, MoTIF-X achieved the lowest mean absolute error on all nine OpenADMET ExpansionRx endpoints and the best overall performance among the evaluated methods. Significance analyses supported its advantage in the vast majority of endpoint-baseline comparisons after multiple-testing correction. Ablation studies supported the complementary contributions of motif-token contextualization, multimodal integration, and two-stage pretraining. Beyond molecular properties, the framework extended to drug-target interaction prediction, achieving the best average classification performance across the evaluated benchmarks and generalizing to an external drug-cold-start dataset without additional fine-tuning. Its motif-centered design also enabled substructure-level interpretation: higher motif attribution scores were associated with larger experimentally measured activity shifts. Together, these findings support MoTIF-X as a transferable and interpretable framework for molecular modeling.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 44 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

19 of 44 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2018How Powerful are Graph Neural Networks?cited by 4,393
  3. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  4. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  5. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  6. 2021E(n) Equivariant Graph Neural Networkscited by 965
  7. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 264
  8. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  9. 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 243
  10. 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 229
  11. 2018DeepDTA: Deep Drug-Target Binding Affinity Predictioncited by 173
  12. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
7 more
  1. 2020MolTrans: Molecular Interaction Transformer for Drug Target Interaction Predictioncited by 65
  2. 2021MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graphcited by 65
  3. 2021Molecule Generation by Principal Subgraph Mining and Assemblingcited by 54
  4. 2018DeepConv-DTI: Prediction of drug-target interactions via deep learning with convolution on protein sequencescited by 46
  5. 2023Fragment-based Pretraining and Finetuning on Molecular Graphscited by 20
  6. 2022Molecular Joint Representation Learning via Multi-modal Informationcited by 8
  7. 2021Machine learning modeling of family wide enzyme-substrate specificity screenscited by 2

Built on by

Not cited yet.