mlsanityData to 14 Oct 2026

TRIDENT: Tri-Modal Molecular Representation Learning with Taxonomic Annotations and Local Correspondence

arXiv 2506.21028 ↗First posted 26 Jun 2025cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Molecular property prediction aims to learn representations that map chemical structures to functional properties. While multimodal learning has emerged as a powerful paradigm to learn molecular representations, prior works have largely overlooked textual and taxonomic information of molecules for representation learning. We introduce TRIDENT, a novel framework that integrates molecular SMILES, textual descriptions, and taxonomic functional annotations to learn rich molecular representations. To achieve this, we curate a comprehensive dataset of molecule-text pairs with structured, multi-level functional annotations. Instead of relying on conventional contrastive loss, TRIDENT employs a volume-based alignment objective to jointly align tri-modal features at the global level, enabling soft, geometry-aware alignment across modalities. Additionally, TRIDENT introduces a novel local alignment objective that captures detailed relationships between molecular substructures and their corresponding sub-textual descriptions. A momentum-based mechanism dynamically balances global and local alignment, enabling the model to learn both broad functional semantics and fine-grained structure-function mappings. TRIDENT achieves state-of-the-art performance on 11 downstream tasks, demonstrating the value of combining SMILES, textual, and taxonomic functional annotations for molecular property prediction.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 28 of its 47 references that are in the map. First posted on arXiv 26 Jun 2025.

Builds on

28 of 47 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  5. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  6. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  7. 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
  8. 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
  9. 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 370
  10. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 264
  11. 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 206
  12. 2022Translation between Molecules and Natural Languagecited by 177
16 more
  1. 2023VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Datasetcited by 169
  2. 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
  3. 2023mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Videocited by 154
  4. 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
  5. 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 131
  6. 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
  7. 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
  8. 2023MolXPT: Wrapping Molecules with Text for Generative Pre-trainingcited by 81
  9. 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 68
  10. 2024BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuningcited by 54
  11. 2024Gramian Multimodal Representation Learning and Alignmentcited by 54
  12. 2023MolFM: A Multimodal Molecular Foundation Modelcited by 50
  13. 2023Accommodating Audio Modality in CLIP for Multimodal Processingcited by 18
  14. 2022Improving Small Molecule Generation using Mutual Information Machinecited by 10
  15. 2024Compositional Image Retrieval via Instruction-Aware Contrastive Learningcited by 8
  16. 2025GoBERT: Gene Ontology Graph Informed BERT for Universal Gene Function Predictioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.