TRIDENT: Tri-Modal Molecular Representation Learning with Taxonomic Annotations and Local Correspondence
Not on the map. Why?
Abstract (arXiv)
Molecular property prediction aims to learn representations that map chemical structures to functional properties. While multimodal learning has emerged as a powerful paradigm to learn molecular representations, prior works have largely overlooked textual and taxonomic information of molecules for representation learning. We introduce TRIDENT, a novel framework that integrates molecular SMILES, textual descriptions, and taxonomic functional annotations to learn rich molecular representations. To achieve this, we curate a comprehensive dataset of molecule-text pairs with structured, multi-level functional annotations. Instead of relying on conventional contrastive loss, TRIDENT employs a volume-based alignment objective to jointly align tri-modal features at the global level, enabling soft, geometry-aware alignment across modalities. Additionally, TRIDENT introduces a novel local alignment objective that captures detailed relationships between molecular substructures and their corresponding sub-textual descriptions. A momentum-based mechanism dynamically balances global and local alignment, enabling the model to learn both broad functional semantics and fine-grained structure-function mappings. TRIDENT achieves state-of-the-art performance on 11 downstream tasks, demonstrating the value of combining SMILES, textual, and taxonomic functional annotations for molecular property prediction.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 28 of its 47 references that are in the map. First posted on arXiv 26 Jun 2025.
Builds on
28 of 47 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
- 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
- 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 370
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 264
- 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 206
- 2022Translation between Molecules and Natural Languagecited by 177
16 more
- 2023VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Datasetcited by 169
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
- 2023mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Videocited by 154
- 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 131
- 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
- 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
- 2023MolXPT: Wrapping Molecules with Text for Generative Pre-trainingcited by 81
- 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 68
- 2024BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuningcited by 54
- 2024Gramian Multimodal Representation Learning and Alignmentcited by 54
- 2023MolFM: A Multimodal Molecular Foundation Modelcited by 50
- 2023Accommodating Audio Modality in CLIP for Multimodal Processingcited by 18
- 2022Improving Small Molecule Generation using Mutual Information Machinecited by 10
- 2024Compositional Image Retrieval via Instruction-Aware Contrastive Learningcited by 8
- 2025GoBERT: Gene Ontology Graph Informed BERT for Universal Gene Function Predictioncited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2026PaperFit: Vision-in-the-Loop Typesetting Optimization for Scientific Documentscited by 1
- 2025GRAM-DTI: adaptive multimodal representation learning for drug target interaction predictioncited by 0
- 2026GLACIER: A Multimodal Student-Teacher Foundation Model for Molecular Property Predictioncited by 0
- 2026GLACIER: A Multimodal Student-Teacher Foundation Model for Molecular Property Prediction9 Jun 2026
- 2026PaperFit: Vision-in-the-Loop Typesetting Optimization for Scientific Documents11 May 2026
- 2025GRAM-DTI: adaptive multimodal representation learning for drug target interaction prediction26 Sep 2025