MolTailor: Tailoring Chemical Molecular Representation to Specific Tasks via Text Prompts
Not on the map. Why?
Abstract (arXiv)
Deep learning is now widely used in drug discovery, providing significant acceleration and cost reduction. As the most fundamental building block, molecular representation is essential for predicting molecular properties to enable various downstream applications. Most existing methods attempt to incorporate more information to learn better representations. However, not all features are equally important for a specific task. Ignoring this would potentially compromise the training efficiency and predictive accuracy. To address this issue, we propose a novel approach, which treats language models as an agent and molecular pretraining models as a knowledge base. The agent accentuates task-relevant features in the molecular representation by understanding the natural language description of the task, just as a tailor customizes clothes for clients. Thus, we call this approach MolTailor. Evaluations demonstrate MolTailor's superior performance over baselines, validating the efficacy of enhancing relevance for molecular representation learning. This illustrates the potential of language model guided optimization to better exploit and unleash the capabilities of existing powerful molecular representation methods. Our code is available at https://github.com/SCIR-HI/MolTailor.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 21 Jan 2024.
Builds on
27 of 51 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
15 more
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
- 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 203
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
- 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
- 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 92
- 2023MolXPT: Wrapping Molecules with Text for Generative Pre-trainingcited by 81
- 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
- 2023Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human Languagecited by 44
- 2021Multilingual Molecular Representation Learning via Contrastive Pre-trainingcited by 12
- 2023From Artificially Real to Real: Leveraging Pseudo Data from Large Language Models for Low-Resource Molecule Discoverycited by 11
Built on by
Citing papers per year: 2024: 4; 2025: 2.
6 papers.
- 2025RAG-Enhanced Collaborative LLM Agents for Drug Discoverycited by 18
- 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Surveycited by 16
- 2024textttPatentAgent: Intelligent Agent for Automated Pharmaceutical Patent Analysiscited by 4
- 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Modelscited by 2
- 2024Adapting Differential Molecular Representation with Hierarchical Prompts for Multi-label Property Predictioncited by 0
- 2025Multi-Level Fusion Graph Neural Network for Molecule Property Predictioncited by 0
- 2025Multi-Level Fusion Graph Neural Network for Molecule Property Prediction4 Jul 2025
- 2025RAG-Enhanced Collaborative LLM Agents for Drug Discovery22 Feb 2025
- 2024textttPatentAgent: Intelligent Agent for Automated Pharmaceutical Patent Analysis25 Oct 2024
- 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Models19 Aug 2024
- 2024Adapting Differential Molecular Representation with Hierarchical Prompts for Multi-label Property Prediction29 May 2024
- 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Survey3 Mar 2024