Aligning Proteins and Language: A Foundation Model for Protein Retrieval
Not on the map. Why?
Abstract (arXiv)
This paper aims to retrieve proteins with similar structures and semantics from large-scale protein dataset, facilitating the functional interpretation of protein structures derived by structural determination methods like cryo-Electron Microscopy (cryo-EM). Motivated by the recent progress of vision-language models (VLMs), we propose a CLIP-style framework for aligning 3D protein structures with functional annotations using contrastive learning. For model training, we propose a large-scale dataset of approximately 200,000 protein-caption pairs with rich functional descriptors. We evaluate our model in both in-domain and more challenging cross-database retrieval on Protein Data Bank (PDB) and Electron Microscopy Data Bank (EMDB) dataset, respectively. In both cases, our approach demonstrates promising zero-shot retrieval performance, highlighting the potential of multimodal foundation models for structure-function understanding in protein biology.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 20 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
10 of 20 references.
References · 10
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
- 2021Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigmcited by 405
- 2023Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Followingcited by 192
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
- 2021Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reportscited by 80
- 2024Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiologycited by 45
- 2024Read Like a Radiologist: Efficient Vision-Language Model for 3D Medical Imaging Interpretationcited by 18
- 2018CliNER 2.0: Accessible and Accurate Clinical Concept Extractioncited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ProtAlign: Contrastive learning paradigm for Sequence and structure alignment
- 2025Rethinking Text-based Protein Understanding: Retrieval or LLM?
- 2025Understanding protein function with a multimodal retrieval-augmented foundation model
- 2025Structure-Aligned Protein Language Model
- 2026Protein Language Models Diverge from Natural Language: Comparative Analysis and Improved Inference
- 2024Aligning Large Language Models and Geometric Deep Models for Protein Representation
- 2024ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding
- 2026ProtStructQA: A Denotation Threshold in Protein Structural Reasoning