mlsanityData to 7 Oct 2026

Aligning Proteins and Language: A Foundation Model for Protein Retrieval

arXiv 2506.08023 ↗First posted 27 May 2025q-bio.BM cs.AI cs.CEcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper aims to retrieve proteins with similar structures and semantics from large-scale protein dataset, facilitating the functional interpretation of protein structures derived by structural determination methods like cryo-Electron Microscopy (cryo-EM). Motivated by the recent progress of vision-language models (VLMs), we propose a CLIP-style framework for aligning 3D protein structures with functional annotations using contrastive learning. For model training, we propose a large-scale dataset of approximately 200,000 protein-caption pairs with rich functional descriptors. We evaluate our model in both in-domain and more challenging cross-database retrieval on Protein Data Bank (PDB) and Electron Microscopy Data Bank (EMDB) dataset, respectively. In both cases, our approach demonstrates promising zero-shot retrieval performance, highlighting the potential of multimodal foundation models for structure-function understanding in protein biology.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 20 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

10 of 20 references.

References · 10

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
  4. 2021Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigmcited by 405
  5. 2023Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Followingcited by 192
  6. 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
  7. 2021Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reportscited by 80
  8. 2024Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiologycited by 45
  9. 2024Read Like a Radiologist: Efficient Vision-Language Model for 3D Medical Imaging Interpretationcited by 18
  10. 2018CliNER 2.0: Accessible and Accurate Clinical Concept Extractioncited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ProtAlign: Contrastive learning paradigm for Sequence and structure alignment
  2. 2025Rethinking Text-based Protein Understanding: Retrieval or LLM?
  3. 2025Understanding protein function with a multimodal retrieval-augmented foundation model
  4. 2025Structure-Aligned Protein Language Model
  5. 2026Protein Language Models Diverge from Natural Language: Comparative Analysis and Improved Inference
  6. 2024Aligning Large Language Models and Geometric Deep Models for Protein Representation
  7. 2024ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding
  8. 2026ProtStructQA: A Denotation Threshold in Protein Structural Reasoning