mlsanityData to 14 Oct 2026

Multimodal Mixture-of-Experts with Retrieval Augmentation for Protein Active Site Identification

arXiv 2603.01511 ↗First posted 2 Mar 2026cs.AIcited by 1

On the map: Retrieval-augmented generation → Medical and biomedical RAG

also in 1 more
Abstract (arXiv)

Accurate identification of protein active sites at the residue level is crucial for understanding protein function and advancing drug discovery. However, current methods face two critical challenges: vulnerability in single-instance prediction due to sparse training data, and inadequate modality reliability estimation that leads to performance degradation when unreliable modalities dominate fusion processes. To address these challenges, we introduce Multimodal Mixture-of-Experts with Retrieval Augmentation (MERA), the first retrieval-augmented framework for protein active site identification. MERA employs hierarchical multi-expert retrieval that dynamically aggregates contextual information from chain, sequence, and active-site perspectives through residue-level mixture-of-experts gating. To prevent modality degradation, we propose a reliability-aware fusion strategy based on Dempster-Shafer evidence theory that quantifies modality trustworthiness through belief mass functions and learnable discounting coefficients, enabling principled multimodal integration. Extensive experiments on ProTAD-Gen and TS125 datasets demonstrate that MERA achieves state-of-the-art performance, with 90% AUPRC on active site prediction and significant gains on peptide-binding site identification, validating the effectiveness of retrieval-augmented multi-expert modeling and reliability-guided fusion.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 11 of its 42 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

11 of 42 references.

References · 11

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  2. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  3. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  4. 2021Scaling Vision with Sparse Mixture of Expertscited by 747
  5. 2019Deep Evidential Regressioncited by 355
  6. 2019Evaluating Protein Transfer Learning with TAPEcited by 231
  7. 2023ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Textscited by 78
  8. 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 49
  9. 2024Endowing Protein Language Models with Structural Knowledgecited by 11
  10. 2025Rethinking Text-based Protein Understanding: Retrieval or LLM?cited by 4
  11. 2025UniSite: The First Cross-Structure Dataset and Learning Framework for End-to-End Ligand Binding Site Detectioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026TriFit: Trimodal Fusion with Protein Dynamics for Mutation Fitness Prediction
  2. 2026Retrieval-Augmented Multimodal Learning for Enzyme-Substrate Interaction Prediction Under Low-Homology Shift
  3. 2025CAME-AB: Cross-Modality Attention with Mixture-of-Experts for Antibody Binding Site Prediction
  4. 2025A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery
  5. 2025Latent Retrieval Augmented Generation of Cross-Domain Protein Binders
  6. 2026BioMiner: A Multi-modal System for Automated Mining of Protein-Ligand Bioactivity Data from Literature
  7. 2025Understanding protein function with a multimodal retrieval-augmented foundation model
  8. 2026Multimodal Protein Language Models for Enzyme Kinetic Parameters: From Substrate Recognition to Conformational Adaptation