EpiBench: Can LLMs Understand Epitopes for Antibody Drug Discovery?
Not on the map. Why?
Abstract (arXiv)
Epitopes determine where antibodies bind antigens and shape downstream therapeutic properties such as functional blockade and escape resistance, making epitope understanding central to antibody drug discovery. Although large language models (LLMs) have shown strong biomedical reasoning ability, it remains unclear whether they can infer epitope information directly from antigen and antibody sequences. Existing epitope resources typically focus on isolated prediction tasks or rely on specialized structural settings, while general protein benchmarks do not evaluate epitope-centered decisions across the antibody development workflow. To address this gap, we introduce EpiBench, a closed-book, sequence-based, and automatically scorable benchmark for evaluating epitope reasoning in LLMs. EpiBench contains 1,609 curated samples grounded in structural antibody--antigen contacts, curated functional B-cell assays, and deep mutational scanning escape measurements. It covers five connected tasks: targetable region discovery, antibody-conditioned epitope identification, epitope binning, functional epitope assessment, and antibody escape assessment, with controlled sampling to reduce shortcut-based evaluation artifacts. We evaluate nine general-purpose LLMs and analyze their behavior through task-specific baselines, antigen length stratification, explicit-reasoning comparison, and failure-mode inspection. The results show that current LLMs capture partial epitope-related signals but remain limited in antibody-specific sequence grounding, long-context residue localization, and biologically grounded reasoning. Therefore, EpiBench provides a diagnostic testbed for measuring and improving sequence-aware biomedical LLMs toward reliable LLM-assisted antibody discovery.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 46 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
15 of 46 references.
References · 15
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2019Evaluating Protein Transfer Learning with TAPEcited by 231
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 159
- 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 133
- 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 79
- 2022PEER: A Comprehensive and Multi-Task Benchmark for Protein Sequence Understandingcited by 77
- 2020ATOM3D: Tasks On Molecules in Three Dimensionscited by 74
- 2024ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Trainingcited by 21
- 2024Hotspot-Driven Peptide Design via Multi-Fragment Autoregressive Extensioncited by 9
- 2024AsEP: Benchmarking Deep Learning Methods for Antibody-specific Epitope Predictioncited by 8
- 2025AbBiBench: A Benchmark for Antibody Binding Affinity Maturation and Designcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Computational Modeling of Antibody-Antigen Complexes: PLM-Based and MSA-Based Approaches
- 2026Multimodal reasoning for broadly neutralizing antibody discovery from label-free human B cell repertoires across virus families
- 2026Antigen-specific Antibody Multi-modal Foundation Model for Functional Antibody Design
- 2025Antibody Design and Optimization with Multi-scale Equivariant Graph Diffusion Models for Accurate Complex Antigen Binding
- 2025Guided Sequence-Structure Generative Modeling for Iterative Antibody Optimization
- 2023Stable Online and Offline Reinforcement Learning for Antibody CDRH3 Design
- 2026Conditional generation of antibody sequences with classifier-guided germline-absorbing discrete diffusion
- 2026ABOPD: Antibody CDR Design via On-Policy Distillation