mlsanityData to 14 Oct 2026

Computational design of target-specific linear peptide binders with TransformerBeta

arXiv 2410.16302 ↗First posted 7 Oct 2024q-bio.BM cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The computational prediction and design of peptide binders targeting specific linear epitopes is crucial in biological and biomedical research, yet it remains challenging due to their highly dynamic nature and the scarcity of experimentally solved binding data. To address this problem, we built an unprecedentedly large-scale library of peptide pairs within stable secondary structures (beta sheets), leveraging newly available AlphaFold predicted structures. We then developed a machine learning method based on the Transformer architecture for the design of specific linear binders, in analogy to a language translation task. Our method, TransformerBeta, accurately predicts specific beta strand interactions and samples sequences with beta sheet-like molecular properties, while capturing interpretable physico-chemical interaction patterns. As such, it can propose specific candidate binders targeting linear epitope for experimental validation to inform protein design.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 96 references that are in the map. First posted on arXiv 7 Oct 2024.

Builds on

25 of 96 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  7. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  8. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  9. 2020Efficient Transformers: A Surveycited by 790
  10. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 772
  11. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
  12. 2021A Survey of Transformerscited by 401
13 more
  1. 2019Evaluating Protein Transfer Learning with TAPEcited by 231
  2. 2020ProGen: Language Modeling for Protein Generationcited by 128
  3. 2021Dive into Deep Learningcited by 111
  4. 2018Training Tips for the Transformer Modelcited by 85
  5. 2020BERTology Meets Biology: Interpreting Attention in Protein Language Modelscited by 85
  6. 2022Conditional Antibody Design as 3D Equivariant Graph Translationcited by 75
  7. 2022Formal Algorithms for Transformerscited by 72
  8. 2021Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformerscited by 43
  9. 2024Full-Atom Peptide Design based on Multi-modal Flow Matchingcited by 34
  10. 2024Antigen-Specific Antibody Design via Direct Energy-based Preference Optimizationcited by 30
  11. 2021TITAN: T Cell Receptor Specificity Prediction with Bimodal Attention Networkscited by 16
  12. 2022Generative power of a protein language model trained on multiple sequence alignmentscited by 9
  13. 2020Generative Capacity of Probabilistic Protein Sequence Modelscited by 6

Built on by

Not cited yet.