Generative modeling, design and analysis of spider silk protein sequences for enhanced mechanical properties
Not on the map. Why?
Abstract (arXiv)
Spider silks are remarkable materials characterized by superb mechanical properties such as strength, extensibility and lightweightedness. Yet, to date, limited models are available to fully explore sequence-property relationships for analysis and design. Here we propose a custom generative large-language model to enable design of novel spider silk protein sequences to meet complex combinations of target mechanical properties. The model, pretrained on a large set of protein sequences, is fine-tuned on ~1,000 major ampullate spidroin (MaSp) sequences for which associated fiber-level mechanical properties exist, to yield an end-to-end forward and inverse generative strategy. Performance is assessed through: (1), a novelty analysis and protein type classification for generated spidroin sequences through BLAST searches, (2) property evaluation and comparison with similar sequences, (3) comparison of molecular structures, as well as, and (4) a detailed sequence motif analyses. We generate silk sequences with property combinations that do not exist in nature, and develop a deep understanding the mechanistic roles of sequence patterns in achieving overarching key mechanical properties (elastic modulus, strength, toughness, failure strain). The model provides an efficient approach to expand the silkome dataset, facilitating further sequence-structure analyses of silks, and establishes a foundation for synthetic silk design and optimization.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 11 of its 107 references that are in the map. First posted on arXiv 18 Sep 2023.
Builds on
11 of 107 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2023MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problemscited by 29
Built on by
Citing papers per year: 2024: 6; 2025: 2; 2026: 1.
9 papers.
- 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 69
- 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningcited by 64
- 2024X-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Molecular Designcited by 42
- 2024AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligencecited by 36
- 2026Autonomous Agents Coordinating Distributed Discovery Through Emergent Artifact Exchangecited by 11
- 2024Cephalo: Multi-Modal Vision-Language Models for Bio-Inspired Materials Analysis and Designcited by 9
- 2025Graph-Aware Isomorphic Attention for Adaptive Dynamics in Transformerscited by 7
- 2024Learning the rules of peptide self-assembly through data mining with large language modelscited by 5
- 2025Customizing Spider Silk: Generative Models with Mechanical Property Conditioning for Protein Engineeringcited by 0
- 2026Autonomous Agents Coordinating Distributed Discovery Through Emergent Artifact Exchange15 Mar 2026
- 2025Customizing Spider Silk: Generative Models with Mechanical Property Conditioning for Protein Engineering11 Apr 2025
- 2025Graph-Aware Isomorphic Attention for Adaptive Dynamics in Transformers4 Jan 2025
- 2024Learning the rules of peptide self-assembly through data mining with large language models8 Nov 2024
- 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilities5 Sep 2024
- 2024AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligence13 Jul 2024
- 2024Cephalo: Multi-Modal Vision-Language Models for Bio-Inspired Materials Analysis and Design29 May 2024
- 2024X-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Molecular Design11 Feb 2024
- 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learning27 Jan 2024