Harnessing Preference Optimisation in Protein LMs for Hit Maturation in Cell Therapy
On the map: LLM alignment / RLHF / preference optimisation → Preference optimization for molecular design
Abstract (arXiv)
Cell and immunotherapy offer transformative potential for treating diseases like cancer and autoimmune disorders by modulating the immune system. The development of these therapies is resource-intensive, with the majority of drug candidates failing to progress beyond laboratory testing. While recent advances in machine learning have revolutionised areas such as protein engineering, applications in immunotherapy remain limited due to the scarcity of large-scale, standardised datasets and the complexity of cellular systems. In this work, we address these challenges by leveraging a high-throughput experimental platform to generate data suitable for fine-tuning protein language models. We demonstrate how models fine-tuned using a preference task show surprising correlations to biological assays, and how they can be leveraged for few-shot hit maturation in CARs. This proof-of-concept presents a novel pathway for applying ML to immunotherapy and could generalise to other therapeutic modalities.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Preference optimization for molecular design, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 8 of its 36 references that are in the map. First posted on arXiv 2 Dec 2024.
Builds on
8 of 36 references.
References · 8
- 2017Attention Is All You Needcited by 59,932
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2020Contrastive Learning with Hard Negative Samplescited by 619
- 2023Statistical Rejection Sampling Improves Preference Optimizationcited by 321
- 2022DiffDock: Diffusion Steps, Twists, and Turns for Molecular Dockingcited by 307
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
- 2021Deciphering antibody affinity maturation with language models and weakly supervised learningcited by 52
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026An immune world model for multiscale forecasting and therapeutic hypothesis generation
- 2026Preference-based Antibody Expression Ranking: Scaling with Large-scale Weak Supervision
- 2026Genotype-Conditioned Molecular Generation via Evidence-Grounded Multi-Objective Latent Perturbation in Diffusion Models
- 2024AutoProteinEngine: A Large Language Model Driven Agent Framework for Multimodal AutoML in Protein Engineering
- 2025g-DPO: Scalable Preference Optimization for Protein Language Models
- 2023Stable Online and Offline Reinforcement Learning for Antibody CDRH3 Design
- 2025Learning from B Cell Evolution: Adaptive Multi-Expert Diffusion for Antibody Design via Online Optimization
- 2024Preference optimization of protein language models as a multi-objective binder design paradigm