mlsanityData to 14 Oct 2026

Enhancing Safe and Controllable Protein Generation via Knowledge Preference Optimization

arXiv 2507.10923 ↗First posted 15 Jul 2025cs.AIcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Preference optimization for molecular design

Abstract (arXiv)

Protein language models have emerged as powerful tools for sequence generation, offering substantial advantages in functional optimization and denovo design. However, these models also present significant risks of generating harmful protein sequences, such as those that enhance viral transmissibility or evade immune responses. These concerns underscore critical biosafety and ethical challenges. To address these issues, we propose a Knowledge-guided Preference Optimization (KPO) framework that integrates prior knowledge via a Protein Safety Knowledge Graph. This framework utilizes an efficient graph pruning strategy to identify preferred sequences and employs reinforcement learning to minimize the risk of generating harmful proteins. Experimental results demonstrate that KPO effectively reduces the likelihood of producing hazardous sequences while maintaining high functionality, offering a robust safety assurance framework for applying generative models in biotechnology.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Preference optimization for molecular design, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 11 of its 42 references that are in the map. First posted on arXiv 15 Jul 2025.

Builds on

11 of 42 references.

References · 11

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  4. 2019Machine Unlearningcited by 1,061
  5. 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 463
  6. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 437
  7. 2022Quark: Controllable Text Generation with Reinforced Unlearningcited by 237
  8. 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 224
  9. 2020BERTology Meets Biology: Interpreting Attention in Protein Language Modelscited by 85
  10. 2022OntoProtein: Protein Pretraining With Gene Ontology Embeddingcited by 70
  11. 2023InstructProtein: Aligning Human and Protein Language via Knowledge Instructioncited by 28

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Blind Spot in Alignment: Quantifying Biosecurity Risks in Large Language Models
  2. 2024Reinforcement Learning for Sequence Design Leveraging Protein Language Models
  3. 2026MolSafeEval: A Benchmark for Uncovering Safety Risks in AI-Generated Molecules
  4. 2025Controllable Protein Sequence Generation with LLM Preference Optimization
  5. 2026Two-Stage Fine-Tuning for Protein Sequence Generation with Targeted Amino-Acid Composition
  6. 2026Be Your Own Teacher: Steering Protein Language Models via Unsupervised Reward Optimization
  7. 2025g-DPO: Scalable Preference Optimization for Protein Language Models
  8. 2026ProteinOPD: Towards Effective and Efficient Preference Alignment for Protein Design