Patient-specific Biomolecular Instruction Tuning
Not on the map. Why?
Abstract (arXiv)
Proteomics data is essential to pathogenic understanding of a disease phenotype. In cancer, analysis of molecular signatures enables precision medicine through the identification of biological processes that drive individualized tumor progression, therapeutic resistance, and clinical heterogeneity. Recent advances in multimodal large language models (LLMs) have shown remarkable capacity to integrate and reason across heterogeneous data modalities. However, performing multi-modal language modeling for molecular understanding of patient-specific proteomics remains a significant challenge due to two barriers: (1) the lack of instruction-tuning datasets that enable clinical interpretation from proteomics data, and (2) the absence of language modeling architectures designed to capture the rich heterogeneity of molecular data. In this work, we introduce CPTAC-PROTSTRUCT, the first instruction tuning dataset for molecular understanding of oncology, comprising over 400k open-ended examples derived from individualized proteomic profiles curated from the largest national proteomics cancer study (CPTAC). Additionally, we propose KRONOS (Knowledge Representation of patient Omics Networks in Oncology via Structured tuning), a novel graph-LLM framework that leverages molecular interaction topology with proteomics to learn patient-specific graph representations for enhanced clinical reasoning. We show that KRONOS achieves competitive performance across benchmark clinical tasks, including molecular classification, temporal trajectory modeling, and tumor stage prediction from proteomics data. Ultimately, this approach empowers LLMs to understand patient-level pathogenesis, advancing precision medicine through more accurate diagnosis, prognosis, and treatment stratification.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 46 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
15 of 46 references.
References · 15
- 2017Graph Attention Networkscited by 8,923
- 2023Visual Instruction Tuningcited by 7,869
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2021Graph Representation Learning in Biomedicinecited by 80
- 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathologycited by 57
- 2024In-context learning enables multimodal large language models to classify cancer pathology imagescited by 38
- 2024MEIT: Multimodal Electrocardiogram Instruction Tuning on Large Language Models for Report Generationcited by 29
- 2024Tx-LLM: A Large Language Model for Therapeuticscited by 25
- 2023From Beginner to Expert: Modeling Medical Knowledge into General LLMscited by 14
3 more
- 2024Dr-LLaVA: Visual Instruction Tuning with Symbolic Clinical Groundingcited by 10
- 2024Structure-Enhanced Protein Instruction Tuning: Towards General-Purpose Protein Understanding with LLMscited by 4
- 2024BioMistral-NLU: Towards More Generalizable Medical Language Understanding through Instruction Tuningcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Scalable and Cross-Lingual Specialist Language Models for Oncology
- 2026Large Language Models Meet Biomedical Knowledge Graphs for Mechanistically Grounded Therapeutic Prioritization
- 2024Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research
- 2023CORAL: Expert-Curated medical Oncology Reports to Advance Language Model Inference
- 2026BreastGPT: A Multimodal Large Language Model for the Full Spectrum of Breast Cancer Clinical Routine
- 2025MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncology
- 2025CancerGUIDE: Cancer Guideline Understanding via Internal Disagreement Estimation
- 2026Clinical Knowledge Graph Construction and Evaluation with Multi-LLMs via Retrieval-Augmented Generation