From Hazard Functions to Language Space: Cox-Supervised Distillation of Survival Risk into a Large Language Model
Not on the map. Why?
Abstract (arXiv)
We investigate whether information about time-to-event risk estimated by a Cox proportional hazards model can be transferred into a generative large language model. We propose a text-based survival modelling pipeline in which structured clinical covariates are converted into text prompts and a Qwen-based large language model is fine-tuned to generate patient-specific survival risk using Cox model predictions as a training target. Across GBSG2, ACTG320, and WHAS500, the model achieves competitive held-out discrimination and calibration despite being trained as a text-generation task rather than with a conventional survival-analysis loss. We further analyse the geometry of the model's hidden states, where t-SNE visualisations reveal smooth risk gradients in latent space, suggesting that the model represents survival risk as a continuous structure rather than isolated risk categories. Together, these findings suggest that large language models can internalise survival-risk structure while supporting calibrated prediction, providing a route towards time-to-event reasoning in language models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 44 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
10 of 44 references.
References · 10
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2024Qwen2 Technical Reportcited by 2,076
- 2021Datasets: A Community Library for Natural Language Processingcited by 526
- 2016DeepSurv: Personalized Treatment Recommender System Using A Cox Proportional Hazards Deep Neural Networkcited by 354
- 2022TabLLM: Few-shot Classification of Tabular Data with Large Language Modelscited by 273
- 2024CK4Gen: A Knowledge Distillation Framework for Generating High-Utility Synthetic Survival Datasets in Healthcarecited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025OncoReason: Structuring Clinical Reasoning in LLMs for Robust and Interpretable Survival Prediction
- 2025RiskAgent: Synergizing Language Models with Validated Tools for Evidence-Based Risk Prediction
- 2024Large Language Model Capabilities in Perioperative Risk Prediction and Prognostication
- 2026ViSTA: A Simple Bridge Extends Visual Alignment to Clinical Time-Series Understanding in Multimodal LLMs
- 2026CACSurv: Concordance-Aligned Comparative Learning with Large Language Models for Cancer Survival Prediction
- 2024AgentMD: Empowering Language Agents for Risk Prediction with Large-Scale Clinical Tool Learning
- 2026CURA: Clinical Uncertainty Risk Alignment for Language Model-Based Risk Prediction
- 2026Large Language Models as Unified Multimodal Learners for Clinical Prediction