mlsanityData to 7 Oct 2026

From Hazard Functions to Language Space: Cox-Supervised Distillation of Survival Risk into a Large Language Model

arXiv 2606.08945 ↗First posted 8 Jun 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We investigate whether information about time-to-event risk estimated by a Cox proportional hazards model can be transferred into a generative large language model. We propose a text-based survival modelling pipeline in which structured clinical covariates are converted into text prompts and a Qwen-based large language model is fine-tuned to generate patient-specific survival risk using Cox model predictions as a training target. Across GBSG2, ACTG320, and WHAS500, the model achieves competitive held-out discrimination and calibration despite being trained as a text-generation task rather than with a conventional survival-analysis loss. We further analyse the geometry of the model's hidden states, where t-SNE visualisations reveal smooth risk gradients in latent space, suggesting that the model represents survival risk as a continuous structure rather than isolated risk categories. Together, these findings suggest that large language models can internalise survival-risk structure while supporting calibrated prediction, providing a route towards time-to-event reasoning in language models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 44 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

10 of 44 references.

References · 10

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  5. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  6. 2024Qwen2 Technical Reportcited by 2,076
  7. 2021Datasets: A Community Library for Natural Language Processingcited by 526
  8. 2016DeepSurv: Personalized Treatment Recommender System Using A Cox Proportional Hazards Deep Neural Networkcited by 354
  9. 2022TabLLM: Few-shot Classification of Tabular Data with Large Language Modelscited by 273
  10. 2024CK4Gen: A Knowledge Distillation Framework for Generating High-Utility Synthetic Survival Datasets in Healthcarecited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025OncoReason: Structuring Clinical Reasoning in LLMs for Robust and Interpretable Survival Prediction
  2. 2025RiskAgent: Synergizing Language Models with Validated Tools for Evidence-Based Risk Prediction
  3. 2024Large Language Model Capabilities in Perioperative Risk Prediction and Prognostication
  4. 2026ViSTA: A Simple Bridge Extends Visual Alignment to Clinical Time-Series Understanding in Multimodal LLMs
  5. 2026CACSurv: Concordance-Aligned Comparative Learning with Large Language Models for Cancer Survival Prediction
  6. 2024AgentMD: Empowering Language Agents for Risk Prediction with Large-Scale Clinical Tool Learning
  7. 2026CURA: Clinical Uncertainty Risk Alignment for Language Model-Based Risk Prediction
  8. 2026Large Language Models as Unified Multimodal Learners for Clinical Prediction