mlsanityData to 14 Oct 2026

Attention-Based Synthetic Data Generation for Calibration-Enhanced Survival Analysis: A Case Study for Chronic Kidney Disease Using Electronic Health Records

arXiv 2503.06096 ↗First posted 8 Mar 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Access to real-world healthcare data is limited by stringent privacy regulations and data imbalances, hindering advancements in research and clinical applications. Synthetic data presents a promising solution, yet existing methods often fail to ensure the realism, utility, and calibration essential for robust survival analysis. Here, we introduce Masked Clinical Modelling (MCM), an attention-based framework capable of generating high-fidelity synthetic datasets that preserve critical clinical insights, such as hazard ratios, while enhancing survival model calibration. Unlike traditional statistical methods like SMOTE and machine learning models such as VAEs, MCM supports both standalone dataset synthesis for reproducibility and conditional simulation for targeted augmentation, addressing diverse research needs. Validated on a chronic kidney disease electronic health records dataset, MCM reduced the general calibration loss over the entire dataset by 15%; and MCM reduced a mean calibration loss by 9% across 10 clinically stratified subgroups, outperforming 15 alternative methods. By bridging data accessibility with translational utility, MCM advances the precision of healthcare models, promoting more efficient use of scarce healthcare resources.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 109 references that are in the map. First posted on arXiv 8 Mar 2025.

Builds on

29 of 109 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  6. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  7. 2016Layer Normalizationcited by 5,669
  8. 2017Neural Discrete Representation Learningcited by 4,712
  9. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  10. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  11. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  12. 2016Improved Techniques for Training GANscited by 2,970
17 more
  1. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  2. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  3. 2016Generative Adversarial Text to Image Synthesiscited by 735
  4. 2016Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learningcited by 195
  5. 2021Deep Cox Mixtures for Survival Regressioncited by 44
  6. 2022The harm of class imbalance corrections for risk prediction models: illustration and simulation using logistic regressioncited by 28
  7. 2022The Health Gym: Synthetic Health-Related Datasets for the Development of Reinforcement Learning Algorithmscited by 19
  8. 2023SurvivalGAN: Generating Time-to-Event Data for Survival Analysiscited by 17
  9. 2022Generating Synthetic Clinical Data that Capture Class Imbalanced Distributions with Generative Adversarial Networks: Example using Antiretroviral Therapy for HIVcited by 12
  10. 2023Synthetic Health-related Longitudinal Data with Mixed-type Variables Generated using Diffusion Modelscited by 11
  11. 2024Synthetic Data: Revisiting the Privacy-Utility Trade-offcited by 7
  12. 2024Understanding The Effectiveness of Lossy Compression in Machine Learning Training Setscited by 6
  13. 2020Predicting cardiovascular risk from national administrative databases using a combined survival analysis and deep learning approachcited by 3
  14. 2024CK4Gen: A Knowledge Distillation Framework for Generating High-Utility Synthetic Survival Datasets in Healthcarecited by 3
  15. 2021Improving Prediction-Based Lossy Compression Dramatically via Ratio-Quality Modelingcited by 2
  16. 2024Masked Clinical Modelling: A Framework for Synthetic and Augmented Survival Data Generationcited by 2
  17. 2024Explainable Machine Learning System for Predicting Chronic Kidney Disease in High-Risk Cardiovascular Patientscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.