mlsanityData to 14 Oct 2026

Deep Kernel Learning for Stratifying Glaucoma Trajectories

arXiv 2605.00708 ↗First posted 1 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Effectively stratifying patient risk in chronic diseases like glaucoma is a major clinical challenge. Clinicians need tools to identify patients at high risk of progression from sparse and irregularly-sampled electronic health records (EHRs). We propose a novel deep kernel learning (DKL) architecture that leverages a Gaussian Process (GP) backend. The GP's kernel is defined by a transformer-based feature extractor applied to clinical-BERT embeddings to model glaucoma patient trajectories from multimodal EHR data. Our method successfully identifies three clinically distinct patient subgroups. Crucially, the model learns to decouple disease progression from current severity, identifying a high-risk group with a worsening trajectory despite having better average visual acuity than a second, stably poor group. This reveals that the model learns to identify progression risk rather than just the current disease state. This ability to stratify patients based on their risk trajectory progression offers a powerful tool for clinical decision support, enabling targeted interventions for high-risk individuals and improving the management of glaucoma care.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 53 references that are in the map. First posted on arXiv 1 May 2026.

Builds on

33 of 53 references.

References · 33

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  6. 2018Neural Ordinary Differential Equationscited by 3,779
  7. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  8. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
  9. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 506
  10. 2022Transformers in Time Series: A Surveycited by 497
  11. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
  12. 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
21 more
  1. 2015Deep Kernel Learningcited by 445
  2. 2013Gaussian Processes for Big Datacited by 383
  3. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
  4. 2018Scalable and accurate deep learning for electronic health recordscited by 280
  5. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  6. 2020Transformer Hawkes Processcited by 235
  7. 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 231
  8. 2017Deep EHR: A Survey of Recent Advances in Deep Learning Techniques for Electronic Health Record (EHR) Analysiscited by 148
  9. 2021Transformer Embeddings of Irregularly Spaced Events and Their Participantscited by 93
  10. 2019Interpolation-Prediction Networks for Irregularly Sampled Time Seriescited by 89
  11. 2021The Promises and Pitfalls of Deep Kernel Learningcited by 81
  12. 2023Time Series as Images: Vision Transformer for Irregularly Sampled Time Seriescited by 79
  13. 2020Deep Representation Learning of Patient Data from Electronic Health Records (EHR): A Systematic Reviewcited by 47
  14. 2024A Comprehensive Survey of Deep Learning for Time Series Forecasting: Architectural Diversity and Open Challengescited by 47
  15. 2022Improving Medical Predictions by Irregular Multimodal Electronic Health Records Modelingcited by 33
  16. 2016Learning Scalable Deep Kernels with Recurrent Structurecited by 22
  17. 2018Modeling Irregularly Sampled Clinical Time Seriescited by 5
  18. 2016Disease Trajectory Mapscited by 4
  19. 2024TEE4EHR: Transformer Event Encoder for Better Representation Learning in Electronic Health Recordscited by 3
  20. 2023Efficient Bayesian Optimization with Deep Kernel Learning and Transformer Pre-trained on Multiple Heterogeneous Datasetscited by 2
  21. 2023Modeling Complex Disease Trajectories using Deep Generative Models with Semi-Supervised Latent Processescited by 2

Built on by

Not cited yet.