mlsanityData to 7 Oct 2026

Self-Supervised Graph Learning with Hyperbolic Embedding for Temporal Health Event Prediction

arXiv 2106.04751 ↗First posted 9 Jun 2021cs.LG cs.AIcited by 15

Not on the map. Why?

Abstract (arXiv)

Electronic Health Records (EHR) have been heavily used in modern healthcare systems for recording patients' admission information to hospitals. Many data-driven approaches employ temporal features in EHR for predicting specific diseases, readmission times, or diagnoses of patients. However, most existing predictive models cannot fully utilize EHR data, due to an inherent lack of labels in supervised training for some temporal events. Moreover, it is hard for existing works to simultaneously provide generic and personalized interpretability. To address these challenges, we first propose a hyperbolic embedding method with information flow to pre-train medical code representations in a hierarchical structure. We incorporate these pre-trained representations into a graph neural network to detect disease complications, and design a multi-level attention method to compute the contributions of particular diseases and admissions, thus enhancing personalized interpretability. We present a new hierarchy-enhanced historical prediction proxy task in our self-supervised learning framework to fully utilize EHR data and exploit medical domain knowledge. We conduct a comprehensive set of experiments and case studies on widely used publicly available EHR datasets to verify the effectiveness of our model. The results demonstrate our model's strengths in both predictive tasks and interpretable abilities.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 26 of its 56 references that are in the map. First posted on arXiv 9 Jun 2021.

Builds on

26 of 56 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  6. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  7. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
  8. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
  9. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  10. 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 515
  11. 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
  12. 2015Doctor AI: Predicting Clinical Events via Recurrent Neural Networkscited by 205
14 more
  1. 2020Low-Dimensional Hyperbolic Knowledge Graph Embeddingscited by 195
  2. 2016GRAM: Graph-based Attention Model for Healthcare Representation Learningcited by 152
  3. 2019Pre-training of Graph Augmented Transformers for Medication Recommendationcited by 124
  4. 2017Dipole: Diagnosis Prediction in Healthcare via Attention-based Bidirectional Recurrent Neural Networkscited by 114
  5. 2019Learning the Graphical Structure of Electronic Health Records with Graph Convolutional Transformercited by 88
  6. 2018Embedding Text in Hyperbolic Spacescited by 76
  7. 2018MiME: Multilevel Medical Embedding of Electronic Health Records for Predictive Healthcarecited by 72
  8. 2016Deepr: A Convolutional Net for Medical Recordscited by 59
  9. 2017Boosting Deep Learning Risk Prediction with Generative Adversarial Networks for Electronic Health Recordscited by 36
  10. 2020Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphscited by 35
  11. 2020Uncertainty-Aware Variational-Recurrent Imputation Network for Clinical Time Seriescited by 33
  12. 2021Collaborative Graph Learning with Auxiliary Text for Temporal Event Prediction in Healthcarecited by 30
  13. 2019TAPER: Time-Aware Patient EHR Representationcited by 22
  14. 2019Mixed Pooling Multi-View Attention Autoencoder for Representation Learning in Healthcarecited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 3; 2024: 2; 2025: 5; 2026: 4.

15 papers.

Sort:

By area:

  1. 2023GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphscited by 57
  2. 2022Multi-Label Clinical Time-Series Generation via Conditional GANcited by 16
  3. 2024Bridging Stepwise Lab-Informed Pretraining and Knowledge-Guided Learning for Diagnostic Reasoningcited by 3
  4. 2025Multi-Ontology Integration with Dual-Axis Propagation for Medical Concept Representationcited by 3
  5. 2023A Survey on Event Prediction Methods from a Systems Perspective: Bringing Together Disparate Research Areascited by 2
  6. 2023Multi-modal Graph Learning over UMLS Knowledge Graphscited by 2
  7. 2025Self-Explaining Hypergraph Neural Networks for Diagnosis Predictioncited by 2
  8. 2024MPLite: Multi-Aspect Pretraining for Mining Clinical Health Recordscited by 1
  9. 2025EEG-MedRAG: Enhancing EEG-based Clinical Decision-Making via Hierarchical Hypergraph Retrieval-Augmented Generationcited by 1
  10. 2026Exploring Accurate and Transparent Domain Adaptation in Predictive Healthcare via Concept-Grounded Orthogonal Inferencecited by 1
  11. 2026Text-Attributed Knowledge Graph Enrichment with Large Language Models for Medical Concept Representationcited by 1
  12. 2026HypEHR: Hyperbolic Modeling of Electronic Health Records for Efficient Question Answeringcited by 1
3 more
  1. 2025Adaptive Fuzzy Time Series Forecasting via Partially Asymmetric Convolution and Sub-Sliding Window Fusioncited by 0
  2. 2025Structure-aware Hypergraph Transformer for Diagnosis Prediction in Electronic Health Recordscited by 0
  3. 2026Risk Horizons: Structured Hypothesis Spaces for Longitudinal Clinical Predictioncited by 0