mlsanityData to 14 Oct 2026

Representing Outcome-driven Higher-order Dependencies in Graphs of Disease Trajectories

arXiv 2312.15353 ↗First posted 23 Dec 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The widespread application of machine learning techniques to biomedical data has produced many new insights into disease progression and improving clinical care. Inspired by the flexibility and interpretability of graphs (networks), as well as the potency of sequence models like transformers and higher-order networks (HONs), we propose a method that identifies combinations of risk factors for a given outcome and accurately encodes these higher-order relationships in a graph. Using historical data from 913,475 type 2 diabetes (T2D) patients, we found that, compared to other approaches, the proposed networks encode significantly more information about the progression of T2D toward a variety of outcomes. We additionally demonstrate how structural information from the proposed graph can be used to augment the performance of transformer-based models on predictive tasks, especially when the data are noisy. By increasing the order, or memory, of the graph, we show how the proposed method illuminates key risk factors while successfully ignoring noisy elements, which facilitates analysis that is simultaneously accurate and interpretable.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 43 references that are in the map. First posted on arXiv 23 Dec 2023.

Builds on

10 of 43 references.

References · 10

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Transformer Interpretability Beyond Attention Visualizationcited by 627
  4. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
  5. 2019BEHRT: Transformer for Electronic Health Recordscited by 263
  6. 2020A Survey of Label-noise Representation Learning: Past, Present and Futurecited by 122
  7. 2023Everything is Connected: Graph Neural Networkscited by 85
  8. 2013Memory in network flows and its effects on spreading dynamics and community detectioncited by 18
  9. 2015Representing higher-order dependencies in networkscited by 10
  10. 2022Deep Ensembles for Graphs with Higher-order Dependenciescited by 3

Built on by

Not cited yet.