# Aiming for Relevance

arXiv: https://arxiv.org/abs/2403.18668 · HTML: https://mlsanity.com/paper/2403.18668/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 2 of its 12 references that are in the map.
- First posted on arXiv 27 Mar 2024.

## Builds on (most cited first, 2 of 2)

- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [Using Deep Networks for Scientific Discovery in Physiological Signals](https://mlsanity.com/paper/2008.10936/) (2020)

## Built on by (most cited first, 1 of 1)

- [INSIGHTS: Demonstration-Based Summaries of Time Series Predictors](https://mlsanity.com/paper/2605.18849/) (2026)

## Abstract (arXiv)

Vital signs are crucial in intensive care units (ICUs). They are used to track the patient's state and to identify clinically significant changes. Predicting vital sign trajectories is valuable for early detection of adverse events. However, conventional machine learning metrics like RMSE often fail to capture the true clinical relevance of such predictions. We introduce novel vital sign prediction performance metrics that align with clinical contexts, focusing on deviations from clinical norms, overall trends, and trend deviations. These metrics are derived from empirical utility curves obtained in a previous study through interviews with ICU clinicians. We validate the metrics' usefulness using simulated and real clinical datasets (MIMIC and eICU). Furthermore, we employ these metrics as loss functions for neural networks, resulting in models that excel in predicting clinically significant events. This research paves the way for clinically relevant machine learning model evaluation and optimization, promising to improve ICU patient care. 10 pages, 9 figures.