Data-Driven Discovery of Feature Groups in Clinical Time Series
Not on the map. Why?
Abstract (arXiv)
Clinical time series data are critical for patient monitoring and predictive modeling. These time series are typically multivariate and often comprise hundreds of heterogeneous features from different data sources. The grouping of features based on similarity and relevance to the prediction task has been shown to enhance the performance of deep learning architectures. However, defining these groups a priori using only semantic knowledge is challenging, even for domain experts. To address this, we propose a novel method that learns feature groups by clustering weights of feature-wise embedding layers. This approach seamlessly integrates into standard supervised training and discovers the groups that directly improve downstream performance on clinically relevant tasks. We demonstrate that our method outperforms static clustering approaches on synthetic data and achieves performance comparable to expert-defined groups on real-world medical data. Moreover, the learned feature groups are clinically interpretable, enabling data-driven discovery of task-relevant relationships between variables.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 57 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
24 of 57 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2020Efficient Content-Based Sparse Attention with Routing Transformerscited by 471
- 2013Fast Computation of Wasserstein Barycenterscited by 216
- 2022On Embeddings for Numerical Features in Tabular Deep Learningcited by 186
- 2020Fast Transformers with Clustered Attentioncited by 123
- 2014Generalized Product of Experts for Automatic and Principled Fusion of Gaussian Process Predictionscited by 67
- 2019ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare Contextcited by 56
12 more
- 2021GroupFormer: Group Activity Recognition with Clustered Spatial-Temporal Transformercited by 54
- 2021HiRID-ICU-Benchmark -- A Comprehensive Machine Learning Benchmark on High-resolution ICU Datacited by 39
- 2023Yet Another ICU Benchmark: A Flexible Multi-Center Framework for Clinical MLcited by 29
- 2022Temporal Label Smoothing for Early Event Predictioncited by 12
- 2022Composite Feature Selection using Deep Ensemblescited by 11
- 2024Intrinsic User-Centric Interpretability through Global Mixture of Expertscited by 9
- 2021A Novel Cluster Detection of COVID-19 Patients and Medical Disease Conditions Using Improved Evolutionary Clustering Algorithm Starcited by 5
- 2023On the Importance of Step-wise Embeddings for Heterogeneous Clinical Time-Seriescited by 5
- 2024Dynamic Survival Analysis for Early Event Predictioncited by 5
- 2022Unsupervised EHR-based Phenotyping via Matrix and Tensor Decompositionscited by 4
- 2024Towards Foundation Models for Critical Care Time Seriescited by 4
- 2025Failure Modes of Time Series Interpretability Algorithms for Critical Care Applications and Potential Solutionscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.