mlsanityData to 7 Oct 2026

Deep sub-ensembles meets quantile regression: uncertainty-aware imputation for time series

arXiv 2312.01294 ↗First posted 3 Dec 2023cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Real-world time series data often exhibits substantial missing values, posing challenges for advanced analysis. A common approach to addressing this issue is imputation, where the primary challenge lies in determining the appropriate values to fill in. While previous deep learning methods have proven effective for time series imputation, they often produce overconfident imputations, which poses a potentially overlooked risk to the reliability of the intelligent system. Diffusion methods are proficient in estimating probability distributions but face challenges under a high missing rate and are, moreover, computationally expensive due to the nature of the generative model framework. In this paper, we propose Quantile Sub-Ensembles, a novel method that estimates uncertainty with ensembles of quantile-regression-based task networks and incorporate Quantile Sub-Ensembles into a non-generative time series imputation method. Our method not only produces accurate and reliable imputations, but also remains computationally efficient due to its non-generative framework. We conduct extensive experiments on five real-world datasets, and the results demonstrates superior performance in both deterministic and probabilistic imputation compared to baselines across most experimental settings. The code is available at https://github.com/yingliu-coder/QSE.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 66 references that are in the map. First posted on arXiv 3 Dec 2023.

Builds on

24 of 66 references.

References · 24

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  3. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  4. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  5. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  6. 2019Conformalized Quantile Regressioncited by 620
  7. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
  8. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
  9. 2017Distributional Reinforcement Learning with Quantile Regressioncited by 464
  10. 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 288
  11. 2022A Survey on Generative Diffusion Modelcited by 238
  12. 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 171
12 more
  1. 2022SAITS: Self-Attention-based Imputation for Time Seriescited by 167
  2. 2018High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approachcited by 117
  3. 2020Calibrated Reliable Regression using Maximum Mean Discrepancycited by 36
  4. 2020Uncertainty-Aware Variational-Recurrent Imputation Network for Clinical Time Seriescited by 33
  5. 2022Ensemble Conformalized Quantile Regression for Probabilistic Time Series Forecastingcited by 27
  6. 2023Provably Convergent Schr"odinger Bridge with Applications to Probabilistic Time Series Imputationcited by 26
  7. 2021Flexible Model Aggregation for Quantile Regressioncited by 22
  8. 2020Uncertainty-Aware Deep Ensembles for Reliable and Explainable Predictions of Clinical Time Seriescited by 13
  9. 2017Time Series Cluster Kernel for Learning Similarities between Multivariate Time Series with Missing Datacited by 11
  10. 2018Imputation of Clinical Covariates in Time Seriescited by 10
  11. 2020RDIS: Random Drop Imputation with Self-Training for Incomplete Time Series Datacited by 7
  12. 2021StackVAE-G: An efficient and interpretable model for time series anomaly detectioncited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.