mlsanityData to 7 Oct 2026

SpectraNet: Multivariate Forecasting and Imputation under Distribution Shifts and Missing Data

arXiv 2210.12515 ↗First posted 22 Oct 2022cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

In this work, we tackle two widespread challenges in real applications for time-series forecasting that have been largely understudied: distribution shifts and missing data. We propose SpectraNet, a novel multivariate time-series forecasting model that dynamically infers a latent space spectral decomposition to capture current temporal dynamics and correlations on the recent observed history. A Convolution Neural Network maps the learned representation by sequentially mixing its components and refining the output. Our proposed approach can simultaneously produce forecasts and interpolate past observations and can, therefore, greatly simplify production systems by unifying imputation and forecasting tasks into a single model. SpectraNet achieves SoTA performance simultaneously on both tasks on five benchmark datasets, compared to forecasting and imputation models, with up to 92% fewer parameters and comparable training times. On settings with up to 80% missing data, SpectraNet has average performance improvements of almost 50% over the second-best alternative. Our code is available at https://github.com/cchallu/spectranet.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 22 Oct 2022.

Builds on

21 of 34 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  5. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  6. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  7. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  8. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  9. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
  10. 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
  11. 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 288
  12. 2019High-Dimensional Multivariate Forecasting with Low-Rank Gaussian Copula Processescited by 147
9 more
  1. 2022N-HiTS: Neural Hierarchical Interpolation for Time Series Forecastingcited by 146
  2. 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 120
  3. 2020Deep Learning for Time Series Forecasting: Tutorial and Literature Surveycited by 117
  4. 2020Learning Latent Space Energy-Based Prior Modelcited by 104
  5. 2017Dilated Recurrent Neural Networkscited by 83
  6. 2021Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSxcited by 63
  7. 2019NAOMI: Non-Autoregressive Multiresolution Sequence Imputationcited by 59
  8. 2022Deep Generative model with Hierarchical Latent Factors for Time Series Anomaly Detectioncited by 16
  9. 2021Generative Text Modeling through Short Run Inferencecited by 5

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.