mlsanityData to 7 Oct 2026

Gaussian Process Latent Variable Modeling for Few-shot Time Series Forecasting

arXiv 2212.10306 ↗First posted 20 Dec 2022cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Accurate time series forecasting is crucial for optimizing resource allocation, industrial production, and urban management, particularly with the growth of cyber-physical and IoT systems. However, limited training sample availability in fields like physics and biology poses significant challenges. Existing models struggle to capture long-term dependencies and to model diverse meta-knowledge explicitly in few-shot scenarios. To address these issues, we propose MetaGP, a meta-learning-based Gaussian process latent variable model that uses a Gaussian process kernel function to capture long-term dependencies and to maintain strong correlations in time series. We also introduce Kernel Association Search (KAS) as a novel meta-learning component to explicitly model meta-knowledge, thereby enhancing both interpretability and prediction accuracy. We study MetaGP on simulated and real-world few-shot datasets, showing that it is capable of state-of-the-art prediction accuracy. We also find that MetaGP can capture long-term dependencies and can model meta-knowledge, thereby providing valuable insights into complex time series patterns.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 72 references that are in the map. First posted on arXiv 20 Dec 2022.

Builds on

36 of 72 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  4. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  5. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  6. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  7. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  8. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  9. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  10. 2015Deep Kernel Learningcited by 440
  11. 2018The UCR Time Series Archivecited by 421
  12. 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
24 more
  1. 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
  2. 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
  3. 2015Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP)cited by 175
  4. 2016Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Datacited by 154
  5. 2017Doubly Stochastic Variational Inference for Deep Gaussian Processescited by 143
  6. 2013Gaussian Process Kernels for Pattern Discovery and Extrapolationcited by 131
  7. 2017A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learningcited by 107
  8. 2020Benchmarking Deep Learning Interpretability in Time Series Predictionscited by 102
  9. 2016Stochastic Variational Deep Kernel Learningcited by 92
  10. 2013Structure Discovery in Nonparametric Regression through Compositional Kernel Searchcited by 86
  11. 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
  12. 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Versioncited by 48
  13. 2014Automatic Construction and Natural-Language Description of Nonparametric Regression Modelscited by 40
  14. 2021Meta-Learning Dynamics Forecasting Using Task Inferencecited by 37
  15. 2021Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Versioncited by 35
  16. 2021Dynamic Gaussian Mixture based Deep Generative Model For Robust Forecasting on Sparse Multivariate Time Seriescited by 30
  17. 2017Spectral Mixture Kernels for Multi-Output Gaussian Processescited by 29
  18. 2021Which priors matter? Benchmarking models for learning latent dynamicscited by 26
  19. 2018Differentiable Compositional Kernel Learning for Gaussian Processescited by 23
  20. 2016Learning Scalable Deep Kernels with Recurrent Structurecited by 22
  21. 2017Scaling up the Automatic Statistician: Scalable Structure Discovery using Gaussian Processescited by 19
  22. 2020PDE-Driven Spatiotemporal Disentanglementcited by 19
  23. 2020Deep Sigma Point Processescited by 16
  24. 2022Generalised Gaussian Process Latent Variable Models (GPLVM) with Stochastic Variational Inferencecited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.