Building a Multivariate Time Series Benchmarking Datasets Inspired by Natural Language Processing (NLP)
Not on the map. Why?
Abstract (arXiv)
Time series analysis has become increasingly important in various domains, and developing effective models relies heavily on high-quality benchmark datasets. Inspired by the success of Natural Language Processing (NLP) benchmark datasets in advancing pre-trained models, we propose a new approach to create a comprehensive benchmark dataset for time series analysis. This paper explores the methodologies used in NLP benchmark dataset creation and adapts them to the unique challenges of time series data. We discuss the process of curating diverse, representative, and challenging time series datasets, highlighting the importance of domain relevance and data complexity. Additionally, we investigate multi-task learning strategies that leverage the benchmark dataset to enhance the performance of time series models. This research contributes to the broader goal of advancing the state-of-the-art in time series modeling by adopting successful strategies from the NLP domain.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 14 Oct 2024.
Builds on
15 of 32 references.
References · 15
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2018Deep contextualized word representationscited by 2,290
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 410
- 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 339
- 2020Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progresscited by 151
- 2022N-HiTS: Neural Hierarchical Interpolation for Time Series Forecastingcited by 146
Built on by
Not cited yet.