Unsupervised Feature Based Algorithms for Time Series Extrinsic Regression
Not on the map. Why?
Abstract (arXiv)
Time Series Extrinsic Regression (TSER) involves using a set of training time series to form a predictive model of a continuous response variable that is not directly related to the regressor series. The TSER archive for comparing algorithms was released in 2022 with 19 problems. We increase the size of this archive to 63 problems and reproduce the previous comparison of baseline algorithms. We then extend the comparison to include a wider range of standard regressors and the latest versions of TSER models used in the previous study. We show that none of the previously evaluated regressors can outperform a regression adaptation of a standard classifier, rotation forest. We introduce two new TSER algorithms developed from related work in time series classification. FreshPRINCE is a pipeline estimator consisting of a transform into a wide range of summary features followed by a rotation forest regressor. DrCIF is a tree ensemble that creates features from summary statistics over random intervals. Our study demonstrates that both algorithms, along with InceptionTime, exhibit significantly better performance compared to the other 18 regressors tested. More importantly, these two proposals (DrCIF and FreshPRINCE) models are the only ones that significantly outperform the standard rotation forest regressor.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 21 of its 83 references that are in the map. First posted on arXiv 2 May 2023.
Builds on
21 of 83 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
- 2018Deep learning for time series classification: a reviewcited by 575
- 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 386
- 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 358
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
- 2020Benchmarking Multivariate Time Series Classification Algorithmscited by 145
- 2022Liquid Structural State-Space Modelscited by 134
- 2021HIVE-COTE 2.0: a new meta ensemble for time series classificationcited by 118
- 2015Should we really use post-hoc tests based on mean-ranks?cited by 116
- 2019catch22: CAnonical Time-series CHaracteristicscited by 103
9 more
- 2023Bake off redux: a review and experimental evaluation of recent time series classification algorithmscited by 99
- 2021MultiRocket: Multiple pooling operators and transformations for fast and effective time series classificationcited by 89
- 2013A Time Series Forest for Classification and Feature Extractioncited by 69
- 2020The Canonical Interval Forest (CIF) Classifier for Time Series Classificationcited by 48
- 2021The Temporal Dictionary Ensemble (TDE) Classifier for Time Series Classificationcited by 26
- 2022The FreshPRINCE: A Simple Transformation Based Pipeline Time Series Classifiercited by 18
- 2022Graph Neural Networks for Multivariate Time Series Regression with Application to Seismic Datacited by 15
- 2018Is rotation forest the best classifier for problems with continuous features?cited by 11
- 2016Online Decorrelation of Humidity and Temperature in Chemical Sensors for Continuous Monitoringcited by 8
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 1; 2026: 3.
9 papers.
- 2024aeon: a Python toolkit for learning from time seriescited by 46
- 2023An Approach to Multiple Comparison Benchmark Evaluations that is Stable Under Manipulation of the Comparate Setcited by 27
- 2023Finding Foundation Models for Time Series Classification with a PreText Taskcited by 4
- 2024LLM-ABBA: Understanding time series via symbolic approximationcited by 4
- 2026The Multiverse of Time Series Machine Learning: an Archive for Multivariate Time Series Classificationcited by 3
- 2023Convolutional and Deep Learning based techniques for Time Series Ordinal Classificationcited by 1
- 2026TS2TabPFN: Time Series Classification and Extrinsic Regression through Feature Extraction and a Tabular Foundation Modelcited by 1
- 2025When, How Long and How Much? Interpretable Neural Networks for Time Series Regression by Learning to Mask and Aggregatecited by 0
- 2026Statistical comparisons of time-series feature sets on classification taskscited by 0
- 2026TS2TabPFN: Time Series Classification and Extrinsic Regression through Feature Extraction and a Tabular Foundation Model4 Aug 2026
- 2026Statistical comparisons of time-series feature sets on classification tasks3 Aug 2026
- 2026The Multiverse of Time Series Machine Learning: an Archive for Multivariate Time Series Classification20 Mar 2026
- 2025When, How Long and How Much? Interpretable Neural Networks for Time Series Regression by Learning to Mask and Aggregate3 Dec 2025
- 2024LLM-ABBA: Understanding time series via symbolic approximation27 Nov 2024
- 2024aeon: a Python toolkit for learning from time series20 Jun 2024
- 2023Finding Foundation Models for Time Series Classification with a PreText Task24 Nov 2023
- 2023Convolutional and Deep Learning based techniques for Time Series Ordinal Classification16 Jun 2023
- 2023An Approach to Multiple Comparison Benchmark Evaluations that is Stable Under Manipulation of the Comparate Set19 May 2023