Multiple-Resolution Tokenization for Time Series Forecasting with an Application to Pricing
Not on the map. Why?
Abstract (arXiv)
We propose a transformer architecture for time series forecasting with a focus on time series tokenisation and apply it to a real-world prediction problem from the pricing domain. Our architecture aims to learn effective representations at many scales across all available data simultaneously. The model contains a number of novel modules: a differentiated form of time series patching which employs multiple resolutions, a multiple-resolution module for time-varying known variables, a mixer-based module for capturing cross-series information, and a novel output head with favourable scaling to account for the increased number of tokens. We present an application of this model to a real world prediction problem faced by the markdown team at a very large retailer. On the experiments conducted our model outperforms in-house models and the selected existing deep learning architectures.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 3 Jul 2024.
Builds on
16 of 25 references.
References · 16
- 2017Attention Is All You Needcited by 59,932
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 100
4 more
- 2022Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecastingcited by 54
- 2023Multi-resolution Time-Series Transformer for Long-term Forecastingcited by 41
- 2023Vision Transformers with Mixed-Resolution Tokenizationcited by 35
- 2022Promotheus: An End-to-End Machine Learning Framework for Optimizing Markdown in Online Fashion E-commercecited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.