mlsanityData to 7 Oct 2026

Multiple-Resolution Tokenization for Time Series Forecasting with an Application to Pricing

arXiv 2407.03185 ↗First posted 3 Jul 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We propose a transformer architecture for time series forecasting with a focus on time series tokenisation and apply it to a real-world prediction problem from the pricing domain. Our architecture aims to learn effective representations at many scales across all available data simultaneously. The model contains a number of novel modules: a differentiated form of time series patching which employs multiple resolutions, a multiple-resolution module for time-varying known variables, a mixer-based module for capturing cross-series information, and a novel output head with favourable scaling to account for the increased number of tokens. We present an application of this model to a real world prediction problem faced by the markdown team at a very large retailer. On the experiments conducted our model outperforms in-house models and the selected existing deep learning architectures.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 3 Jul 2024.

Builds on

16 of 25 references.

References · 16

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  3. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  4. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  5. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  6. 2023A decoder-only foundation model for time-series forecastingcited by 650
  7. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  8. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
  9. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
  10. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
  11. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  12. 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 100
4 more
  1. 2022Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecastingcited by 54
  2. 2023Multi-resolution Time-Series Transformer for Long-term Forecastingcited by 41
  3. 2023Vision Transformers with Mixed-Resolution Tokenizationcited by 35
  4. 2022Promotheus: An End-to-End Machine Learning Framework for Optimizing Markdown in Online Fashion E-commercecited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.