mlsanityData to 14 Oct 2026

TimePerceiver: An Encoder-Decoder Framework for Generalized Time-Series Forecasting

arXiv 2512.22550 ↗First posted 27 Dec 2025cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

In machine learning, effective modeling requires a holistic consideration of how to encode inputs, make predictions (i.e., decoding), and train the model. However, in time-series forecasting, prior work has predominantly focused on encoder design, often treating prediction and training as separate or secondary concerns. In this paper, we propose TimePerceiver, a unified encoder-decoder forecasting framework that is tightly aligned with an effective training strategy. To be specific, we first generalize the forecasting task to include diverse temporal prediction objectives such as extrapolation, interpolation, and imputation. Since this generalization requires handling input and target segments that are arbitrarily positioned along the temporal axis, we design a novel encoder-decoder architecture that can flexibly perceive and adapt to these varying positions. For encoding, we introduce a set of latent bottleneck representations that can interact with all input segments to jointly capture temporal and cross-channel dependencies. For decoding, we leverage learnable queries corresponding to target timestamps to effectively retrieve relevant information. Extensive experiments demonstrate that our framework consistently and significantly outperforms prior state-of-the-art baselines across a wide range of benchmark datasets. The code is available at https://github.com/efficient-learning-lab/TimePerceiver.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 27 Dec 2025.

Builds on

27 of 39 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  7. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  8. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  9. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  10. 2020Object-Centric Learning with Slot Attentioncited by 876
  11. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  12. 2014Memory Networkscited by 363
15 more
  1. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  2. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
  3. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
  4. 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 104
  5. 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 101
  6. 2023CARD: Channel Aligned Robust Blend Transformer for Time Series Forecastingcited by 55
  7. 2023SegRNN: Segment Recurrent Neural Network for Long-Term Time Series Forecastingcited by 55
  8. 2023MSGNet: Learning Multi-Scale Inter-Series Correlations for Multivariate Time Series Forecastingcited by 50
  9. 2023CycleNet: Rethinking Cycle Consistency in Text-Guided Diffusion for Image Manipulationcited by 41
  10. 2023Learning to Embed Time Series Patches Independentlycited by 35
  11. 2023PatchMixer: A Patch-Mixing Architecture for Long-Term Time Series Forecastingcited by 20
  12. 2024Are Self-Attentions Effective for Time Series Forecasting?cited by 19
  13. 2024xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memoriescited by 19
  14. 2023SageFormer: Series-Aware Framework for Long-term Multivariate Time Series Forecastingcited by 10
  15. 2024Sequential Order-Robust Mamba for Time Series Forecastingcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.