mlsanityData to 7 Oct 2026

TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysis

arXiv 2410.16032 ↗First posted 21 Oct 2024cs.LG cs.AIcited by 113

Not on the map. Why?

Abstract (arXiv)

Time series analysis plays a critical role in numerous applications, supporting tasks such as forecasting, classification, anomaly detection, and imputation. In this work, we present the time series pattern machine (TSPM), a model designed to excel in a broad range of time series tasks through powerful representation and pattern extraction capabilities. Traditional time series models often struggle to capture universal patterns, limiting their effectiveness across diverse tasks. To address this, we define multiple scales in the time domain and various resolutions in the frequency domain, employing various mixing strategies to extract intricate, task-adaptive time series patterns. Specifically, we introduce a general-purpose TSPM that processes multi-scale time series using (1) multi-resolution time imaging (MRTI), (2) time image decomposition (TID), (3) multi-scale mixing (MCM), and (4) multi-resolution mixing (MRM) to extract comprehensive temporal patterns. MRTI transforms multi-scale time series into multi-resolution time images, capturing patterns across both temporal and frequency domains. TID leverages dual-axis attention to extract seasonal and trend patterns, while MCM hierarchically aggregates these patterns across scales. MRM adaptively integrates all representations across resolutions. This method achieves state-of-the-art performance across 8 time series analytical tasks, consistently surpassing both general-purpose and task-specific models. Our work marks a promising step toward the next generation of TSPMs, paving the way for further advancements in time series analysis.

Key facts. Cited by 113 papers in the map (data through 7 Oct 2026). Builds on 42 of its 67 references that are in the map. First posted on arXiv 21 Oct 2024.

Builds on

42 of 67 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  7. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  8. 2020Reformer: The Efficient Transformercited by 1,658
  9. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  10. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  11. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  12. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
30 more
  1. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  2. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  3. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  4. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  5. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  6. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  7. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 407
  8. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 387
  9. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  10. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
  11. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  12. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  13. 2018The UEA multivariate time series classification archive, 2018cited by 330
  14. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
  15. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
  16. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
  17. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
  18. 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 170
  19. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
  20. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  21. 2022N-HiTS: Neural Hierarchical Interpolation for Time Series Forecastingcited by 146
  22. 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 146
  23. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
  24. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 110
  25. 2022Flowformer: Linearizing Transformers with Conservation Flowscited by 69
  26. 2023MTS-Mixers: Multivariate Time Series Forecasting via Factorized Temporal and Channel Mixingcited by 52
  27. 2023TFDNet: Time-Frequency Enhanced Decomposed Network for Long-term Time Series Forecastingcited by 7
  28. 2023Full Scaling Automation for Sustainable Development of Green Data Centerscited by 5
  29. 2022End-to-End Modeling Hierarchical Time Series Using Autoregressive Transformer and Conditional Normalizing Flow based Reconciliationcited by 4
  30. 2024Multiscale Representation Enhanced Temporal Flow Fusion Model for Long-Term Workload Forecastingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 53; 2026: 56.

113 papers.

Sort:

By area:

  1. 2025Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecastingcited by 59
  2. 2025Aurora: Towards Universal Generative Multimodal Time Series Forecastingcited by 28
  3. 2025Harnessing Vision Models for Time Series Analysis: A Surveycited by 26
  4. 2025OLinear: A Linear Model for Time Series Forecasting in Orthogonally Transformed Domaincited by 25
  5. 2025TimeOmni-1: Incentivizing Complex Reasoning with Time Series in Large Language Modelscited by 24
  6. 2024xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memoriescited by 18
  7. 2025Multi-Scale Finetuning for Encoder-based Time Series Foundation Modelscited by 13
  8. 2025SciTS: Scientific Time Series Understanding and Generation with LLMscited by 13
  9. 2025TimeMosaic: Temporal Heterogeneity Guided Time Series Forecasting via Adaptive Granularity Patch and Segment-wise Decodingcited by 12
  10. 2025FeDaL: Federated Dataset Learning for General Time Series Foundation Modelscited by 10
  11. 2025Vision-Enhanced Time Series Forecasting via Latent Diffusion Modelscited by 9
  12. 2026EEO-TFV: Escape-Explore Optimizer for Web-Scale Time-Series Forecasting and Vision Analysiscited by 9
38 more
  1. 2025Multimodal Conditioned Diffusive Time Series Forecastingcited by 8
  2. 2025TimeRecipe: A Time-Series Forecasting Recipe via Benchmarking Module Level Effectivenesscited by 6
  3. 2025Multi-Order Wavelet Derivative Transform for Deep Time Series Forecastingcited by 4
  4. 2025OKG-LLM: Aligning Ocean Knowledge Graph with Observation Data via LLMs for Global Sea Surface Temperature Predictioncited by 4
  5. 2025Exploring Accuracy Law for Deep Time Series Forecasters: An Empirical Studycited by 4
  6. 2026SEMixer: Semantics Enhanced MLP-Mixer for Multiscale Mixing and Long-term Time Series Forecastingcited by 4
  7. 2026TimeOmni-VL: Unified Models for Time Series Understanding and Generationcited by 4
  8. 2026Unlocking the Value of Text: Event-Driven Reasoning and Multi-Level Alignment for Time Series Forecastingcited by 4
  9. 2024Dataset-Driven Channel Masks in Transformers for Multivariate Time Seriescited by 3
  10. 2024Disentangled Parameter-Efficient Linear Model for Long-Term Time Series Forecastingcited by 3
  11. 2025MoFE-Time: Mixture of Frequency Domain Experts for Time-Series Forecasting Modelscited by 3
  12. 2025FreDN: Spectral Disentanglement for Time Series Forecasting via Learnable Frequency Decompositioncited by 3
  13. 2025IdealTSF: Can Non-Ideal Data Contribute to Enhancing the Performance of Time Series Forecasting Models?cited by 3
  14. 2026MambaSL: Exploring Single-Layer Mamba for Time Series Classificationcited by 3
  15. 2025BrainNetMLP: An Efficient and Effective Baseline for Functional Brain Network Classificationcited by 2
  16. 2025Semantic-Enhanced Time-Series Forecasting via Large Language Modelscited by 2
  17. 2025PENGUIN: Enhancing Transformer with Periodic-Nested Group Attention for Long-term Time Series Forecastingcited by 2
  18. 2025Task-Aware Mixture-of-Experts for Time Series Analysiscited by 2
  19. 2025FADTI: Fourier and Attention Driven Diffusion for Multivariate Time Series Imputationcited by 2
  20. 2026TimeMar: Multi-Scale Autoregressive Modeling for Unconditional Time Series Generationcited by 2
  21. 2026PHAT: Modeling Period Heterogeneity for Multivariate Time Series Forecastingcited by 2
  22. 2026How (Not) to Hybridize Neural and Mechanistic Models for Epidemiological Forecastingcited by 2
  23. 2026Enhancing Multivariate Time Series Forecasting with Global Temporal Retrievalcited by 2
  24. 2026T1: One-to-One Channel-Head Binding for Multivariate Time-Series Imputationcited by 2
  25. 2026Seeking SOTA: Time-Series Forecasting Must Adopt Taxonomy-Specific Evaluation to Dispel Illusory Gainscited by 2
  26. 2024Domain Fusion Controllable Generalization for Cross-Domain Time Series Forecasting from Multi-Domain Integrated Distributioncited by 1
  27. 2025Mitigating Data Scarcity in Time Series Analysis: A Foundation Model with Series-Symbol Data Generationcited by 1
  28. 2025Unify and Anchor: A Context-Aware Transformer for Cross-Domain Time Series Forecastingcited by 1
  29. 2025A Set-Sequence Model for Time Seriescited by 1
  30. 2025Uncovering Insights of Compound Flooding with Data-Driven AIcited by 1
  31. 2025Towards Robust Real-World Multivariate Time Series Forecasting: A Unified Framework for Dependency, Asynchrony, and Missingnesscited by 1
  32. 2025HGTS-Former: Hierarchical HyperGraph Transformer for Multivariate Time Series Analysiscited by 1
  33. 2025DMSC: Dynamic Multi-Scale Coordination Framework for Time Series Forecastingcited by 1
  34. 2025STM3: Mixture of Multiscale Mamba for Long-Term Spatio-Temporal Time-Series Predictioncited by 1
  35. 2025How Effective Are Time-Series Models for Precipitation Nowcasting? A Comprehensive Benchmark for GNSS-based Precipitation Nowcastingcited by 1
  36. 2025TimeFormer: Transformer with Attention Modulation Empowered by Temporal Characteristics for Time Series Forecastingcited by 1
  37. 2025Hierarchical Graph Networks for Accurate Weather Forecasting via Lightweight Trainingcited by 1
  38. 2025Are Time-Indexed Foundation Models the Future of Time Series Imputation?cited by 1

50 most cited of 113 All 113 (JSON)