Position: The Inevitable End of One-Architecture-Fits-All-Domains in Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Recent work has questioned the effectiveness and robustness of neural network architectures for time series forecasting tasks. We summarize these concerns and analyze groundly their inherent limitations: i.e. the irreconcilable conflict between single (or few similar) domains SOTA and generalizability over general domains for time series forecasting neural network architecture designs. Moreover, neural networks architectures for general domain time series forecasting are becoming more and more complicated and their performance has almost saturated in recent years. As a result, network architectures developed aiming at fitting general time series domains are almost not inspiring for real world practices for certain single (or few similar) domains such as Finance, Weather, Traffic, etc: each specific domain develops their own methods that rarely utilize advances in neural network architectures of time series community in recent 2-3 years. As a result, we call for the time series community to shift focus away from research on time series neural network architectures for general domains: these researches have become saturated and away from domain-specific SOTAs over time. We should either (1) focus on deep learning methods for certain specific domain(s), or (2) turn to the development of meta-learning methods for general domains.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 36 of its 86 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
36 of 86 references.
References · 36
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
- 2023ClimaX: A foundation model for weather and climatecited by 337
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
- 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 241
24 more
- 2023Neural General Circulation Models for Weather and Climatecited by 239
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
- 2023FITS: Modeling Time Series with 10k Parameterscited by 195
- 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasterscited by 129
- 2024UniTS: A Unified Multi-Task Time Series Modelcited by 94
- 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 82
- 2024LSTPrompt: Large Language Models as Zero-Shot Time Series Forecasters by Long-Short-Term Promptingcited by 59
- 2024Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilitiescited by 48
- 2024A Comprehensive Survey of Deep Learning for Time Series Forecasting: Architectural Diversity and Open Challengescited by 47
- 2021Long-Range Transformers for Dynamic Spatiotemporal Forecastingcited by 46
- 2024In-Context Fine-Tuning for Time-Series Foundation Modelscited by 35
- 2022Improving Medical Predictions by Irregular Multimodal Electronic Health Records Modelingcited by 33
- 2024Efficient Large-Scale Traffic Forecasting with Transformers: A Spatial Data Management Perspectivecited by 26
- 2025OLinear: A Linear Model for Time Series Forecasting in Orthogonally Transformed Domaincited by 26
- 2024RWKV-TS: Beyond Traditional Recurrent Neural Network for Time Series Taskscited by 22
- 2025CrossLinear: Plug-and-Play Cross-Correlation Embedding for Time Series Forecasting with Exogenous Variablescited by 22
- 2025TimeSeriesScientist: A General-Purpose AI Agent for Time Series Analysiscited by 22
- 2025Re(Visiting) Time Series Foundation Models in Financecited by 7
- 2025Exploring Accuracy Law for Deep Time Series Forecasters: An Empirical Studycited by 5
- 2025Bridging Simplicity and Sophistication using GLinear: A Novel Architecture for Enhanced Time Series Predictioncited by 4
- 2025Tailored Forecasting from Short Time Series via Meta-learningcited by 2
- 2025Forecasting Time Series with LLMs via Patch-Based Prompting and Decompositioncited by 2
- 2025A Time-Series Foundation Model by Universal Delay Embeddingcited by 2
- 2025Time-Prompt: Integrated Heterogeneous Prompts for Unlocking LLMs in Time Series Forecastingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.