mlsanityData to 7 Oct 2026

Moirai 2.0: When Less Is More for Time Series Forecasting

arXiv 2511.11698 ↗First posted 12 Nov 2025cs.LGcited by 59

Not on the map. Why?

Abstract (arXiv)

We introduce Moirai 2.0, a decoder-only time-series foundation model trained on a new corpus of 36M series. The model adopts quantile forecasting and multi-token prediction, improving both probabilistic accuracy and inference efficiency. On the Gift-Eval benchmark, it ranks among the top pretrained models while achieving a strong trade-off between accuracy, speed, and model size. Compared to Moirai 1.0, Moirai 2.0 replaces masked-encoder training, multi-patch inputs, and mixture-distribution outputs with a simpler decoder-only architecture, single patch, and quantile loss. Ablation studies isolate these changes -- showing that the decoder-only backbone along with recursive multi-quantile decoding contribute most to the gains. Additional experiments show that Moirai 2.0 outperforms larger models from the same family and exhibits robust domain-level results. In terms of efficiency and model size, Moirai 2.0 is twice as fast and thirty times smaller than its prior best version, Moirai 1.0-Large, while also performing better. Model performance plateaus with increasing parameter count and declines at longer horizons, motivating future work on data scaling and long-horizon modeling. We release code and evaluation details to support further research.

Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

31 of 41 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020Scaling Laws for Neural Language Modelscited by 6,411
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  8. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  9. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  10. 2024Chronos: Learning the Language of Time Seriescited by 712
  11. 2023A decoder-only foundation model for time-series forecastingcited by 650
  12. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
19 more
  1. 2022Efficiently Scaling Transformer Inferencecited by 529
  2. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
  3. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  4. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
  5. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 168
  6. 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
  7. 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 120
  8. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
  9. 2023Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecastingcited by 102
  10. 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoningcited by 95
  11. 2024ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Datacited by 92
  12. 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 88
  13. 2024Language Models Still Struggle to Zero-shot Reason about Time Seriescited by 81
  14. 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 52
  15. 2024Toto: Time Series Optimized Transformer for Observabilitycited by 44
  16. 2024Towards Time Series Reasoning with LLMscited by 36
  17. 2025LangTime: A Language-Guided Unified Model for Time Series Forecasting with Proximal Policy Optimizationcited by 21
  18. 2025Output Scaling: YingLong-Delayed Chain of Thought in a Large Pretrained Time Series Forecasting Modelcited by 21
  19. 2025Kairos: Toward Adaptive and Parameter-Efficient Time Series Foundation Modelscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 58.

59 papers.

Sort:

By area:

  1. 2026It's TIME: Towards the Next Generation of Time Series Forecasting Benchmarkscited by 25
  2. 2026Timer-S1: A Billion-Scale Time Series Foundation Model with Serial Scalingcited by 24
  3. 2026Toto 2.0: Time Series Forecasting Enters the Scaling Eracited by 21
  4. 2026TiRex-2: Generalizing TiRex to Multivariate Data and Streamingcited by 10
  5. 2026Falcon-X: A Time Series Foundation Model for Heterogeneous Multivariate Modelingcited by 7
  6. 2026Learning the Context of Errors: Black-Box Online Adaptation of Time Series Foundation Modelscited by 5
  7. 2026Baguan-TS: A Sequence-Native In-Context Learning Model for Time Series Forecasting with Covariatescited by 4
  8. 2026CTF4Nuclear: Common Task Framework for Nuclear Fission and Fusion Modelscited by 4
  9. 2026KairosAgent: Agentic Time Series Forecasting with Fused Semantic Reasoningcited by 4
  10. 2026Reasoning-Aware Training for Time Series Forecastingcited by 3
  11. 2026TSFMAudit: Data Contamination Auditing in Forecasting Time Series Foundation Modelscited by 3
  12. 2026Into the ORBIT for Time Series: Training Regimes for Foundation Modelscited by 3
38 more
  1. 2026Time Series Foundation Models for Energy Load Forecasting on Consumer Hardware: A Multi-Dimensional Zero-Shot Benchmarkcited by 2
  2. 2026Why Do Time Series Models Need Long Context Windows?cited by 2
  3. 2026TS-ICL: A Flexible Time-Indexed Foundation Model for Time Series via In-Context Learningcited by 2
  4. 2026TimeRouter: Efficient and Adaptive Routing of Time-Series Foundation Modelscited by 2
  5. 2025Time Series Foundation Models for Process Model Forecastingcited by 1
  6. 2026Position: Universal Time Series Foundation Models Rest on a Category Errorcited by 1
  7. 2026DiTS: Multimodal Diffusion Transformers Are Time Series Forecasterscited by 1
  8. 2026Regression Models Meet Foundation Models: A Hybrid-AI Approach to Practical Electricity Price Forecastingcited by 1
  9. 2026WaveMoE: A Wavelet-Enhanced Mixture-of-Experts Foundation Model for Time Series Forecastingcited by 1
  10. 2026Investigating simple target-covariate relationships for Chronos-2 and TabPFN-TScited by 1
  11. 2026Factorize to Generalize: Retrieval-Guided Invariant-Dynamic Decomposition for Time Series Forecastingcited by 1
  12. 2026AION: Next-Generation Tasks and Practical Harness for Time Seriescited by 1
  13. 2026AME-TS: Anchored Mixture-of-Experts for Time Series Forecastingcited by 1
  14. 2026CITRAS-FM: Tiny Time Series Foundation Model for Covariate-Informed Zero-Shot Forecastingcited by 1
  15. 2026Foundation models for electricity price forecasting and battery arbitrage: Can they replace market-specific forecasting models?cited by 1
  16. 2026What If TSF: Reframing Time Series Forecasting as Scenario-Guided Multimodal Forecastingcited by 0
  17. 2026Signature-Kernel Based Evaluation Metrics for Robust Probabilistic and Tail-Event Forecastingcited by 0
  18. 2026EIDOS: Latent-Space Predictive Learning for Time Series Foundation Modelscited by 0
  19. 2026JointFM-0.1: A Foundation Model for Multi-Target Joint Distributional Predictioncited by 0
  20. 2026Assessing the Performance-Efficiency Trade-off of Foundation Models in Probabilistic Electricity Price Forecastingcited by 0
  21. 2026Agent-Based Post-Hoc Correction of Agricultural Yield Forecastscited by 0
  22. 2026Deep ZakaiJ: Structured Filtering for Jump-Diffusion Time Series Forecastingcited by 0
  23. 2026Feature to Dynamics: Feature-space to Autoregression strategy for Zero-shot Time Series Forecastingcited by 0
  24. 2026GlucoFM-Bench: Benchmarking Time-Series Foundation Models for Blood Glucose Forecastingcited by 0
  25. 2026Time series Foundation Models based on Physics-Informed Synthetic Histories for Cold-Start Photovoltaic Forecastingcited by 0
  26. 2026Tyan-WP: A Wind Power Foundation Model for Ultra-Short-Term Probabilistic Forecastingcited by 0
  27. 2026MacroLens: A Multi-Task Benchmark for Contextual Financial Reasoning under Macroeconomic Scenarioscited by 0
  28. 2026Domain-Informed Multi-View Self-Distillation for Astronomical Light-Curve Representation Learning with JEPAcited by 0
  29. 2026Evolutionary Feature Engineering for Structured Datacited by 0
  30. 2026Evaluating the Generalizability of Foundation Models for Extreme Environmental Events: Case Study of California Wildfire PM2.5cited by 0
  31. 2026Bet on Features: Anytime-Valid and Feature-Aware Auditing of Conditional Quantile Forecasterscited by 0
  32. 2026Learning Spatio-Temporal Foundation Models from Pure Synthetic Datacited by 0
  33. 2026Air Quality Arena: A Large-Scale Multi-Region Ground Monitoring Dataset and Benchmark for Air Quality Forecasting with Time-Series Foundation Modelscited by 0
  34. 2026Expert-Guided Forecast Editing for Time-Series Foundation Modelscited by 0
  35. 2026LiveHouse-TS: An Open-world Living Benchmark for Time Series Foundation Modelscited by 0
  36. 2026Distillation of Synthetic Data for Time Series Foundation Modelscited by 0
  37. 2026FlowTSFM: Turning Encoder Depth into Quantile Transportcited by 0
  38. 2026QUALS: Corpus Equilibrium for Universal Forecasting via Pattern Quantization and Learnability Synchronizationcited by 0

50 most cited of 59 All 59 (JSON)