Pre-training Epidemic Time Series Forecasters with Compartmental Prototypes
Not on the map. Why?
Abstract (arXiv)
Accurate epidemic forecasting is crucial for outbreak preparedness, but existing data-driven models are often brittle. Typically trained on a single pathogen, they struggle with data scarcity during new outbreaks and fail under distribution shifts caused by viral evolution or interventions. However, decades of surveillance data and the design of various compartmental models from diverse diseases offer an untapped source of transferable knowledge. To leverage the collective lessons from history, we propose CAPE, the first open-source pre-trained model for epidemic forecasting. Unlike existing time series foundation models that overlook epidemiological challenges, CAPE models epidemic dynamics as mixtures of latent compartmental population states, termed textitcompartmental prototypes. It models a flexible dictionary of compartment prototypes directly from a large collection of simulation data, enabling each outbreak to be expressed as a time-varying mixture that links observed infections to latent population states. To promote robust generalization, CAPE adopts the next-token-prediction paradigm during pre-training with lightweight epidemic-aware regularization that aligns the learned prototypes with epidemiological semantics. On a comprehensive benchmark spanning 17 diseases, CAPE significantly outperforms strong baselines with zero-shot forecasting. This work represents a principled step toward pre-trained epidemic models that are both transferable and epidemiologically grounded. We provide our code in: https://github.com/nuuuh/CAPE.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 33 of its 90 references that are in the map. First posted on arXiv 5 Feb 2025.
Builds on
33 of 90 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023A Survey of Large Language Modelscited by 2,537
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
21 more
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
- 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 230
- 2017Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learningcited by 192
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
- 2019GMNN: Graph Markov Neural Networkscited by 82
- 2022Learning Fast and Slow for Online Time Series Forecastingcited by 43
- 2024A Review of Graph Neural Networks in Epidemic Modelingcited by 31
- 2022EINNs: Epidemiologically-informed Neural Networkscited by 21
- 2023T-Rep: Representation Learning for Time Series using Time-Embeddingscited by 19
- 2024Epidemiology-Aware Neural ODE with Continuous Disease Transmission Graphcited by 10
- 2020Gaussian kernel smoothingcited by 6
- 2024EpiLearn: A Python Library for Machine Learning in Epidemic Modelingcited by 5
- 2024Mining of Switching Sparse Networks for Missing Value Imputation in Multivariate Time Seriescited by 5
- 2021Deep Epidemiological Modeling by Black-box Knowledge Distillation: An Accurate Deep Learning Model for COVID-19cited by 3
- 2023PEMS: Pre-trained Epidemic Time-series Modelscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2026STReasoner: Empowering LLMs for Spatio-Temporal Reasoning in Time Series via Spatial-Aware Reinforcement Learningcited by 7
- 2025PPG-Distill: Efficient Photoplethysmography Signals Analysis via Foundation Model Distillationcited by 6
- 2026EpiEvolve: Self-Evolving Agents for Streaming Pandemic Forecasting under Regime Shiftscited by 1
- 2026EpiEvolve: Self-Evolving Agents for Streaming Pandemic Forecasting under Regime Shifts3 Jun 2026
- 2026STReasoner: Empowering LLMs for Spatio-Temporal Reasoning in Time Series via Spatial-Aware Reinforcement Learning6 Jan 2026
- 2025PPG-Distill: Efficient Photoplethysmography Signals Analysis via Foundation Model Distillation23 Sep 2025