mlsanityData to 14 Oct 2026

A Multi-Resolution Multi-Domain Pre-Training Framework for Universal Traffic Forecasting

arXiv 2609.13878 ↗First posted 12 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Spatio-temporal traffic data are central to intelligent transportation systems, yet their heterogeneity poses significant challenges for large-scale modeling. Existing pre-trained models often rely on a homogeneous modeling paradigm to handle highly heterogeneous traffic data. This fundamental mismatch not only limits model generalization but also leads to computationally expensive and parameter-inefficient designs. To this end, we propose FlexST, a novel pre-training framework that introduces modularity and adaptivity for traffic modeling. Specifically, we first propose a multi-resolution spatio-temporal diffusion module that captures both short-term fluctuations and long-range trends, effectively reconciling inputs with divergent temporal and spatial resolutions. After that, we construct a domain-adaptive mixture-of-experts that dynamically routes data to specialized sub-networks, enabling selective knowledge transfer while preventing negative interference across diverse domains. Moreover, we devise a unified periodic encoding strategy that injects resolution- and domain-aware inductive biases to harmonize periodic inconsistencies across datasets. Extensive experiments on 23 real-world traffic datasets demonstrate that FlexST significantly outperforms state-of-the-art baselines in zero- and few-shot settings, showcasing superior generalization, adaptability and efficiency. This work offers a new direction for building general-purpose pre-trained models capable of handling the complexity and variability of urban traffic systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 41 references that are in the map. First posted on arXiv 12 Sep 2026.

Builds on

28 of 41 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  5. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
  6. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  7. 2024Chronos: Learning the Language of Time Seriescited by 759
  8. 2023A decoder-only foundation model for time-series forecastingcited by 692
  9. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  10. 2019Diffusion Improves Graph Learningcited by 414
  11. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  12. 2021GRAND: Graph Neural Diffusioncited by 258
16 more
  1. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
  2. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
  3. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 151
  4. 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
  5. 2023Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity Analysiscited by 117
  6. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 94
  7. 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 87
  8. 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
  9. 2024FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusioncited by 68
  10. 2024Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series Classificationcited by 53
  11. 2022Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfercited by 43
  12. 2024OpenCity: Open Spatio-Temporal Foundation Models for Traffic Predictioncited by 27
  13. 2019Deep-learning Architecture for Short-term Passenger Flow Forecasting in Urban Rail Transitcited by 25
  14. 2020Polestar: An Intelligent, Efficient and National-Wide Public Transportation Routing Enginecited by 8
  15. 2024Interpretable Cascading Mixture-of-Experts for Urban Traffic Congestion Predictioncited by 7
  16. 2024UniFlow: A Foundation Model for Unified Urban Spatio-Temporal Flow Predictioncited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecasting
  2. 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction
  3. 2026STHMoE: Hypergraph-Enhanced Heterogeneous Dependency Coordination for LLM-Based Urban Traffic Data Forecasting
  4. 2026PHGNet: Prototype-Guided Hypergraph Construction for Heterogeneous Spatiotemporal Forecasting
  5. 2025RAST: A Retrieval Augmented Spatio-Temporal Framework for Traffic Prediction
  6. 2026GAMMA-Net: Adaptive Long-Horizon Traffic Spatio-Temporal Forecasting Model based on Interleaved Graph Attention and Multi-Axis Mamba
  7. 2024SpecSTG: A Fast Spectral Diffusion Framework for Probabilistic Spatio-Temporal Traffic Forecasting
  8. 2024STLLM-DF: A Spatial-Temporal Large Language Model with Diffusion for Enhanced Multi-Mode Traffic System Forecasting