mlsanityData to 7 Oct 2026

Graph-Conditioned Mixture of Graph Neural Network Experts for Traffic Forecasting

arXiv 2605.30486 ↗First posted 28 May 2026cs.LG cs.AIcited by 0

On the map: Mixture-of-experts → MoE for time series and graphs

Abstract (arXiv)

Spatio-temporal forecasting on sensor graphs is commonly tackled with a single backbone architecture applied uniformly across all nodes, although graph regions can exhibit different dynamics. Road segments differ in functional class, structure, and traffic behavior, suggesting that node-wise expert specialization can be useful. We propose GC-MoE, a graph-conditioned mixture of experts framework that assigns each node a personalized combination of frozen forecasting experts based on graph topology and the recent traffic input window. GC-MoE combines frozen pretrained spatio-temporal GNN experts with an input-aware, spatially contextualized router while training only a lightweight routing module. We also study a bounded graph-conditioned output refinement layer as an optional extension and include node-adaptive ST-LoRA adapters only as an ablation diagnostic. Across four standard benchmarks (PEMS04, PEMS07, METR-LA, and PEMS-BAY), GC-MoE improves MAE over a zero-parameter ensemble baseline, with competitive RMSE and MAPE, while training only ~17K parameters on top of 1.5M frozen expert weights. The implementation is available at https://github.com/Ahghaffari/gc_moe.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 21 of its 30 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

21 of 30 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts5 Mar

Other references · 20

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  6. 2024Mixtral of Expertscited by 1,785
  7. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  8. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
  9. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  10. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 740
  11. 2022Mixture-of-Experts with Expert Choice Routingcited by 611
  12. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
8 more
  1. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
  2. 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
  3. 2023From Sparse to Soft Mixtures of Expertscited by 245
  4. 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
  5. 2024Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLMcited by 106
  6. 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 86
  7. 2024ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecastingcited by 9
  8. 2025STM-Graph: A Python Framework for Spatio-Temporal Mapping and Graph Neural Network Predictionscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Less is More: Strategic Expert Selection Outperforms Ensemble Complexity in Traffic Forecasting
  2. 2024Robust Traffic Forecasting against Spatial Shift over Years
  3. 2024Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecasting
  4. 2024Continual Traffic Forecasting via Mixture of Experts
  5. 2026STHMoE: Hypergraph-Enhanced Heterogeneous Dependency Coordination for LLM-Based Urban Traffic Data Forecasting
  6. 2024A Time Series is Worth Five Experts: Heterogeneous Mixture of Experts for Traffic Flow Prediction
  7. 2026FaST: Efficient and Effective Long-Horizon Forecasting for Large-Scale Spatial-Temporal Graphs via Mixture-of-Experts
  8. 2026A Multi-Resolution Multi-Domain Pre-Training Framework for Universal Traffic Forecasting