Graph-Conditioned Mixture of Graph Neural Network Experts for Traffic Forecasting
On the map: Mixture-of-experts → MoE for time series and graphs
Abstract (arXiv)
Spatio-temporal forecasting on sensor graphs is commonly tackled with a single backbone architecture applied uniformly across all nodes, although graph regions can exhibit different dynamics. Road segments differ in functional class, structure, and traffic behavior, suggesting that node-wise expert specialization can be useful. We propose GC-MoE, a graph-conditioned mixture of experts framework that assigns each node a personalized combination of frozen forecasting experts based on graph topology and the recent traffic input window. GC-MoE combines frozen pretrained spatio-temporal GNN experts with an input-aware, spatially contextualized router while training only a lightweight routing module. We also study a bounded graph-conditioned output refinement layer as an optional extension and include node-adaptive ST-LoRA adapters only as an ablation diagnostic. Across four standard benchmarks (PEMS04, PEMS07, METR-LA, and PEMS-BAY), GC-MoE improves MAE over a zero-parameter ensemble baseline, with competitive RMSE and MAPE, while training only ~17K parameters on top of 1.5M frozen expert weights. The implementation is available at https://github.com/Ahghaffari/gc_moe.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 21 of its 30 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
21 of 30 references.
Closest ancestors · 1
Same direction, newest first
Other references · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2024Mixtral of Expertscited by 1,785
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 740
- 2022Mixture-of-Experts with Expert Choice Routingcited by 611
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
8 more
- 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
- 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
- 2023From Sparse to Soft Mixtures of Expertscited by 245
- 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
- 2024Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLMcited by 106
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 86
- 2024ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecastingcited by 9
- 2025STM-Graph: A Python Framework for Spatio-Temporal Mapping and Graph Neural Network Predictionscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Less is More: Strategic Expert Selection Outperforms Ensemble Complexity in Traffic Forecasting
- 2024Robust Traffic Forecasting against Spatial Shift over Years
- 2024Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecasting
- 2024Continual Traffic Forecasting via Mixture of Experts
- 2026STHMoE: Hypergraph-Enhanced Heterogeneous Dependency Coordination for LLM-Based Urban Traffic Data Forecasting
- 2024A Time Series is Worth Five Experts: Heterogeneous Mixture of Experts for Traffic Flow Prediction
- 2026FaST: Efficient and Effective Long-Horizon Forecasting for Large-Scale Spatial-Temporal Graphs via Mixture-of-Experts
- 2026A Multi-Resolution Multi-Domain Pre-Training Framework for Universal Traffic Forecasting