mlsanityData to 14 Oct 2026

Interpretable Cascading Mixture-of-Experts for Urban Traffic Congestion Prediction

arXiv 2406.12923 ↗First posted 14 Jun 2024cs.LG cs.MAcited by 7

On the map: Mixture-of-experts → MoE for time series and graphs

Abstract (arXiv)

Rapid urbanization has significantly escalated traffic congestion, underscoring the need for advanced congestion prediction services to bolster intelligent transportation systems. As one of the world's largest ride-hailing platforms, DiDi places great emphasis on the accuracy of congestion prediction to enhance the effectiveness and reliability of their real-time services, such as travel time estimation and route planning. Despite numerous efforts have been made on congestion prediction, most of them fall short in handling heterogeneous and dynamic spatio-temporal dependencies (e.g., periodic and non-periodic congestions), particularly in the presence of noisy and incomplete traffic data. In this paper, we introduce a Congestion Prediction Mixture-of-Experts, CP-MoE, to address the above challenges. We first propose a sparsely-gated Mixture of Adaptive Graph Learners (MAGLs) with congestion-aware inductive biases to improve the model capacity for efficiently capturing complex spatio-temporal dependencies in varying traffic scenarios. Then, we devise two specialized experts to help identify stable trends and periodic patterns within the traffic data, respectively. By cascading these experts with MAGLs, CP-MoE delivers congestion predictions in a more robust and interpretable manner. Furthermore, an ordinal regression strategy is adopted to facilitate effective collaboration among diverse experts. Extensive experiments on real-world datasets demonstrate the superiority of our proposed method compared with state-of-the-art spatio-temporal prediction models. More importantly, CP-MoE has been deployed in DiDi to improve the accuracy and reliability of the travel time estimation system.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 26 of its 64 references that are in the map. First posted on arXiv 14 Jun 2024.

Builds on

26 of 64 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modeling6 Apr

Other references · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  4. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  5. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
  6. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  7. 2021Scaling Vision with Sparse Mixture of Expertscited by 747
  8. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
  9. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
  10. 2022DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scalecited by 404
  11. 2022Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Expertscited by 203
  12. 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
13 more
  1. 2021Efficient Large Scale Language Modeling with Mixtures of Expertscited by 175
  2. 2021Delving into Deep Imbalanced Regressioncited by 158
  3. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 151
  4. 2022A Review of Sparse Expert Models in Deep Learningcited by 148
  5. 2022RankSim: Ranking Similarity Regularization for Deep Imbalanced Regressioncited by 52
  6. 2022Practical Adversarial Attacks on Spatiotemporal Traffic Forecasting Modelscited by 29
  7. 2021MugRep: A Multi-Task Hierarchical Graph Representation Learning Framework for Real Estate Appraisalcited by 20
  8. 2017DeepTransport: Learning Spatial-Temporal Dependency for Traffic Condition Forecastingcited by 16
  9. 2021Applications of deep learning in traffic congestion detection, prediction and alleviation: A surveycited by 14
  10. 2023Spatio-Temporal Graph Neural Point Process for Traffic Congestion Event Predictioncited by 13
  11. 2020PCNN: Deep Convolutional Networks for Short-term Traffic Congestion Predictioncited by 12
  12. 2020Polestar: An Intelligent, Efficient and National-Wide Public Transportation Routing Enginecited by 8
  13. 2023Mixture of Weak & Strong Experts on Graphscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 3.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Less is More: Strategic Expert Selection Outperforms Ensemble Complexity in Traffic Forecasting
  2. 2024Interpretable mixture of experts for time series prediction under recurrent and non-recurrent conditions
  3. 2024A Time Series is Worth Five Experts: Heterogeneous Mixture of Experts for Traffic Flow Prediction
  4. 2024Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecasting
  5. 2023Transport-Hub-Aware Spatial-Temporal Adaptive Graph Transformer for Traffic Flow Prediction
  6. 2026Graph-Conditioned Mixture of Graph Neural Network Experts for Traffic Forecasting
  7. 2026CROSS: A Mixture-of-Experts Reinforcement Learning Framework for Generalizable Large-Scale Traffic Signal Control
  8. 2024Continual Traffic Forecasting via Mixture of Experts