mlsanityData to 7 Oct 2026

STAMImputer: Spatio-Temporal Attention MoE for Traffic Data Imputation

arXiv 2506.08054 ↗First posted 9 Jun 2025cs.LG cs.AIcited by 2

On the map: Mixture-of-experts → MoE for time series and graphs

Abstract (arXiv)

Traffic data imputation is fundamentally important to support various applications in intelligent transportation systems such as traffic flow prediction. However, existing time-to-space sequential methods often fail to effectively extract features in block-wise missing data scenarios. Meanwhile, the static graph structure for spatial feature propagation significantly constrains the models flexibility in handling the distribution shift issue for the nonstationary traffic data. To address these issues, this paper proposes a SpatioTemporal Attention Mixture of experts network named STAMImputer for traffic data imputation. Specifically, we introduce a Mixture of Experts (MoE) framework to capture latent spatio-temporal features and their influence weights, effectively imputing block missing. A novel Low-rank guided Sampling Graph ATtention (LrSGAT) mechanism is designed to dynamically balance the local and global correlations across road networks. The sampled attention vectors are utilized to generate dynamic graphs that capture real-time spatial correlations. Extensive experiments are conducted on four traffic datasets for evaluation. The result shows STAMImputer achieves significantly performance improvement compared with existing SOTA approaches. Our codes are available at https://github.com/RingBDStack/STAMImupter.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 19 of its 44 references that are in the map. First posted on arXiv 9 Jun 2025.

Builds on

19 of 44 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  3. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  4. 2018GAIN: Missing Data Imputation using Generative Adversarial Netscited by 349
  5. 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 288
  6. 2022SAITS: Self-Attention-based Imputation for Time Seriescited by 167
  7. 2021MoEfication: Transformer Feed-forward Layers are Mixtures of Expertscited by 149
  8. 2021Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networkscited by 93
  9. 2022Learning to Reconstruct Missing Data from Spatiotemporal Graphs with Sparse Observationscited by 64
  10. 2023ImputeFormer: Low Rankness-Induced Transformers for Generalizable Spatiotemporal Imputationcited by 50
  11. 2019Bayesian Temporal Factorization for Multidimensional Time Series Predictioncited by 47
  12. 2021Low-Rank Autoregressive Tensor Completion for Spatiotemporal Traffic Data Imputationcited by 35
7 more
  1. 2023SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimizationcited by 35
  2. 2020A Nonconvex Low-Rank Tensor Completion Model for Spatiotemporal Traffic Data Imputationcited by 27
  3. 2019CDSA: Cross-Dimensional Self-Attention for Multivariate, Geo-tagged Time Series Imputationcited by 24
  4. 2023Cross-city Few-Shot Traffic Forecasting via Traffic Pattern Bankcited by 22
  5. 2023MultiSPANS: A Multi-range Spatial-Temporal Transformer Network for Traffic Forecast via Structural Entropy Optimizationcited by 13
  6. 2020Traffic Data Imputation using Deep Convolutional Neural Networkscited by 7
  7. 2024Score-CDM: Score-Weighted Convolutional Diffusion Model for Multivariate Time Series Imputationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024FastSTI: A Fast Conditional Pseudo Numerical Diffusion Model for Spatio-temporal Traffic Data Imputation
  2. 2026Spatiotemporal Imputation with Graph-Informed Flow Matching
  3. 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction
  4. 2024Robust Traffic Forecasting against Spatial Shift over Years
  5. 2026Spatial-Temporal Feedback Diffusion Guidance for Controlled Traffic Imputation
  6. 2024TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts
  7. 2024Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecasting
  8. 2025Less is More: Strategic Expert Selection Outperforms Ensemble Complexity in Traffic Forecasting