Transformer with Koopman-Enhanced Graph Convolutional Network for Spatiotemporal Dynamics Forecasting
Not on the map. Why?
Abstract (arXiv)
Spatiotemporal dynamics forecasting is inherently challenging, particularly in systems defined over irregular geometric domains, due to the need to jointly capture complex spatial correlations and nonlinear temporal dynamics. To tackle these challenges, we propose TK-GCN, a two-stage framework that integrates geometry-aware spatial encoding with long-range temporal modeling. In the first stage, a Koopman-enhanced Graph Convolutional Network (K-GCN) is developed to embed the high-dimensional dynamics distributed on spatially irregular domains into a latent space where the evolution of system states is approximately linear. By leveraging Koopman operator theory, this stage enhances the temporal consistency during the latent learning. In the second stage, a Transformer module is employed to model the temporal progression within the Koopman-encoded latent space. Through the self-attention mechanism, the Transformer captures long-range temporal dependencies, enabling accurate forecasting over extended horizons. We evaluate TK-GCN in spatiotemporal cardiac dynamics forecasting and benchmark its performance against several state-of-the-art baselines. Experimental results and ablation studies show that TK-GCN consistently delivers superior predictive accuracy across a range of forecast horizons, demonstrating its capability to effectively model complex spatial structures and nonlinear temporal dynamics.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 27 of its 64 references that are in the map. First posted on arXiv 5 Jul 2025.
Builds on
27 of 64 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
- 2022Transformers in Time Series: A Surveycited by 497
- 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 434
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 180
- 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 172
15 more
- 2017SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernelscited by 161
- 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
- 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 127
- 2020Transformers for Modeling Physical Systemscited by 106
- 2014Manifold Gaussian Processes for Regressioncited by 80
- 2014Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geostatistical Datasetscited by 72
- 2015MCMC for Variationally Sparse Gaussian Processescited by 44
- 2022Long-term Spatio-temporal Forecasting via Dynamic Multiple-Graph Attentioncited by 15
- 2022Statistical Deep Learning for Spatial and Spatio-Temporal Datacited by 15
- 2023Spatio-temporal DeepKriging for Interpolation and Probabilistic Forecastingcited by 13
- 2023Automated Identication of Atrial Fibrillation from Single-lead ECGs Using Multi-branching ResNetcited by 9
- 2023Spatio-Temporal Point Process for Multiple Object Trackingcited by 5
- 2024MUSE-Net: Missingness-aware mUlti-branching Self-attention Encoder for Irregular Longitudinal Electronic Health Recordscited by 4
- 2023Hierarchical shrinkage Gaussian processes: applications to computer code emulation and dynamical system recoverycited by 3
- 2025Geometry-aware Active Learning of Spatiotemporal Dynamic Systemscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Physics-augmented Multi-task Gaussian Process for Modeling Spatiotemporal Dynamicscited by 1
- 2026Multi-Task LLM with LoRA Fine-Tuning for Automated Cancer Staging and Biomarker Extractioncited by 0
- 2026P-K-GCN: Physics-augmented Koopman-enhanced Graph Convolutional Network for Deep Spatiotemporal Super-resolutioncited by 0
- 2026P-K-GCN: Physics-augmented Koopman-enhanced Graph Convolutional Network for Deep Spatiotemporal Super-resolution17 Jun 2026
- 2026Multi-Task LLM with LoRA Fine-Tuning for Automated Cancer Staging and Biomarker Extraction14 Apr 2026
- 2025Physics-augmented Multi-task Gaussian Process for Modeling Spatiotemporal Dynamics15 Oct 2025