# KITS: Inductive Spatio-Temporal Kriging with Increment Training Strategy

arXiv: https://arxiv.org/abs/2311.02565 · HTML: https://mlsanity.com/paper/2311.02565/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 52 references that are in the map.
- First posted on arXiv 5 Nov 2023.

## Builds on (most cited first, 20 of 20)

- [Inductive Representation Learning on Large Graphs](https://mlsanity.com/paper/1706.02216/) (2017)
- [Generative Adversarial Networks](https://mlsanity.com/paper/2203.00667/) (2022)
- [Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation](https://mlsanity.com/paper/1406.1078/) (2014)
- [Neural Message Passing for Quantum Chemistry](https://mlsanity.com/paper/1704.01212/) (2017)
- [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://mlsanity.com/paper/2012.07436/) (2020)
- [SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interaction](https://mlsanity.com/paper/2106.09305/) (2021)
- [BRITS: Bidirectional Recurrent Imputation for Time Series](https://mlsanity.com/paper/1805.10572/) (2018)
- [Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networks](https://mlsanity.com/paper/2108.00298/) (2021)
- [Inductive Graph Neural Networks for Spatiotemporal Kriging](https://mlsanity.com/paper/2006.07527/) (2020)
- [Learning Graph-Level Representation for Drug Discovery](https://mlsanity.com/paper/1709.03741/) (2017)
- [Jointly Contrastive Representation Learning on Road Network and Trajectory](https://mlsanity.com/paper/2209.06389/) (2022)
- [UrbanFM: Inferring Fine-Grained Urban Flows](https://mlsanity.com/paper/1902.05377/) (2019)
- [Kriging Convolutional Networks](https://mlsanity.com/paper/2306.09463/) (2023)
- [Graph Classification via Deep Learning with Virtual Nodes](https://mlsanity.com/paper/1708.04357/) (2017)
- [Tensor Completion for Weakly-dependent Data on Graph for Metro Passenger Flow Prediction](https://mlsanity.com/paper/1912.05693/) (2019)
- [Spatial Aggregation and Temporal Convolution Networks for Real-time Kriging](https://mlsanity.com/paper/2109.12144/) (2021)
- [INCREASE: Inductive Graph Representation Learning for Spatio-Temporal Kriging](https://mlsanity.com/paper/2302.02738/) (2023)
- [DR.VIC: Decomposition and Reasoning for Video Individual Counting](https://mlsanity.com/paper/2203.12335/) (2022)
- [Long-Short Term Spatiotemporal Tensor Prediction for Passenger Flow Profile](https://mlsanity.com/paper/2004.11022/) (2020)
- [Decoupling Long- and Short-Term Patterns in Spatiotemporal Inference](https://mlsanity.com/paper/2109.09506/) (2021)

## Built on by (most cited first, 19 of 19)

- [Spatial-Temporal Large Language Model for Traffic Prediction](https://mlsanity.com/paper/2401.10134/) (2024)
- [Network-wide Freeway Traffic Estimation Using Sparse Sensor Data: A Dirichlet Graph Auto-Encoder Approach](https://mlsanity.com/paper/2503.15845/) (2025)
- [Skin Cancer Detection utilizing Deep Learning: Classification of Skin Lesion Images using a Vision Transformer](https://mlsanity.com/paper/2407.18554/) (2024)
- [MoGERNN: An Inductive Traffic Predictor for Unobserved Locations](https://mlsanity.com/paper/2501.12281/) (2025)
- [Deep Causal Learning to Explain and Quantify The Geo-Tension's Impact on Natural Gas Market](https://mlsanity.com/paper/2407.10878/) (2024)
- [Generalising Traffic Forecasting to Regions without Traffic Observations](https://mlsanity.com/paper/2508.08947/) (2025)
- [AnchorGK: Anchor-based Incremental and Stratified Graph Learning Framework for Inductive Spatio-Temporal Kriging](https://mlsanity.com/paper/2512.21569/) (2025)
- [Transformer-based Drum-level Prediction in a Boiler Plant with Delayed Relations among Multivariates](https://mlsanity.com/paper/2407.11180/) (2024)
- [Exploring Genre and Success Classification through Song Lyrics using DistilBERT: A Fun NLP Venture](https://mlsanity.com/paper/2407.21068/) (2024)
- [A Survey and Benchmarking of Spatial-Temporal Traffic Data Imputation Models](https://mlsanity.com/paper/2412.04733/) (2024)
- [Inductive Spatio-Temporal Kriging with Physics-Guided Increment Training Strategy for Air Quality Inference](https://mlsanity.com/paper/2503.09646/) (2025)
- [Leakage-Free Evaluation and Distribution-Robust Spatio-Temporal Graph Learning for Inductive Kriging](https://mlsanity.com/paper/2509.23631/) (2025)
- [A Hybrid Inductive-Transductive Network for Traffic Flow Imputation on Unsampled Locations](https://mlsanity.com/paper/2512.17984/) (2025)
- [PlugSI: Plug-and-Play Test-Time Graph Adaptation for Spatial Interpolation](https://mlsanity.com/paper/2602.09824/) (2026)
- [Uniform Inductive Spatio-Temporal Kriging](https://mlsanity.com/paper/2603.05301/) (2026)
- [Metropolis-Scale Resilient and Trustworthy Traffic Flow Inference Using Multi-Source Data](https://mlsanity.com/paper/2605.25004/) (2026)
- [AdaKernel: Learning Adaptive Kernel Parameters for Spatiotemporal Graph Neural Networks](https://mlsanity.com/paper/2606.01283/) (2026)
- [Toward Equitable Low-Carbon Mobility: Fairness-Aware Demand Prediction for Expanding Bike-Sharing Systems](https://mlsanity.com/paper/2608.26451/) (2026)
- [A Dataset and Model for Imputing Water Surface Elevation on a Large and Extremely Sparse Spatiotemporal Graph](https://mlsanity.com/paper/2609.11580/) (2026)

## Abstract (arXiv)

Sensors are commonly deployed to perceive the environment. However, due to the high cost, sensors are usually sparsely deployed. Kriging is the tailored task to infer the unobserved nodes (without sensors) using the observed source nodes (with sensors). The essence of kriging task is transferability. Recently, several inductive spatio-temporal kriging methods have been proposed based on graph neural networks, being trained based on a graph built on top of observed nodes via pretext tasks such as masking nodes out and reconstructing them. However, the graph in training is inevitably much sparser than the graph in inference that includes all the observed and unobserved nodes. The learned pattern cannot be well generalized for inference, denoted as graph gap. To address this issue, we first present a novel Increment training strategy: instead of masking nodes (and reconstructing them), we add virtual nodes into the training graph so as to mitigate the graph gap issue naturally. Nevertheless, the empty-shell virtual nodes without labels could have bad-learned features and lack supervision signals. To solve these issues, we pair each virtual node with its most similar observed node and fuse their features together; to enhance the supervision signal, we construct reliable pseudo labels for virtual nodes. As a result, the learned pattern of virtual nodes could be safely transferred to real unobserved nodes for reliable kriging. We name our new Kriging model with Increment Training Strategy as KITS. Extensive experiments demonstrate that KITS consistently outperforms existing kriging methods by large margins, e.g., the improvement over MAE score could be as high as 18.33%.
