Spatio-Temporal Contrastive Self-Supervised Learning for POI-level Crowd Flow Inference
Not on the map. Why?
Abstract (arXiv)
Accurate acquisition of crowd flow at Points of Interest (POIs) is pivotal for effective traffic management, public service, and urban planning. Despite this importance, due to the limitations of urban sensing techniques, the data quality from most sources is inadequate for monitoring crowd flow at each POI. This renders the inference of accurate crowd flow from low-quality data a critical and challenging task. The complexity is heightened by three key factors: 1) The scarcity and rarity of labeled data, 2) The intricate spatio-temporal dependencies among POIs, and 3) The myriad correlations between precise crowd flow and GPS reports. To address these challenges, we recast the crowd flow inference problem as a self-supervised attributed graph representation learning task and introduce a novel Contrastive Self-learning framework for Spatio-Temporal data (CSST). Our approach initiates with the construction of a spatial adjacency graph founded on the POIs and their respective distances. We then employ a contrastive learning technique to exploit large volumes of unlabeled spatio-temporal data. We adopt a swapped prediction approach to anticipate the representation of the target subgraph from similar instances. Following the pre-training phase, the model is fine-tuned with accurate crowd flow data. Our experiments, conducted on two real-world datasets, demonstrate that the CSST pre-trained on extensive noisy data consistently outperforms models trained from scratch.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 6 Sep 2023.
Builds on
31 of 45 references.
References · 31
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2019Contrastive Multiview Codingcited by 1,297
19 more
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
- 2020Self-supervised Learning: Generative or Contrastivecited by 693
- 2020A Survey on Contrastive Self-supervised Learningcited by 553
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2016Adversarial Feature Learningcited by 350
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
- 2019Large Scale Adversarial Representation Learningcited by 238
- 2016Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Predictioncited by 217
- 2021Self-Supervised Learning with Swin Transformerscited by 121
- 2017Estimating Missing Data in Temporal Data Streams Using Multi-directional Recurrent Neural Networkscited by 86
- 2022Spatio-Temporal Self-Supervised Learning for Traffic Flow Predictioncited by 77
- 2019Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networkscited by 40
- 2020Generative Adversarial Networks for Spatio-temporal Data: A Surveycited by 35
- 2019UrbanFM: Inferring Fine-Grained Urban Flowscited by 31
- 2019A convolution recurrent autoencoder for spatio-temporal missing data imputationcited by 6
Built on by
Citing papers per year: 2024: 1.
1 paper.