Unsupervised Path Representation Learning with Curriculum Negative Sampling
Not on the map. Why?
Abstract (arXiv)
Path representations are critical in a variety of transportation applications, such as estimating path ranking in path recommendation systems and estimating path travel time in navigation systems. Existing studies often learn task-specific path representations in a supervised manner, which require a large amount of labeled training data and generalize poorly to other tasks. We propose an unsupervised learning framework Path InfoMax (PIM) to learn generic path representations that work for different downstream tasks. We first propose a curriculum negative sampling method, for each input path, to generate a small amount of negative paths, by following the principles of curriculum learning. Next, PIM employs mutual information maximization to learn path representations from both a global and a local view. In the global view, PIM distinguishes the representations of the input paths from those of the negative paths. In the local view, PIM distinguishes the input path representations from the representations of the nodes that appear only in the negative paths. This enables the learned path representations to encode both global and local information at different scales. Extensive experiments on two downstream tasks, ranking score estimation and travel time estimation, using two road network datasets suggest that PIM significantly outperforms other unsupervised methods and is also able to be used as a pre-training method to enhance supervised path representation learning.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 17 Jun 2021.
Builds on
15 of 28 references.
References · 15
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2018Deep Graph Infomaxcited by 1,101
- 2015LINE: Large-scale Information Network Embeddingcited by 582
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
- 2016DeepCas: an End-to-end Predictor of Information Cascadescited by 48
Built on by
Citing papers per year: 2021: 2; 2022: 7; 2023: 4; 2024: 13; 2025: 8; 2026: 8.
42 papers.
Sort:
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 104
- 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 91
- 2022Towards Spatio-Temporal Aware Traffic Time Series Forecasting--Full Versioncited by 59
- 2022Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting--Full Versioncited by 59
- 2022Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semanticscited by 58
- 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Versioncited by 48
- 2021Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Versioncited by 35
- 2022Jointly Contrastive Representation Learning on Road Network and Trajectorycited by 34
- 2023LightPath: Lightweight and Scalable Path Representation Learningcited by 32
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
- 2024Trajectory Data Management and Mining: A Survey from Deep Learning to the LLM Eracited by 23
30 more
- 2024More Than Routing: Joint GPS and Route Modeling for Refine Trajectory Representation Learningcited by 20
- 2022Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Versioncited by 19
- 2024BIGCity: A Universal Spatiotemporal Model for Unified Trajectory and Traffic State Data Analysiscited by 16
- 2022Weakly-supervised Temporal Path Representation Learning with Contrastive Curriculum Learning -- Extended Versioncited by 15
- 2025Bridging Traffic State and Trajectory for Dynamic Road Network and Trajectory Representation Learningcited by 14
- 2024Self-Supervised Representation Learning for Geospatial Objects: A Surveycited by 8
- 2024RED: Effective Trajectory Representation Learning with Comprehensive Informationcited by 8
- 2025Blurred Encoding for Trajectory Representation Learningcited by 8
- 2024Grid and Road Expressions Are Complementary for Trajectory Representation Learningcited by 7
- 2025K2VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecastingcited by 7
- 2022Fine-Grained Trajectory-based Travel Time Estimation for Multi-city Scenarios Based on Deep Meta-Learningcited by 6
- 2023A Critical Perceptual Pre-trained Model for Complex Trajectory Recoverycited by 4
- 2024TrajCogn: Leveraging LLMs for Cognizing Movement Patterns and Travel Purposes from Trajectoriescited by 4
- 2025RCRank: Multimodal Ranking of Root Causes of Slow Queries in Cloud Database Systemscited by 4
- 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigmscited by 4
- 2023VisionTraj: A Noise-Robust Trajectory Recovery Framework based on Large-scale Camera Networkcited by 3
- 2025Towards Lightweight Time Series Forecasting: a Patch-wise Transformer with Weak Data Enrichingcited by 3
- 2025Spatio-Temporal Trajectory Foundation Model - Recent Advances and Future Directionscited by 3
- 2023Jointly spatial-temporal representation learning for individual trajectoriescited by 2
- 2024Context-Enhanced Multi-View Trajectory Representation Learning: Bridging the Gap through Self-Supervised Modelscited by 2
- 2025Data Driven Decision Making with Time Series and Spatio-temporal Datacited by 2
- 2026TrajTok: Adaptive Spatial Tokenization for Trajectory Representation Learningcited by 1
- 2026REFINE: Trajectory Representation Learning via Closed-Loop Transcription -- Extended Versioncited by 1
- 2026DGCPath: Distribution-Aware Generative Contrastive Framework for Self-supervised Path Representation Learning -- Extended Versioncited by 1
- 2024STAHGNet: Modeling Hybrid-grained Heterogenous Dependency Efficiently for Traffic Predictioncited by 0
- 2025Capturing Context-Aware Route Choice Semantics for Trajectory Representation Learningcited by 0
- 2026Accurate and Efficient Multi-Channel Time Series Forecasting via Sparse Attention Mechanismcited by 0
- 2026TraveL: Transformer-based Multi-view Path Distributional Representation Learningcited by 0
- 2026HypLTSF: A Hyperbolic Geometric View of Multi-Scale Hierarchies for Long-Term Time Series Forecastingcited by 0
- 2026When Correlations Mislead: Confounder-Aware Multi-View Urban Region Representation Learningcited by 0
- 2026When Correlations Mislead: Confounder-Aware Multi-View Urban Region Representation Learning14 Sep 2026
- 2026HypLTSF: A Hyperbolic Geometric View of Multi-Scale Hierarchies for Long-Term Time Series Forecasting8 Sep 2026
- 2026DGCPath: Distribution-Aware Generative Contrastive Framework for Self-supervised Path Representation Learning -- Extended Version7 Sep 2026
- 2026REFINE: Trajectory Representation Learning via Closed-Loop Transcription -- Extended Version7 Sep 2026
- 2026TraveL: Transformer-based Multi-view Path Distributional Representation Learning3 Sep 2026
- 2026TrajTok: Adaptive Spatial Tokenization for Trajectory Representation Learning19 May 2026
- 2026Accurate and Efficient Multi-Channel Time Series Forecasting via Sparse Attention Mechanism19 Mar 2026
- 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigms27 Jan 2026
- 2025Spatio-Temporal Trajectory Foundation Model - Recent Advances and Future Directions25 Nov 2025
- 2025Blurred Encoding for Trajectory Representation Learning12 Nov 2025
- 2025Capturing Context-Aware Route Choice Semantics for Trajectory Representation Learning16 Oct 2025
- 2025K2VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecasting29 May 2025
30 more
- 2025Data Driven Decision Making with Time Series and Spatio-temporal Data11 Mar 2025
- 2025RCRank: Multimodal Ranking of Root Causes of Slow Queries in Cloud Database Systems6 Mar 2025
- 2025Bridging Traffic State and Trajectory for Dynamic Road Network and Trajectory Representation Learning8 Feb 2025
- 2025Towards Lightweight Time Series Forecasting: a Patch-wise Transformer with Weak Data Enriching14 Jan 2025
- 2024STAHGNet: Modeling Hybrid-grained Heterogenous Dependency Efficiently for Traffic Prediction23 Dec 2024
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecasting14 Dec 2024
- 2024BIGCity: A Universal Spatiotemporal Model for Unified Trajectory and Traffic State Data Analysis1 Dec 2024
- 2024RED: Effective Trajectory Representation Learning with Comprehensive Information22 Nov 2024
- 2024Grid and Road Expressions Are Complementary for Trajectory Representation Learning22 Nov 2024
- 2024Context-Enhanced Multi-View Trajectory Representation Learning: Bridging the Gap through Self-Supervised Models17 Oct 2024
- 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patching16 Oct 2024
- 2024Self-Supervised Representation Learning for Geospatial Objects: A Survey22 Aug 2024
- 2024TrajCogn: Leveraging LLMs for Cognizing Movement Patterns and Travel Purposes from Trajectories21 May 2024
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methods29 Mar 2024
- 2024Trajectory Data Management and Mining: A Survey from Deep Learning to the LLM Era21 Mar 2024
- 2024More Than Routing: Joint GPS and Route Modeling for Refine Trajectory Representation Learning25 Feb 2024
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models30 Jan 2024
- 2023VisionTraj: A Noise-Robust Trajectory Recovery Framework based on Large-scale Camera Network11 Dec 2023
- 2023Jointly spatial-temporal representation learning for individual trajectories7 Dec 2023
- 2023A Critical Perceptual Pre-trained Model for Complex Trajectory Recovery5 Nov 2023
- 2023LightPath: Lightweight and Scalable Path Representation Learning19 Jul 2023
- 2022Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semantics17 Nov 2022
- 2022Jointly Contrastive Representation Learning on Road Network and Trajectory14 Sep 2022
- 2022Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting--Full Version28 Apr 2022
- 2022Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Version7 Apr 2022
- 2022Weakly-supervised Temporal Path Representation Learning with Contrastive Curriculum Learning -- Extended Version30 Mar 2022
- 2022Towards Spatio-Temporal Aware Traffic Time Series Forecasting--Full Version29 Mar 2022
- 2022Fine-Grained Trajectory-based Travel Time Estimation for Multi-city Scenarios Based on Deep Meta-Learning20 Jan 2022
- 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Version21 Dec 2021
- 2021Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Version22 Nov 2021
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 104
- 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 91
- 2022Towards Spatio-Temporal Aware Traffic Time Series Forecasting--Full Versioncited by 59
- 2022Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting--Full Versioncited by 59
- 2022Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semanticscited by 58
- 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Versioncited by 48
- 2021Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Versioncited by 35
- 2022Jointly Contrastive Representation Learning on Road Network and Trajectorycited by 34
- 2023LightPath: Lightweight and Scalable Path Representation Learningcited by 32
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
- 2024Trajectory Data Management and Mining: A Survey from Deep Learning to the LLM Eracited by 23
12 most cited of 42 All 42 (JSON)
- 2026When Correlations Mislead: Confounder-Aware Multi-View Urban Region Representation Learning14 Sep 2026
- 2026HypLTSF: A Hyperbolic Geometric View of Multi-Scale Hierarchies for Long-Term Time Series Forecasting8 Sep 2026
- 2026DGCPath: Distribution-Aware Generative Contrastive Framework for Self-supervised Path Representation Learning -- Extended Version7 Sep 2026
- 2026REFINE: Trajectory Representation Learning via Closed-Loop Transcription -- Extended Version7 Sep 2026
- 2026TraveL: Transformer-based Multi-view Path Distributional Representation Learning3 Sep 2026
- 2026TrajTok: Adaptive Spatial Tokenization for Trajectory Representation Learning19 May 2026
- 2026Accurate and Efficient Multi-Channel Time Series Forecasting via Sparse Attention Mechanism19 Mar 2026
- 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigms27 Jan 2026
- 2025Spatio-Temporal Trajectory Foundation Model - Recent Advances and Future Directions25 Nov 2025
- 2025Blurred Encoding for Trajectory Representation Learning12 Nov 2025
- 2025Capturing Context-Aware Route Choice Semantics for Trajectory Representation Learning16 Oct 2025
- 2025K2VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecasting29 May 2025
12 newest of 42 All 42 (JSON)