mlsanityData to 7 Oct 2026

Unsupervised Path Representation Learning with Curriculum Negative Sampling

arXiv 2106.09373 ↗First posted 17 Jun 2021cs.LG cs.AIcited by 42

Not on the map. Why?

Abstract (arXiv)

Path representations are critical in a variety of transportation applications, such as estimating path ranking in path recommendation systems and estimating path travel time in navigation systems. Existing studies often learn task-specific path representations in a supervised manner, which require a large amount of labeled training data and generalize poorly to other tasks. We propose an unsupervised learning framework Path InfoMax (PIM) to learn generic path representations that work for different downstream tasks. We first propose a curriculum negative sampling method, for each input path, to generate a small amount of negative paths, by following the principles of curriculum learning. Next, PIM employs mutual information maximization to learn path representations from both a global and a local view. In the global view, PIM distinguishes the representations of the input paths from those of the negative paths. In the local view, PIM distinguishes the input path representations from the representations of the nodes that appear only in the negative paths. This enables the learned path representations to encode both global and local information at different scales. Extensive experiments on two downstream tasks, ranking score estimation and travel time estimation, using two road network datasets suggest that PIM significantly outperforms other unsupervised methods and is also able to be used as a pre-training method to enhance supervised path representation learning.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 17 Jun 2021.

Builds on

15 of 28 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  5. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  6. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  7. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  8. 2018Deep Graph Infomaxcited by 1,101
  9. 2015LINE: Large-scale Information Network Embeddingcited by 582
  10. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  11. 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
  12. 2016DeepCas: an End-to-end Predictor of Information Cascadescited by 48
3 more
  1. 2020Simplify and Robustify Negative Sampling for Implicit Collaborative Filteringcited by 34
  2. 2018Incorporating GAN for Negative Sampling in Knowledge Representation Learningcited by 31
  3. 2018Learning to Route with Sparse Trajectory Sets---Extended Versioncited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 7; 2023: 4; 2024: 13; 2025: 8; 2026: 8.

42 papers.

Sort:

  1. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
  2. 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 104
  3. 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 91
  4. 2022Towards Spatio-Temporal Aware Traffic Time Series Forecasting--Full Versioncited by 59
  5. 2022Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting--Full Versioncited by 59
  6. 2022Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semanticscited by 58
  7. 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Versioncited by 48
  8. 2021Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Versioncited by 35
  9. 2022Jointly Contrastive Representation Learning on Road Network and Trajectorycited by 34
  10. 2023LightPath: Lightweight and Scalable Path Representation Learningcited by 32
  11. 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
  12. 2024Trajectory Data Management and Mining: A Survey from Deep Learning to the LLM Eracited by 23
30 more
  1. 2024More Than Routing: Joint GPS and Route Modeling for Refine Trajectory Representation Learningcited by 20
  2. 2022Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Versioncited by 19
  3. 2024BIGCity: A Universal Spatiotemporal Model for Unified Trajectory and Traffic State Data Analysiscited by 16
  4. 2022Weakly-supervised Temporal Path Representation Learning with Contrastive Curriculum Learning -- Extended Versioncited by 15
  5. 2025Bridging Traffic State and Trajectory for Dynamic Road Network and Trajectory Representation Learningcited by 14
  6. 2024Self-Supervised Representation Learning for Geospatial Objects: A Surveycited by 8
  7. 2024RED: Effective Trajectory Representation Learning with Comprehensive Informationcited by 8
  8. 2025Blurred Encoding for Trajectory Representation Learningcited by 8
  9. 2024Grid and Road Expressions Are Complementary for Trajectory Representation Learningcited by 7
  10. 2025K2VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecastingcited by 7
  11. 2022Fine-Grained Trajectory-based Travel Time Estimation for Multi-city Scenarios Based on Deep Meta-Learningcited by 6
  12. 2023A Critical Perceptual Pre-trained Model for Complex Trajectory Recoverycited by 4
  13. 2024TrajCogn: Leveraging LLMs for Cognizing Movement Patterns and Travel Purposes from Trajectoriescited by 4
  14. 2025RCRank: Multimodal Ranking of Root Causes of Slow Queries in Cloud Database Systemscited by 4
  15. 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigmscited by 4
  16. 2023VisionTraj: A Noise-Robust Trajectory Recovery Framework based on Large-scale Camera Networkcited by 3
  17. 2025Towards Lightweight Time Series Forecasting: a Patch-wise Transformer with Weak Data Enrichingcited by 3
  18. 2025Spatio-Temporal Trajectory Foundation Model - Recent Advances and Future Directionscited by 3
  19. 2023Jointly spatial-temporal representation learning for individual trajectoriescited by 2
  20. 2024Context-Enhanced Multi-View Trajectory Representation Learning: Bridging the Gap through Self-Supervised Modelscited by 2
  21. 2025Data Driven Decision Making with Time Series and Spatio-temporal Datacited by 2
  22. 2026TrajTok: Adaptive Spatial Tokenization for Trajectory Representation Learningcited by 1
  23. 2026REFINE: Trajectory Representation Learning via Closed-Loop Transcription -- Extended Versioncited by 1
  24. 2026DGCPath: Distribution-Aware Generative Contrastive Framework for Self-supervised Path Representation Learning -- Extended Versioncited by 1
  25. 2024STAHGNet: Modeling Hybrid-grained Heterogenous Dependency Efficiently for Traffic Predictioncited by 0
  26. 2025Capturing Context-Aware Route Choice Semantics for Trajectory Representation Learningcited by 0
  27. 2026Accurate and Efficient Multi-Channel Time Series Forecasting via Sparse Attention Mechanismcited by 0
  28. 2026TraveL: Transformer-based Multi-view Path Distributional Representation Learningcited by 0
  29. 2026HypLTSF: A Hyperbolic Geometric View of Multi-Scale Hierarchies for Long-Term Time Series Forecastingcited by 0
  30. 2026When Correlations Mislead: Confounder-Aware Multi-View Urban Region Representation Learningcited by 0