mlsanityData to 7 Oct 2026

Grid and Road Expressions Are Complementary for Trajectory Representation Learning

arXiv 2411.14768 ↗First posted 22 Nov 2024cs.LG cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Trajectory representation learning (TRL) maps trajectories to vectors that can be used for many downstream tasks. Existing TRL methods use either grid trajectories, capturing movement in free space, or road trajectories, capturing movement in a road network, as input. We observe that the two types of trajectories are complementary, providing either region and location information or providing road structure and movement regularity. Therefore, we propose a novel multimodal TRL method, dubbed GREEN, to jointly utilize Grid and Road trajectory Expressions for Effective representatioN learning. In particular, we transform raw GPS trajectories into both grid and road trajectories and tailor two encoders to capture their respective information. To align the two encoders such that they complement each other, we adopt a contrastive loss to encourage them to produce similar embeddings for the same raw trajectory and design a mask language model (MLM) loss to use grid trajectories to help reconstruct masked road trajectories. To learn the final trajectory representation, a dual-modal interactor is used to fuse the outputs of the two encoders via cross-attention. We compare GREEN with 7 state-of-the-art TRL methods for 3 downstream tasks, finding that GREEN consistently outperforms all baselines and improves the accuracy of the best-performing baseline by an average of 15.99%.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 22 Nov 2024.

Builds on

20 of 41 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  6. 2017Graph Attention Networkscited by 8,854
  7. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  8. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  9. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  10. 2019Time2Vec: Learning a Vector Representation of Timecited by 208
  11. 2016OSMnx: New Methods for Acquiring, Constructing, Analyzing, and Visualizing Complex Street Networkscited by 109
  12. 2022Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semanticscited by 58
8 more
  1. 2022Contrastive Trajectory Similarity Learning with Dual-Feature Attentioncited by 44
  2. 2021Unsupervised Path Representation Learning with Curriculum Negative Samplingcited by 42
  3. 2022Jointly Contrastive Representation Learning on Road Network and Trajectorycited by 34
  4. 2021Deep Spatially and Temporally Aware Similarity Computation for Road Network Constrained Trajectoriescited by 29
  5. 2024COLA: Cross-city Mobility Transformer for Human Trajectory Simulationcited by 25
  6. 2024Trajectory Data Management and Mining: A Survey from Deep Learning to the LLM Eracited by 23
  7. 2024More Than Routing: Joint GPS and Route Modeling for Refine Trajectory Representation Learningcited by 20
  8. 2023MM-DAG: Multi-task DAG Learning for Multi-modal Data -- with Application for Traffic Congestion Analysiscited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 2.

7 papers.