mlsanityData to 7 Oct 2026

TrajCogn: Leveraging LLMs for Cognizing Movement Patterns and Travel Purposes from Trajectories

arXiv 2405.12459 ↗First posted 21 May 2024cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Spatio-temporal trajectories are crucial in various data mining tasks. It is important to develop a versatile trajectory learning method that performs different tasks with high accuracy. This involves effectively extracting two core aspects of information--movement patterns and travel purposes--from trajectories. However, this is challenging due to limitations in model capacity and the quality and scale of trajectory datasets. Meanwhile, large language models (LLMs) have shown great success in versatility by training on large-scale, high-quality datasets. Given the similarities between trajectories and sentences, there's potential to leverage LLMs to develop an effective trajectory learning method. However, standard LLMs are not designed to handle the unique spatio-temporal features of trajectories and cannot extract movement patterns and travel purposes. To address these challenges, we propose a model called TrajCogn that effectively utilizes LLMs to model trajectories. TrajCogn leverages the strengths of LLMs to create a versatile trajectory learning approach while addressing the limitations of standard LLMs. First, TrajCogn incorporates a novel trajectory semantic embedder that enables LLMs to process spatio-temporal features and extract movement patterns and travel purposes. Second, TrajCogn introduces a new trajectory prompt that integrates these patterns and purposes into LLMs, allowing the model to adapt to various tasks. Extensive experiments on two real-world datasets and two representative tasks demonstrate that TrajCogn successfully achieves its design goals. Codes are available at https://anonymous.4open.science/r/TrajCogn-5021.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 21 of its 55 references that are in the map. First posted on arXiv 21 May 2024.

Builds on

21 of 55 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  8. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  9. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  10. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  11. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  12. 2015Semi-supervised Sequence Learningcited by 198
9 more
  1. 2023Representation Learning with Large Language Models for Recommendationcited by 155
  2. 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
  3. 2022Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semanticscited by 58
  4. 2022Contrastive Trajectory Similarity Learning with Dual-Feature Attentioncited by 44
  5. 2021Unsupervised Path Representation Learning with Curriculum Negative Samplingcited by 42
  6. 2023Frozen Transformers in Language Models Are Effective Visual Encoder Layerscited by 39
  7. 2023LightPath: Lightweight and Scalable Path Representation Learningcited by 32
  8. 2021Deep Spatially and Temporally Aware Similarity Computation for Road Network Constrained Trajectoriescited by 29
  9. 2022Pre-training General Trajectory Embeddings with Maximum Multi-view Entropy Codingcited by 25

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.