# Spatio-Temporal Trajectory Foundation Model - Recent Advances and Future Directions

arXiv: https://arxiv.org/abs/2511.20729 · HTML: https://mlsanity.com/paper/2511.20729/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 46 references that are in the map.
- First posted on arXiv 25 Nov 2025.

## Builds on (most cited first, 22 of 22)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Contrastive Multiview Coding](https://mlsanity.com/paper/1906.05849/) (2019)
- [Graph Contrastive Learning with Augmentations](https://mlsanity.com/paper/2010.13902/) (2020)
- [Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semantics](https://mlsanity.com/paper/2211.09510/) (2022)
- [ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Model](https://mlsanity.com/paper/2404.15380/) (2024)
- [Contrastive Trajectory Similarity Learning with Dual-Feature Attention](https://mlsanity.com/paper/2210.05155/) (2022)
- [Unsupervised Path Representation Learning with Curriculum Negative Sampling](https://mlsanity.com/paper/2106.09373/) (2021)
- [LightPath: Lightweight and Scalable Path Representation Learning](https://mlsanity.com/paper/2307.10171/) (2023)
- [Deep Spatially and Temporally Aware Similarity Computation for Road Network Constrained Trajectories](https://mlsanity.com/paper/2112.09339/) (2021)
- [Pre-training General Trajectory Embeddings with Maximum Multi-view Entropy Coding](https://mlsanity.com/paper/2207.14539/) (2022)
- [Origin-Destination Travel Time Oracle for Map-based Services](https://mlsanity.com/paper/2307.03048/) (2023)
- [More Than Routing: Joint GPS and Route Modeling for Refine Trajectory Representation Learning](https://mlsanity.com/paper/2402.16915/) (2024)
- [Weakly-supervised Temporal Path Representation Learning with Contrastive Curriculum Learning -- Extended Version](https://mlsanity.com/paper/2203.16110/) (2022)
- [MM-Path: Multi-modal, Multi-granularity Path Representation Learning -- Extended Version](https://mlsanity.com/paper/2411.18428/) (2024)
- [Bridging Traffic State and Trajectory for Dynamic Road Network and Trajectory Representation Learning](https://mlsanity.com/paper/2502.06870/) (2025)
- [RED: Effective Trajectory Representation Learning with Comprehensive Information](https://mlsanity.com/paper/2411.15096/) (2024)
- [Grid and Road Expressions Are Complementary for Trajectory Representation Learning](https://mlsanity.com/paper/2411.14768/) (2024)
- [CausalTAD: Causal Implicit Generative Model for Debiased Online Trajectory Anomaly Detection](https://mlsanity.com/paper/2412.18820/) (2024)
- [Towards Robust Trajectory Representations: Isolating Environmental Confounders with Causal Learning](https://mlsanity.com/paper/2404.14073/) (2024)
- [TrajCogn: Leveraging LLMs for Cognizing Movement Patterns and Travel Purposes from Trajectories](https://mlsanity.com/paper/2405.12459/) (2024)
- [UVTM: Universal Vehicle Trajectory Modeling with ST Feature Domain Generation](https://mlsanity.com/paper/2402.07232/) (2024)
- [LLMs Meet Cross-Modal Time Series Analytics: Overview and Directions](https://mlsanity.com/paper/2507.10620/) (2025)

## Built on by (most cited first, 3 of 3)

- [REFINE: Trajectory Representation Learning via Closed-Loop Transcription -- Extended Version](https://mlsanity.com/paper/2609.07206/) (2026)
- [DGCPath: Distribution-Aware Generative Contrastive Framework for Self-supervised Path Representation Learning -- Extended Version](https://mlsanity.com/paper/2609.07316/) (2026)
- [When Correlations Mislead: Confounder-Aware Multi-View Urban Region Representation Learning](https://mlsanity.com/paper/2609.15305/) (2026)

## Abstract (arXiv)

Foundation models (FMs) have emerged as a powerful paradigm, enabling a diverse range of data analytics and knowledge discovery tasks across scientific fields. Inspired by the success of FMs, particularly large language models, researchers have recently begun to explore spatio-temporal foundation models (STFMs) to improve adaptability and generalization across a wide spectrum of spatio-temporal (ST) tasks. Despite rapid progress, a systematic investigation of trajectory foundation models (TFMs), a crucial subclass of STFMs, is largely lacking. This tutorial addresses this gap by offering a comprehensive overview of recent advances in TFMs, including a taxonomy of existing methodologies and a critical analysis of their strengths and limitations. In addition, the tutorial highlights open challenges and outlines promising research directions to advance spatio-temporal general intelligence through the development of robust, responsible, and transferable TFMs.