mlsanityData to 7 Oct 2026

TrackGPT -- A generative pre-trained transformer for cross-domain entity trajectory forecasting

arXiv 2402.00066 ↗First posted 29 Jan 2024cs.LG cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

The forecasting of entity trajectories at future points in time is a critical capability gap in applications across both Commercial and Defense sectors. Transformers, and specifically Generative Pre-trained Transformer (GPT) networks have recently revolutionized several fields of Artificial Intelligence, most notably Natural Language Processing (NLP) with the advent of Large Language Models (LLM) like OpenAI's ChatGPT. In this research paper, we introduce TrackGPT, a GPT-based model for entity trajectory forecasting that has shown utility across both maritime and air domains, and we expect to perform well in others. TrackGPT stands as a pioneering GPT model capable of producing accurate predictions across diverse entity time series datasets, demonstrating proficiency in generating both long-term forecasts with sustained accuracy and short-term forecasts with high precision. We present benchmarks against state-of-the-art deep learning techniques, showing that TrackGPT's forecasting capability excels in terms of accuracy, reliability, and modularity. Importantly, TrackGPT achieves these results while remaining domain-agnostic and requiring minimal data features (only location and time) compared to models achieving similar performance. In conclusion, our findings underscore the immense potential of applying GPT architectures to the task of entity trajectory forecasting, exemplified by the innovative TrackGPT model.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 7 of its 23 references that are in the map. First posted on arXiv 29 Jan 2024.

Builds on

7 of 23 references.

References · 7

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
  3. 2020Transformer Networks for Trajectory Forecastingcited by 180
  4. 2023TimeGPT-1cited by 149
  5. 2021Deep Learning Methods for Vessel Trajectory Prediction based on Recurrent Neural Networkscited by 32
  6. 2019GeoTrackNet-A Maritime Anomaly Detector using Probabilistic Neural Network Representation of AIS Tracks and A Contrario Detectioncited by 16
  7. 2021Predicting Like A Pilot: Dataset and Method to Predict Socially-Aware Aircraft Trajectories in Non-Towered Terminal Airspacecited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 8; 2026: 3.

13 papers.

Sort:

By area: