mlsanityData to 7 Oct 2026

Detecting Transportation Mode Using Dense Smartphone GPS Trajectories and Transformer Models

arXiv 2603.00340 ↗First posted 27 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Transportation mode detection is an important topic within GeoAI and transportation research. In this study, we introduce SpeedTransformer, a novel Transformer-based model that relies solely on speed inputs to infer transportation modes from dense smartphone GPS trajectories. In benchmark experiments, SpeedTransformer outperformed traditional deep learning models, such as the Long Short-Term Memory (LSTM) network. Moreover, the model demonstrated strong flexibility in transfer learning, achieving high accuracy across geographical regions after fine-tuning with small datasets. Finally, we deployed the model in a real-world experiment, where it consistently outperformed baseline models under complex built environments and high data uncertainty. These findings suggest that Transformer architectures, when combined with dense GPS trajectories, hold substantial potential for advancing transportation mode detection and broader mobility-related research.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 75 references that are in the map. First posted on arXiv 27 Feb 2026.

Builds on

17 of 75 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  6. 2020GLU Variants Improve Transformercited by 1,724
  7. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
  8. 2016Long Short-Term Memory-Networks for Machine Readingcited by 161
  9. 2022Leveraging Language Foundation Models for Human Mobility Forecastingcited by 50
  10. 2018Inferring transportation modes from GPS trajectories using a convolutional neural networkcited by 26
  11. 2017Trajectory Recovery From Ash: User Privacy Is NOT Preserved in Aggregated Mobility Datacited by 17
  12. 2024Future Directions in Human Mobility Sciencecited by 16
5 more
  1. 2022How do you go where? Improving next location prediction by learning travel mode information using transformerscited by 12
  2. 2017TrajectoryNet: An Embedded GPS Trajectory Representation for Point-based Classification Using Recurrent Neural Networkscited by 10
  3. 2015The Effect of Recency to Human Mobilitycited by 6
  4. 2020Evidence of economic segregation from mobility lockdown during COVID-19 epidemiccited by 6
  5. 2024MobilityDL: A Review of Deep Learning From Trajectory Datacited by 6

Built on by

Not cited yet.