Enhancing Large Language Models for Mobility Analytics with Semantic Location Tokenization
Not on the map. Why?
Abstract (arXiv)
The widespread adoption of location-based services has led to the generation of vast amounts of mobility data, providing significant opportunities to model user movement dynamics within urban environments. Recent advancements have focused on adapting Large Language Models (LLMs) for mobility analytics. However, existing methods face two primary limitations: inadequate semantic representation of locations (i.e., discrete IDs) and insufficient modeling of mobility signals within LLMs (i.e., single templated instruction fine-tuning). To address these issues, we propose QT-Mob, a novel framework that significantly enhances LLMs for mobility analytics. QT-Mob introduces a location tokenization module that learns compact, semantically rich tokens to represent locations, preserving contextual information while ensuring compatibility with LLMs. Furthermore, QT-Mob incorporates a series of complementary fine-tuning objectives that align the learned tokens with the internal representations in LLMs, improving the model's comprehension of sequential movement patterns and location semantics. The proposed QT-Mob framework not only enhances LLMs' ability to interpret mobility data but also provides a more generalizable approach for various mobility analytics tasks. Experiments on three real-world dataset demonstrate the superior performance in both next-location prediction and mobility recovery tasks, outperforming existing deep learning and LLM-based methods.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 20 of its 55 references that are in the map. First posted on arXiv 8 Jun 2025.
Builds on
20 of 55 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2017Neural Discrete Representation Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2021STAN: Spatio-Temporal Attention Network for Next Location Recommendationcited by 102
- 2024Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generationcited by 100
- 2020A Survey on Deep Learning for Human Mobilitycited by 88
- 2024Large Language Models for Next Point-of-Interest Recommendationcited by 40
- 2024A Unified Replay-based Continuous Learning Framework for Spatio-Temporal Prediction on Streaming Datacited by 39
8 more
- 2020STP-UDGAT: Spatial-Temporal-Preference User Dimensional Graph Attention Network for Next POI Recommendationcited by 31
- 2016Learning Points and Routes to Recommend Trajectoriescited by 13
- 2024A Survey on Point-of-Interest Recommendation: Models, Architectures, and Securitycited by 12
- 2021AttnMove: History Enhanced Trajectory Recovery via Attentional Networkcited by 11
- 2024LAMP: A Language Model on the Mapcited by 9
- 2024Self-Supervised Representation Learning for Geospatial Objects: A Surveycited by 9
- 2024GenUP: Generative User Profilers as In-Context Learners for Next POI Recommender Systemscited by 6
- 2021Modelling of Bi-directional Spatio-Temporal Dependence and Users' Dynamic Preferences for Missing POI Check-in Identificationcited by 5
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2026Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Modelscited by 2
- 2026Bus-Conditioned Zero-Shot Trajectory Generation via Task Arithmeticcited by 2
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoningcited by 1
- 2025TS-Mob: Social and Geographical-Aware Time Series Foundation-Model Framework for Human Mobility Predictioncited by 0
- 2025STRelay: A Universal Spatio-Temporal Relaying Framework for Location Prediction over Human Trajectory Datacited by 0
- 2026Do LLMs Know Your Neighborhood? Auditing LLM Priors for Neighborhood-Level Mobility Prediction and Structural Alignmentcited by 0
- 2026On the security and privacy of LLMs in Mobilitycited by 0
- 2026Plan-to-Synthesis: Cross-City Human Mobility Generation via Semantic Latent Flow Matchingcited by 0
- 2026Plan-to-Synthesis: Cross-City Human Mobility Generation via Semantic Latent Flow Matching26 Sep 2026
- 2026On the security and privacy of LLMs in Mobility22 Sep 2026
- 2026Do LLMs Know Your Neighborhood? Auditing LLM Priors for Neighborhood-Level Mobility Prediction and Structural Alignment31 Aug 2026
- 2026Bus-Conditioned Zero-Shot Trajectory Generation via Task Arithmetic13 Feb 2026
- 2026Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Models17 Jan 2026
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoning26 Sep 2025
- 2025STRelay: A Universal Spatio-Temporal Relaying Framework for Location Prediction over Human Trajectory Data14 Aug 2025
- 2025TS-Mob: Social and Geographical-Aware Time Series Foundation-Model Framework for Human Mobility Prediction1 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2023Where Would I Go Next? Large Language Models as Human Mobility Predictors
- 2024Mobility-LLM: Learning Visiting Intentions and Travel Preferences from Human Mobility Data with Large Language Models
- 2025MoveGPT: Scaling Mobility Foundation Models with Spatially-Aware Mixture of Experts
- 2025RHYTHM: Reasoning with Hierarchical Temporal Tokenization for Human Mobility
- 2024Human Mobility Modeling with Household Coordination Activities under Limited Information via Retrieval-Augmented LLMs
- 2024LIMP: Large Language Model Enhanced Intent-aware Mobility Prediction
- 2025SeMob: Semantic Synthesis for Dynamic Urban Mobility Prediction
- 2025Mixture-of-Experts for Personalized and Semantic-Aware Next Location Prediction