mlsanityData to 14 Oct 2026

Geo-Llama: Leveraging LLMs for Human Mobility Trajectory Generation with Spatiotemporal Constraints

arXiv 2408.13918 ↗First posted 25 Aug 2024cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Generating realistic human mobility data is essential for various application domains, including transportation, urban planning, and epidemic control, as real data is often inaccessible to researchers due to high costs and privacy concerns. Existing deep generative models learn from real trajectories to generate synthetic ones. Despite the progress, most of them suffer from training stability issues and scale poorly with increasing data size. More importantly, they often lack control mechanisms to guide the generated trajectories under constraints such as enforcing specific visits. To address these limitations, we formally define the controlled trajectory generation problem for effectively handling multiple spatiotemporal constraints. We introduce Geo-Llama, a novel LLM finetuning framework that can enforce multiple explicit visit constraints while maintaining contextual coherence of the generated trajectories. In this approach, pre-trained LLMs are fine-tuned on trajectory data with a visit-wise permutation strategy where each visit corresponds to a specific time and location. This strategy enables the model to capture spatiotemporal patterns regardless of visit orders while maintaining flexible and in-context constraint integration through prompts during generation. Extensive experiments on real-world and synthetic datasets validate the effectiveness of Geo-Llama, demonstrating its versatility and robustness in handling a broad range of constraints to generate more realistic trajectories compared to existing methods.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 21 of its 51 references that are in the map. First posted on arXiv 25 Aug 2024.

Builds on

21 of 51 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2023A Comprehensive Overview of Large Language Modelscited by 648
  5. 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 376
  6. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
  7. 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
  8. 2020Enabling Language Models to Fill in the Blankscited by 122
  9. 2021STAN: Spatio-Temporal Attention Network for Next Location Recommendationcited by 102
  10. 2024Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generationcited by 100
  11. 2023DiffTraj: Generating GPS Trajectory with Diffusion Probabilistic Modelcited by 65
  12. 2023GETNext: Trajectory Flow Map Enhanced Transformer for Next POI Recommendationcited by 58
9 more
  1. 2024ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Modelcited by 49
  2. 2021Neural Point Process for Learning Spatiotemporal Event Dynamicscited by 42
  3. 2024Large Language Models for Next Point-of-Interest Recommendationcited by 40
  4. 2020STP-UDGAT: Spatial-Temporal-Preference User Dimensional Graph Attention Network for Next POI Recommendationcited by 31
  5. 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
  6. 2022PrivTrace: Differentially Private Trajectory Synthesis by Adaptive Markov Modelcited by 13
  7. 2024Urban Mobility Assessment Using LLMscited by 13
  8. 2024HRNet: Differentially Private Hierarchical and Multi-Resolution Network for Human Mobility Data Synthesizationcited by 2
  9. 2020Factorized Deep Generative Models for Trajectory Generation with Spatiotemporal-Validity Constraintscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.