Mobility-LLM: Learning Visiting Intentions and Travel Preferences from Human Mobility Data with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Location-based services (LBS) have accumulated extensive human mobility data on diverse behaviors through check-in sequences. These sequences offer valuable insights into users' intentions and preferences. Yet, existing models analyzing check-in sequences fail to consider the semantics contained in these sequences, which closely reflect human visiting intentions and travel preferences, leading to an incomplete comprehension. Drawing inspiration from the exceptional semantic understanding and contextual information processing capabilities of large language models (LLMs) across various domains, we present Mobility-LLM, a novel framework that leverages LLMs to analyze check-in sequences for multiple tasks. Since LLMs cannot directly interpret check-ins, we reprogram these sequences to help LLMs comprehensively understand the semantics of human visiting intentions and travel preferences. Specifically, we introduce a visiting intention memory network (VIMN) to capture the visiting intentions at each record, along with a shared pool of human travel preference prompts (HTPP) to guide the LLM in understanding users' travel preferences. These components enhance the model's ability to extract and leverage semantic information from human mobility data effectively. Extensive experiments on four benchmark datasets and three downstream tasks demonstrate that our approach significantly outperforms existing models, underscoring the effectiveness of Mobility-LLM in advancing our understanding of human mobility data within LBS contexts.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 30 of its 63 references that are in the map. First posted on arXiv 29 Oct 2024.
Builds on
30 of 63 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2024TinyLlama: An Open-Source Small Language Modelcited by 604
- 2020Transformer Hawkes Processcited by 230
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
18 more
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
- 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 165
- 2023Representation Learning with Large Language Models for Recommendationcited by 155
- 2019Intensity-Free Learning of Temporal Point Processescited by 138
- 2023Large Language Models are Few-Shot Health Learnerscited by 115
- 2021STAN: Spatio-Temporal Attention Network for Next Location Recommendationcited by 102
- 2024Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generationcited by 99
- 2023GETNext: Trajectory Flow Map Enhanced Transformer for Next POI Recommendationcited by 57
- 2023Spatio-temporal Diffusion Point Processescited by 52
- 2023Frozen Transformers in Language Models Are Effective Visual Encoder Layerscited by 39
- 2024Tiny Titans: Can Smaller Large Language Models Punch Above Their Weight in the Real World for Meeting Summarization?cited by 32
- 2022Region Embedding with Intra and Inter-View Contrastive Learningcited by 24
- 2021Virtual Augmentation Supported Contrastive Learning of Sentence Representationscited by 21
- 2022Learning Temporal Point Processes for Efficient Retrieval of Continuous Time Event Sequencescited by 14
- 2024A Survey of Generative Techniques for Spatial-Temporal Data Miningcited by 14
- 2023Revisiting Mobility Modeling with Graph: A Graph Transformer Model for Next Point-of-Interest Recommendationcited by 11
- 2021LightMove: A Lightweight Next-POI Recommendation for Taxicab Rooftop Advertisingcited by 9
- 2024Spatial-Temporal Cross-View Contrastive Pre-training for Check-in Sequence Representation Learningcited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 15; 2026: 5.
21 papers.
Sort:
By area:
- 2024Toward LLM-Agent-Based Modeling of Transportation Systems: A Conceptual Frameworkcited by 19
- 2025UrbanLLaVA: A Multi-modal Large Language Model for Urban Intelligence with Spatial Reasoning and Understandingcited by 15
- 2025A Survey of Large Language Model-Powered Spatial Intelligence Across Scales: Advances in Embodied Agents, Smart Cities, and Earth Sciencecited by 11
- 2025GATSim: Urban Mobility Simulation with Generative Agentscited by 10
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
- 2025Aligning LLM with human travel choices: a persona-based embedding learning approachcited by 7
- 2026SynHAT: A Two-stage Coarse-to-Fine Diffusion Framework for Synthesizing Human Activity Tracescited by 4
- 2025Adaptive Location Hierarchy Learning for Long-Tailed Mobility Predictioncited by 3
- 2026ELLMob: Event-Driven Human Mobility Generation with Self-Aligned LLM Frameworkcited by 3
- 2025MobiVerse: Scaling Urban Mobility Simulation with Hybrid Lightweight Domain-Specific Generator and Large Language Modelscited by 1
- 2025Benchmarking Retrieval-Augmented Generation Strategies for Large Language Model-Based Travel Mode Choice Predictioncited by 1
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoningcited by 1
9 more
- 2026TrajPrism: A Multi-Task Benchmark for Language-Grounded Urban Trajectory Understandingcited by 1
- 2025A Foundational Individual Mobility Prediction Model based on Open-Source Large Language Modelscited by 0
- 2025TS-Mob: Social and Geographical-Aware Time Series Foundation-Model Framework for Human Mobility Predictioncited by 0
- 2025Efficient Temporal Tokenization for Mobility Prediction with Large Language Modelscited by 0
- 2025STRelay: A Universal Spatio-Temporal Relaying Framework for Location Prediction over Human Trajectory Datacited by 0
- 2025Capturing Context-Aware Route Choice Semantics for Trajectory Representation Learningcited by 0
- 2025Beyond Shortest Path: Agentic Vehicular Routing with Semantic Contextcited by 0
- 2026TraXion: Rethinking Pre-training Frameworks for Mobility and Beyondcited by 0
- 2026SafeStep: AI-powered Travel Assistance for Elderly People with Frailty or Dementiacited by 0
- 2026SafeStep: AI-powered Travel Assistance for Elderly People with Frailty or Dementia23 Jul 2026
- 2026TrajPrism: A Multi-Task Benchmark for Language-Grounded Urban Trajectory Understanding11 May 2026
- 2026TraXion: Rethinking Pre-training Frameworks for Mobility and Beyond7 May 2026
- 2026SynHAT: A Two-stage Coarse-to-Fine Diffusion Framework for Synthesizing Human Activity Traces16 Apr 2026
- 2026ELLMob: Event-Driven Human Mobility Generation with Self-Aligned LLM Framework9 Mar 2026
- 2025Beyond Shortest Path: Agentic Vehicular Routing with Semantic Context6 Nov 2025
- 2025Capturing Context-Aware Route Choice Semantics for Trajectory Representation Learning16 Oct 2025
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoning26 Sep 2025
- 2025Benchmarking Retrieval-Augmented Generation Strategies for Large Language Model-Based Travel Mode Choice Prediction24 Aug 2025
- 2025STRelay: A Universal Spatio-Temporal Relaying Framework for Location Prediction over Human Trajectory Data14 Aug 2025
- 2025Efficient Temporal Tokenization for Mobility Prediction with Large Language Models18 Jul 2025
- 2025TS-Mob: Social and Geographical-Aware Time Series Foundation-Model Framework for Human Mobility Prediction1 Jul 2025
9 more
- 2025GATSim: Urban Mobility Simulation with Generative Agents29 Jun 2025
- 2025UrbanLLaVA: A Multi-modal Large Language Model for Urban Intelligence with Spatial Reasoning and Understanding29 Jun 2025
- 2025MobiVerse: Scaling Urban Mobility Simulation with Hybrid Lightweight Domain-Specific Generator and Large Language Models26 Jun 2025
- 2025Adaptive Location Hierarchy Learning for Long-Tailed Mobility Prediction26 May 2025
- 2025Aligning LLM with human travel choices: a persona-based embedding learning approach25 May 2025
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review19 May 2025
- 2025A Survey of Large Language Model-Powered Spatial Intelligence Across Scales: Advances in Embodied Agents, Smart Cities, and Earth Science14 Apr 2025
- 2025A Foundational Individual Mobility Prediction Model based on Open-Source Large Language Models19 Mar 2025
- 2024Toward LLM-Agent-Based Modeling of Transportation Systems: A Conceptual Framework9 Dec 2024
- 2025UrbanLLaVA: A Multi-modal Large Language Model for Urban Intelligence with Spatial Reasoning and Understandingcited by 15
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoningcited by 1
- 2026TraXion: Rethinking Pre-training Frameworks for Mobility and Beyondcited by 0
- 2026TraXion: Rethinking Pre-training Frameworks for Mobility and Beyond7 May 2026
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoning26 Sep 2025
- 2025UrbanLLaVA: A Multi-modal Large Language Model for Urban Intelligence with Spatial Reasoning and Understanding29 Jun 2025
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
- 2025Aligning LLM with human travel choices: a persona-based embedding learning approachcited by 7
- 2026SynHAT: A Two-stage Coarse-to-Fine Diffusion Framework for Synthesizing Human Activity Tracescited by 4
- 2025Adaptive Location Hierarchy Learning for Long-Tailed Mobility Predictioncited by 3
- 2026ELLMob: Event-Driven Human Mobility Generation with Self-Aligned LLM Frameworkcited by 3
- 2025MobiVerse: Scaling Urban Mobility Simulation with Hybrid Lightweight Domain-Specific Generator and Large Language Modelscited by 1
- 2026TrajPrism: A Multi-Task Benchmark for Language-Grounded Urban Trajectory Understandingcited by 1
- 2025A Foundational Individual Mobility Prediction Model based on Open-Source Large Language Modelscited by 0
- 2025TS-Mob: Social and Geographical-Aware Time Series Foundation-Model Framework for Human Mobility Predictioncited by 0
- 2025Efficient Temporal Tokenization for Mobility Prediction with Large Language Modelscited by 0
- 2025STRelay: A Universal Spatio-Temporal Relaying Framework for Location Prediction over Human Trajectory Datacited by 0
- 2025Capturing Context-Aware Route Choice Semantics for Trajectory Representation Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026SafeStep: AI-powered Travel Assistance for Elderly People with Frailty or Dementia23 Jul 2026
- 2026TrajPrism: A Multi-Task Benchmark for Language-Grounded Urban Trajectory Understanding11 May 2026
- 2026SynHAT: A Two-stage Coarse-to-Fine Diffusion Framework for Synthesizing Human Activity Traces16 Apr 2026
- 2026ELLMob: Event-Driven Human Mobility Generation with Self-Aligned LLM Framework9 Mar 2026
- 2025Capturing Context-Aware Route Choice Semantics for Trajectory Representation Learning16 Oct 2025
- 2025STRelay: A Universal Spatio-Temporal Relaying Framework for Location Prediction over Human Trajectory Data14 Aug 2025
- 2025Efficient Temporal Tokenization for Mobility Prediction with Large Language Models18 Jul 2025
- 2025TS-Mob: Social and Geographical-Aware Time Series Foundation-Model Framework for Human Mobility Prediction1 Jul 2025
- 2025MobiVerse: Scaling Urban Mobility Simulation with Hybrid Lightweight Domain-Specific Generator and Large Language Models26 Jun 2025
- 2025Adaptive Location Hierarchy Learning for Long-Tailed Mobility Prediction26 May 2025
- 2025Aligning LLM with human travel choices: a persona-based embedding learning approach25 May 2025
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review19 May 2025
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Where Would I Go Next? Large Language Models as Human Mobility Predictors
- 2024Be More Real: Travel Diary Generation Using LLM Agents and Individual Profiles
- 2024LIMP: Large Language Model Enhanced Intent-aware Mobility Prediction
- 2026Think Before You Act: Intention-Guided Reasoning for LLM-Based Location Prediction
- 2024Human Mobility Modeling with Household Coordination Activities under Limited Information via Retrieval-Augmented LLMs
- 2026InsTraj: Instructing Diffusion Models with Travel Intentions to Generate Real-world Trajectories
- 2025Zero-Shot Human Mobility Forecasting via Large Language Model with Hierarchical Reasoning
- 2024From Twitter to Reasoner: Understand Mobility Travel Modes and Sentiment Using Large Language Models