mlsanityData to 14 Oct 2026

A Foundational Individual Mobility Prediction Model based on Open-Source Large Language Models

arXiv 2503.16553 ↗First posted 19 Mar 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Individual mobility prediction plays a key role in urban transport, enabling personalized service recommendations and effective travel management. It is widely modeled by data-driven methods such as machine learning, deep learning, as well as classical econometric methods to capture key features of mobility patterns. However, such methods are hindered in promoting further transferability and robustness due to limited capacity to learn mobility patterns from different data sources, predict in out-of-distribution settings (a.k.a ``zero-shot"). To address this challenge, this paper introduces MoBLLM, a foundational model for individual mobility prediction that aims to learn a shared and transferable representation of mobility behavior across heterogeneous data sources. Based on a lightweight open-source large language model (LLM), MoBLLM employs Parameter-Efficient Fine-Tuning (PEFT) techniques to create a cost-effective training pipeline, avoiding the need for large-scale GPU clusters while maintaining strong performance. We conduct extensive experiments on six real-world mobility datasets to evaluate its accuracy, robustness, and transferability across varying temporal scales (years), spatial contexts (cities), and situational conditions (e.g., disruptions and interventions). MoBLLM achieves the best F1 score and accuracy across all datasets compared with state-of-the-art deep learning models and shows better transferability and cost efficiency than commercial LLMs. Further experiments reveal its robustness under network changes, policy interventions, special events, and incidents. These results indicate that MoBLLM provides a generalizable modeling foundation for individual mobility behavior, enabling more reliable and adaptive personalized information services for transportation management.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 58 references that are in the map. First posted on arXiv 19 Mar 2025.

Builds on

32 of 58 references.

References · 32

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  9. 2019Invariant Risk Minimizationcited by 1,854
  10. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  11. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
  12. 2013Domain Generalization via Invariant Feature Representationcited by 623
20 more
  1. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  2. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
  3. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 377
  4. 2024PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Modelscited by 269
  5. 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 243
  6. 2023LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Modelscited by 196
  7. 2024Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generationcited by 100
  8. 2023Where Would I Go Next? Large Language Models as Human Mobility Predictorscited by 93
  9. 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 69
  10. 2024The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunitiescited by 64
  11. 2021MobTCast: Leveraging Auxiliary Trajectory Forecasting for Human Mobility Predictioncited by 48
  12. 2024OLoRA: Orthonormal Low-Rank Adaptation of Large Language Modelscited by 39
  13. 2023Exploring Large Language Models for Human Mobility Prediction under Public Eventscited by 34
  14. 2024AgentMove: A Large Language Model based Agentic Framework for Zero-shot Next Location Predictioncited by 25
  15. 2024Mobility-LLM: Learning Visiting Intentions and Travel Preferences from Human Mobility Data with Large Language Modelscited by 22
  16. 2022Context-aware multi-head self-attentional neural network model for next location predictioncited by 21
  17. 2024Where to Move Next: Zero-shot Generalization of LLMs for Next POI Recommendationcited by 17
  18. 2021Point-of-Interest Recommender Systems based on Location-Based Social Networks: A Survey from an Experimental Perspectivecited by 13
  19. 2024AI-Driven Day-to-Day Route Choicecited by 13
  20. 2024LIMP: Large Language Model Enhanced Intent-aware Mobility Predictioncited by 8

Built on by

Not cited yet.