MoveGPT: Scaling Mobility Foundation Models with Spatially-Aware Mixture of Experts
On the map: Mixture-of-experts → MoE for time series and graphs
Abstract (arXiv)
The success of foundation models in language has inspired a new wave of general-purpose models for human mobility. However, existing approaches struggle to scale effectively due to two fundamental limitations: a failure to use meaningful basic units to represent movement, and an inability to capture the vast diversity of patterns found in large-scale data. In this work, we develop MoveGPT, a large-scale foundation model specifically architected to overcome these barriers. MoveGPT is built upon two key innovations: (1) a unified location encoder that maps geographically disjoint locations into a shared semantic space, enabling pre-training on a global scale; and (2) a Spatially-Aware Mixture-of-Experts Transformer that develops specialized experts to efficiently capture diverse mobility patterns. Pre-trained on billion-scale datasets, MoveGPT establishes a new state-of-the-art across a wide range of downstream tasks, achieving performance gains of up to 35% on average. It also demonstrates strong generalization capabilities to unseen cities. Crucially, our work provides empirical evidence of scaling ability in human mobility, validating a clear path toward building increasingly capable foundation models in this domain.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 22 of its 52 references that are in the map. First posted on arXiv 24 May 2025.
Builds on
22 of 52 references.
References · 22
- 2017Attention Is All You Needcited by 60,361
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
- 2022Mixture-of-Experts with Expert Choice Routingcited by 623
- 2017Deep & Cross Network for Ad Click Predictionscited by 393
- 2016LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detectioncited by 215
- 2023Where Would I Go Next? Large Language Models as Human Mobility Predictorscited by 93
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 87
- 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
10 more
- 2023DiffTraj: Generating GPS Trajectory with Diffusion Probabilistic Modelcited by 65
- 2023GETNext: Trajectory Flow Map Enhanced Transformer for Next POI Recommendationcited by 58
- 2023Spatio-temporal Diffusion Point Processescited by 52
- 2021MobTCast: Leveraging Auxiliary Trajectory Forecasting for Human Mobility Predictioncited by 48
- 2024Be More Real: Travel Diary Generation Using LLM Agents and Individual Profilescited by 22
- 2024TrajFM: A Vehicle Trajectory Foundation Model for Region and Task Transferabilitycited by 16
- 2024TrajGPT: Controlled Synthetic Trajectory Generation Using a Multitask Transformer-Based Spatiotemporal Modelcited by 13
- 2024Diffusion Transformers as Open-World Spatiotemporal Foundation Modelscited by 10
- 2024A Universal Model for Human Mobility Predictioncited by 10
- 2025One Fits All: General Mobility Trajectory Modeling via Masked Conditional Diffusioncited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoning
- 2025Mixture-of-Experts for Personalized and Semantic-Aware Next Location Prediction
- 2024MobilityGPT: Enhanced Human Mobility Modeling with a GPT model
- 2025UniMove: A Unified Model for Multi-city Human Mobility Prediction
- 2025Enhancing Large Language Models for Mobility Analytics with Semantic Location Tokenization
- 2025Deep Generative Model for Human Mobility Behavior
- 2025MoE-TransMov: A Transformer-based Model for Next POI Prediction in Familiar & Unfamiliar Movements
- 2026ARMove: Learning to Predict Human Mobility through Agentic Reasoning