Cognitive-Aligned Spatio-Temporal Large Language Models For Next Point-of-Interest Prediction
On the map: LLM alignment / RLHF / preference optimisation → Preference alignment for recommenders and RAG
Abstract (arXiv)
The next point-of-interest (POI) recommendation task aims to predict the users' immediate next destinations based on their preferences and historical check-ins, holding significant value in location-based services. Recently, large language models (LLMs) have shown great potential in recommender systems, which treat the next POI prediction in a generative manner. However, these LLMs, pretrained primarily on vast corpora of unstructured text, lack the native understanding of structured geographical entities and sequential mobility patterns required for next POI prediction tasks. Moreover, in industrial-scale POI prediction applications, incorporating world knowledge and alignment of human cognition, such as seasons, weather conditions, holidays, and users' profiles (such as habits, occupation, and preferences), can enhance the user experience while improving recommendation performance. To address these issues, we propose CoAST (Cognitive-Aligned Spatial-Temporal LLMs), a framework employing natural language as an interface, allowing for the incorporation of world knowledge, spatio-temporal trajectory patterns, profiles, and situational information. Specifically, CoAST mainly comprises of 2 stages: (1) Recommendation Knowledge Acquisition through continued pretraining on the enriched spatial-temporal trajectory data of the desensitized users; (2) Cognitive Alignment to align cognitive judgments with human preferences using enriched training data through Supervised Fine-Tuning (SFT) and a subsequent Reinforcement Learning (RL) phase. Extensive offline experiments on various real-world datasets and online experiments deployed in "Guess Where You Go" of AMAP App homepage demonstrate the effectiveness of CoAST.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Preference alignment for recommenders and RAG, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 22 of its 45 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
22 of 45 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2024DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Servingcited by 595
- 2024Better & Faster Large Language Models via Multi-token Predictioncited by 344
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
- 2019Multi-Interest Network with Dynamic Routing for Recommendation at Tmallcited by 113
- 2024Learnable Item Tokenization for Generative Recommendationcited by 106
10 more
- 2021STAN: Spatio-Temporal Attention Network for Next Location Recommendationcited by 102
- 2024Generative Recommender with End-to-End Learnable Item Tokenizationcited by 32
- 2020Large Scale Product Graph Construction for Recommendation in E-commercecited by 28
- 2024Aligning Large Language Models with Recommendation Knowledgecited by 19
- 2022AANG: Automating Auxiliary Learningcited by 12
- 2016A Survey of Point-of-interest Recommendation in Location-based Social Networkscited by 11
- 2025Universal Item Tokenization for Transferable Generative Recommendationcited by 7
- 2024Context-based Fast Recommendation Strategy for Long User Behavior Sequence in Meituan Waimaicited by 6
- 2023Difference-Masking: Choosing What to Mask in Continued Pretrainingcited by 4
- 2025A Simple Contrastive Framework Of Item Tokenization For Generative Recommendationcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025RALLM-POI: Retrieval-Augmented LLM for Zero-shot Next POI Recommendation with Geographical Reranking
- 2025TOOL4POI: A Tool-Augmented LLM Framework for Next POI Recommendation
- 2025CoMaPOI: A Collaborative Multi-Agent Framework for Next POI Prediction Bridging the Gap Between Trajectory and Language
- 2026Think2Go: Generative Next POI Recommendation with LLM Reasoning
- 2026SemPOI-RL: Aligning LLM Semantic Reasoning for Interpretable Out-of-Town POI Sequential Generation
- 2023A Diffusion model for POI recommendation
- 2026ADS-POI: Agentic Spatiotemporal State Decomposition for Next Point-of-Interest Recommendation
- 2026An Empirical Evaluation of Cross-City POI Recommendation on a Large-Scale Benchmark