U-MASK: User-adaptive Spatio-Temporal Masking for Personalized Mobile AI Applications
Not on the map. Why?
Abstract (arXiv)
Personalized mobile artificial intelligence applications are widely deployed, yet they are expected to infer user behavior from sparse and irregular histories under a continuously evolving spatio-temporal context. This setting induces a fundamental tension among three requirements, i.e., immediacy to adapt to recent behavior, stability to resist transient noise, and generalization to support long-horizon prediction and cold-start users. Most existing approaches satisfy at most two of these requirements, resulting in an inherent impossibility triangle in data-scarce, non-stationary personalization. To address this challenge, we model mobile behavior as a partially observed spatio-temporal tensor and unify short-term adaptation, long-horizon forecasting, and cold-start recommendation as a conditional completion problem, where a user- and task-specific mask specifies which coordinates are treated as evidence. We propose U-MASK, a user-adaptive spatio-temporal masking method that allocates evidence budgets based on user reliability and task sensitivity. To enable mask generation under sparse observations, U-MASK learns a compact, task-agnostic user representation from app and location histories via U-SCOPE, which serves as the sole semantic conditioning signal. A shared diffusion transformer then performs mask-guided generative completion while preserving observed evidence, so personalization and task differentiation are governed entirely by the mask and the user representation. Experiments on real-world mobile datasets demonstrate consistent improvements over state-of-the-art methods across short-term prediction, long-horizon forecasting, and cold-start settings, with the largest gains under severe data sparsity. The code and dataset will be available at https://github.com/NICE-HKU/U-MASK.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 58 references that are in the map. First posted on arXiv 11 Jan 2026.
Builds on
36 of 58 references.
References · 36
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
24 more
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
- 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attentioncited by 263
- 2023Unmasked Teacher: Towards Training-Efficient Video Foundation Modelscited by 199
- 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 197
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
- 2022Adaptive Diffusion Priors for Accelerated MRI Reconstructioncited by 118
- 2023Amortizing intractable inference in large language modelscited by 97
- 2024Spatial-Temporal Large Language Model for Traffic Predictioncited by 83
- 2024LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendationcited by 47
- 2015Understanding Mobile Traffic Patterns of Large Scale Cellular Towers in Urban Environmentcited by 18
- 2021Dual Attention-Based Federated Learning for Wireless Traffic Predictioncited by 18
- 2024LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendationcited by 18
- 2017Smartphone App Usage Prediction Using Points of Interestcited by 15
- 2024FLAP: Flow-Adhering Planning with Constrained Decoding in LLMscited by 11
- 2024SIGMA: Selective Gated Mamba for Sequential Recommendationcited by 10
- 2025LLMInit: A Free Lunch from Large Language Models for Selective Initialization of Recommendationcited by 7
- 2019Cellular Traffic Prediction and Classification: a comparative evaluation of LSTM and ARIMAcited by 4
- 2024Direct Preference Optimization for LLM-Enhanced Recommendation Systemscited by 4
- 2024AppGen: Mobility-aware App Usage Behavior Generation for Mobile Userscited by 3
- 2025Tuning Language Models for Robust Prediction of Diverse User Behaviorscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MobileMem: Learning from a Year of Mobile Experiences
- 2026Entity-Centric World Models: Interaction-Aware Masking for Causal Video Prediction
- 2025One Fits All: General Mobility Trajectory Modeling via Masked Conditional Diffusion
- 2026How Do Decoder-Only LLMs Perceive Users? Rethinking Attention Masking for User Representation Learning
- 2026PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks
- 2025FC-MIR: A Mobile Screen Awareness Framework for Intent-Aware Recommendation based on Frame-Compressed Multimodal Trajectory Reasoning
- 2026ADS-POI: Agentic Spatiotemporal State Decomposition for Next Point-of-Interest Recommendation
- 2024A Population-to-individual Tuning Framework for Adapting Pretrained LM to On-device User Intent Prediction