FOUNDv2: Learning Unified User Quantized Tokenizers for User Representation
Not on the map. Why?
Abstract (arXiv)
User representation learning serves as a fundamental pillar for personalized services on large-scale web platforms. Despite its importance, conventional continuous embedding methods face significant challenges, including the lack of a unified paradigm for multi-source data integration, prohibitive storage overhead due to low information density, and the lack of multi-scale modeling granularity. To overcome these limitations, we introduce FOUNDv2, a comprehensive user representation scheme centered on the Unified User Quantized Tokenizer U2QT) framework. FOUNDv2 transforms heterogeneous user data into a standardized discrete token space through a robust two-stage architecture. Specifically, the framework first extracts compact feature representations and subsequently employs a multi-view RQ-VAE to discretize them into storage-efficient tokens using shared and source-specific codebooks. To empower these representations with predictive intelligence, we further design multi-scale alignment objectives to capture both fine-grained behavioral dependencies and macro-temporal periodicity. Extensive experiments on various benchmarks demonstrate that FOUNDv2 consistently outperforms task-specific baselines while achieving substantial reductions in storage and computational costs. Finally, the large-scale deployment of FOUNDv2 on Alipay validates its practical scalability and efficiency across diverse industrial scenarios. The main code is available at: https://github.com/chuanhe1999/FOUNDv2.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
29 of 57 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 409
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
- 2025UniTok: A Unified Tokenizer for Visual Generation and Understandingcited by 153
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
- 2024HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modelingcited by 63
- 2023PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Informationcited by 60
- 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
17 more
- 2021MaskNet: Introducing Feature-Wise Multiplication to CTR Ranking Models by Instance-Guided Maskcited by 48
- 2025A Survey of State of the Art Large Vision Language Models: Alignment, Benchmark, Evaluations and Challengescited by 47
- 2024NoteLLM-2: Multimodal Large Representation Models for Recommendationcited by 44
- 2024NoteLLM: A Retrievable Large Language Model for Note Recommendationcited by 33
- 2020One Person, One Model, One World: Learning Continual User Representation without Forgettingcited by 30
- 2024Auto-Encoding Morph-Tokens for Multimodal LLMcited by 30
- 2024User Modeling and User Profiling: A Comprehensive Surveycited by 29
- 2018Perceive Your Users in Depth: Learning Universal User Representations from Multiple E-commerce Taskscited by 24
- 2024MMGRec: Multimodal Generative Recommendation with Transformer Modelcited by 20
- 2020Exploiting Behavioral Consistence for Universal User Representationcited by 14
- 2024Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representationcited by 14
- 2021One4all User Representation for Recommender Systems in E-commercecited by 12
- 2025Multimodal Quantitative Language for Generative Recommendationcited by 12
- 2017A Context-Aware User-Item Representation Learning for Item Recommendationcited by 11
- 2023Task Relation-aware Continual User Representation Learningcited by 7
- 2024Transferable and Forecastable User Targeting Foundation Modelcited by 4
- 2022Learning Large-scale Universal User Representation with Sparse Mixture of Expertscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Learning Representations through Token Prediction: Geometry, Approximation, and Downstream Guarantees
- 2025Breaking Token Into Concepts: Exploring Extreme Compression in Token Representation Via Compositional Shared Semantics
- 2026High Fidelity Textual User Representation over Heterogeneous Sources via Reinforcement Learning
- 2026Query as Anchor: Scenario-Adaptive User Representation via Large Language Model
- 2026Tokens are All You Need: Dual-purpose Semantic IDs for Achieving LLM-Level I/O Efficiency in recommendation systems
- 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendation
- 2026WeFair: Fidelity-Aware Alignment from Human Feedback for Personalized Query Rewriting in Short-Video Search
- 2026Where Post-Training Quantization Breaks Text Embedders: A Measured Map Across Four Embedder Families