mlsanityData to 14 Oct 2026

FOUNDv2: Learning Unified User Quantized Tokenizers for User Representation

arXiv 2508.00956 ↗First posted 1 Aug 2025cs.LG cs.AI cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

User representation learning serves as a fundamental pillar for personalized services on large-scale web platforms. Despite its importance, conventional continuous embedding methods face significant challenges, including the lack of a unified paradigm for multi-source data integration, prohibitive storage overhead due to low information density, and the lack of multi-scale modeling granularity. To overcome these limitations, we introduce FOUNDv2, a comprehensive user representation scheme centered on the Unified User Quantized Tokenizer U2QT) framework. FOUNDv2 transforms heterogeneous user data into a standardized discrete token space through a robust two-stage architecture. Specifically, the framework first extracts compact feature representations and subsequently employs a multi-view RQ-VAE to discretize them into storage-efficient tokens using shared and source-specific codebooks. To empower these representations with predictive intelligence, we further design multi-scale alignment objectives to capture both fine-grained behavioral dependencies and macro-temporal periodicity. Extensive experiments on various benchmarks demonstrate that FOUNDv2 consistently outperforms task-specific baselines while achieving substantial reductions in storage and computational costs. Finally, the large-scale deployment of FOUNDv2 on Alipay validates its practical scalability and efficiency across diverse industrial scenarios. The main code is available at: https://github.com/chuanhe1999/FOUNDv2.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

29 of 57 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  4. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  5. 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 409
  6. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
  7. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
  8. 2025UniTok: A Unified Tokenizer for Visual Generation and Understandingcited by 153
  9. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
  10. 2024HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modelingcited by 63
  11. 2023PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Informationcited by 60
  12. 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
17 more
  1. 2021MaskNet: Introducing Feature-Wise Multiplication to CTR Ranking Models by Instance-Guided Maskcited by 48
  2. 2025A Survey of State of the Art Large Vision Language Models: Alignment, Benchmark, Evaluations and Challengescited by 47
  3. 2024NoteLLM-2: Multimodal Large Representation Models for Recommendationcited by 44
  4. 2024NoteLLM: A Retrievable Large Language Model for Note Recommendationcited by 33
  5. 2020One Person, One Model, One World: Learning Continual User Representation without Forgettingcited by 30
  6. 2024Auto-Encoding Morph-Tokens for Multimodal LLMcited by 30
  7. 2024User Modeling and User Profiling: A Comprehensive Surveycited by 29
  8. 2018Perceive Your Users in Depth: Learning Universal User Representations from Multiple E-commerce Taskscited by 24
  9. 2024MMGRec: Multimodal Generative Recommendation with Transformer Modelcited by 20
  10. 2020Exploiting Behavioral Consistence for Universal User Representationcited by 14
  11. 2024Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representationcited by 14
  12. 2021One4all User Representation for Recommender Systems in E-commercecited by 12
  13. 2025Multimodal Quantitative Language for Generative Recommendationcited by 12
  14. 2017A Context-Aware User-Item Representation Learning for Item Recommendationcited by 11
  15. 2023Task Relation-aware Continual User Representation Learningcited by 7
  16. 2024Transferable and Forecastable User Targeting Foundation Modelcited by 4
  17. 2022Learning Large-scale Universal User Representation with Sparse Mixture of Expertscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Representations through Token Prediction: Geometry, Approximation, and Downstream Guarantees
  2. 2025Breaking Token Into Concepts: Exploring Extreme Compression in Token Representation Via Compositional Shared Semantics
  3. 2026High Fidelity Textual User Representation over Heterogeneous Sources via Reinforcement Learning
  4. 2026Query as Anchor: Scenario-Adaptive User Representation via Large Language Model
  5. 2026Tokens are All You Need: Dual-purpose Semantic IDs for Achieving LLM-Level I/O Efficiency in recommendation systems
  6. 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendation
  7. 2026WeFair: Fidelity-Aware Alignment from Human Feedback for Personalized Query Rewriting in Short-Video Search
  8. 2026Where Post-Training Quantization Breaks Text Embedders: A Measured Map Across Four Embedder Families