Transferable and Forecastable User Targeting Foundation Model
Not on the map. Why?
Abstract (arXiv)
User targeting, the process of selecting targeted users from a pool of candidates for non-expert marketers, has garnered substantial attention with the advancements in digital marketing. However, existing user targeting methods encounter two significant challenges: (i) Poor cross-domain and cross-scenario transferability and generalization, and (ii) Insufficient forecastability in real-world applications. These limitations hinder their applicability across diverse industrial scenarios. In this work, we propose FOUND, an industrial-grade, transferable, and forecastable user targeting foundation model. To enhance cross-domain transferability, our framework integrates heterogeneous multi-scenario user data, aligning them with one-sentence targeting demand inputs through contrastive pre-training. For improved forecastability, the text description of each user is derived based on anticipated future behaviors, while user representations are constructed from historical information. Experimental results demonstrate that our approach significantly outperforms existing baselines in cross-domain, real-world user targeting scenarios, showcasing the superior capabilities of FOUND. Moreover, our method has been successfully deployed on the Alipay platform and is widely utilized across various scenarios.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 17 Dec 2024.
Builds on
26 of 40 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
14 more
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
- 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 398
- 2022Prompt-aligned Gradient for Prompt Tuningcited by 339
- 2023Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?cited by 167
- 2023Large-scale Multi-Modal Pre-trained Models: A Comprehensive Surveycited by 153
- 2023Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Promptingcited by 62
- 2023Multi-Modal Self-Supervised Learning for Recommendationcited by 44
- 2023ConGraT: Self-Supervised Contrastive Pretraining for Joint Graph and Text Embeddingscited by 32
- 2018Perceive Your Users in Depth: Learning Universal User Representations from Multiple E-commerce Taskscited by 24
- 2020Exploiting Behavioral Consistence for Universal User Representationcited by 14
- 2020General-Purpose User Embeddings based on Mobile App Usagecited by 11
- 2022Pre-trained Token-replaced Detection Model as Few-shot Learnercited by 7
- 2024Know Your Needs Better: Towards Structured Understanding of Marketer Demands with Analogical Reasoning Augmented LLMscited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025FOUNDv2: Learning Unified User Quantized Tokenizers for User Representationcited by 1
- 2025Instruction-aware User Embedding via Synergistic Language and Representation Modelingcited by 1
- 2026Query as Anchor: Scenario-Adaptive User Representation via Large Language Modelcited by 1
- 2026Towards a Densing Law for User Representation Learning at Billion-Scale Capacitycited by 0
- 2026Towards a Densing Law for User Representation Learning at Billion-Scale Capacity24 Aug 2026
- 2026Query as Anchor: Scenario-Adaptive User Representation via Large Language Model16 Feb 2026
- 2025Instruction-aware User Embedding via Synergistic Language and Representation Modeling13 Oct 2025
- 2025FOUNDv2: Learning Unified User Quantized Tokenizers for User Representation1 Aug 2025