mlsanityData to 7 Oct 2026

Don't Contrast the Impossible: Region-Constrained Batching for Contrastive User Modeling on a Local Community Platform

arXiv 2607.28971 ↗First posted 31 Jul 2026cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Contrastive learning is widely used for user modeling in large-scale recommender systems, where standard in-batch negatives implicitly assume universal exposure that any user can be shown any item. On local community platforms such as Karrot, however, exposure is geographically constrained; many user-item pairs are impossible by design yet still treated as negatives during training, diluting the contrastive learning signal. We address this impossible negatives problem and propose Region-Constrained Batch Sampling (RCBS), a simple yet effective batching method that constructs region-homogeneous mini-batches so that users are contrasted primarily against items they could feasibly see. By replacing impossible negatives with feasible ones, RCBS naturally introduces harder and more informative negatives under realistic exposure constraints. With offline evaluations and online A/B tests, we show that RCBS consistently improves user representation quality and consequently enhances home feed ranking, retrieval, and display ads ranking. The resulting user embeddings have been deployed in production across various applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 27 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

20 of 27 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  4. 2020On Layer Normalization in the Transformer Architecturecited by 906
  5. 2020Contrastive Learning with Hard Negative Samplescited by 619
  6. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
  7. 2020Hard Negative Mixing for Contrastive Learningcited by 399
  8. 2020Debiased Contrastive Learningcited by 354
  9. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 326
  10. 2016Recommendations as Treatments: Debiasing Learning and Evaluationcited by 246
  11. 2019Unbiased Recommender Learning from Missing-Not-At-Random Implicit Feedbackcited by 79
  12. 2022PinnerFormer: Sequence Modeling for User Representation at Pinterestcited by 57
8 more
  1. 2025Training Sparse Mixture Of Experts Text Embedding Modelscited by 32
  2. 2021Scaling Law for Recommendation Models: Towards General-purpose User Representationscited by 26
  3. 2021Cross-Batch Negative Sampling for Training Two-Tower Recommenderscited by 24
  4. 2023Scaling User Modeling: Large-scale Online User Representations for Ads Personalization in Metacited by 20
  5. 2024Nomic Embed Vision: Expanding the Latent Spacecited by 19
  6. 2023On the Theories Behind Hard Negative Sampling for Recommendationcited by 18
  7. 2021UserBERT: Contrastive User Model Pre-trainingcited by 6
  8. 2023uCTRL: Unbiased Contrastive Representation Learning via Alignment and Uniformity for Collaborative Filteringcited by 5

Built on by

Not cited yet.