Target-Aware Early Stage Ranking
Not on the map. Why?
Abstract (arXiv)
Early Stage Ranking (ESR) in large-scale recommendation systems is dominated by ''user--item decoupling'' Two Tower architectures, which scale efficiently but cannot capture fine-grained, target-aware user--item interactions directly. We propose Target-Aware Early Stage Ranking (TESR), which augments the Two Tower with a Mixture of Attention (MoA) module trained as a request-level sequence modeling over user history. MoA combines (i) Hard Matching Attention (HMA) to capture explicit categorical-ID level overlap signals between user history and candidate item, (ii) target-aware HSTU attention for implicit affinities conditioned on the candidate, and (iii) target dependent and independent cross-attention for symmetric user-item contextualization. On top of this, a Multi-Logit Parameterized Gating (MLPG) head amplifies these signals at scoring time. To keep latency within ESR budgets, we co-design the architecture with FP8 quantization, custom kernels, and a Torch Inductor compilation path. On a production deployment, TESR delivers consistent offline NE wins and online topline gains, and is, to our knowledge, the first deployment of full target-aware attention sequence modeling in an ESR stage at this scale.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
18 of 36 references.
References · 18
- 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
- 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 177
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
- 2019Behavior Sequence Transformer for E-commerce Recommendation in Alibabacited by 130
- 2024HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modelingcited by 63
- 2023PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Informationcited by 60
- 2021End-to-End User Behavior Retrieval in Click-Through RatePrediction Modelcited by 45
- 2018Product-based Neural Networks for User Response Prediction over Multi-field Categorical Datacited by 44
- 2025RankMixer: Scaling Up Ranking Models in Industrial Recommenderscited by 42
- 2022IntTower: the Next Generation of Two-Tower Model for Pre-Ranking Systemcited by 18
- 2023Beyond Two-Tower Matching: Learning Sparse Retrievable Cross-Interactions for Recommendationcited by 13
6 more
- 2024Enhancing CTR Prediction through Sequential Recommendation Pre-training: Introducing the SRP4CTR Frameworkcited by 7
- 2025SilverTorch: A Unified Model-based System to Democratize Large-Scale Recommendation on GPUscited by 6
- 2025Request-Only Optimization for Recommendation Systemscited by 5
- 2025HIT Model: A Hierarchical Interaction-Enhanced Two-Tower Model for Pre-Ranking Systemscited by 2
- 2025Equip Pre-ranking with Target Attention by Residual Quantizationcited by 2
- 2025A Learnable Fully Interacted Two-Tower Model for Pre-Ranking Systemcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025LIME: Link-based user-item Interaction Modeling with decoupled xor attention for Efficient test time scaling
- 2026RelayGR: Scaling Long-Sequence Generative Recommendation via Cross-Stage Relay-Race Inference
- 2025STAR-Rec: Making Peace with Length Variance and Pattern Diversity in Sequential Recommendation
- 2025The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit
- 2024GLINT-RU: Gated Lightweight Intelligent Recurrent Units for Sequential Recommender Systems
- 2025On-device Semantic Selection Made Low Latency and Memory Efficient with Monolithic Forwarding
- 2025AdaptRec: A Self-Adaptive Framework for Sequential Recommendations with Large Language Models
- 2025Language Ranker: A Lightweight Ranking framework for LLM Decoding