mlsanityData to 7 Oct 2026

COPR: Consistency-Oriented Pre-Ranking for Online Advertising

arXiv 2306.03516 ↗First posted 6 Jun 2023cs.IR cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Cascading architecture has been widely adopted in large-scale advertising systems to balance efficiency and effectiveness. In this architecture, the pre-ranking model is expected to be a lightweight approximation of the ranking model, which handles more candidates with strict latency requirements. Due to the gap in model capacity, the pre-ranking and ranking models usually generate inconsistent ranked results, thus hurting the overall system effectiveness. The paradigm of score alignment is proposed to regularize their raw scores to be consistent. However, it suffers from inevitable alignment errors and error amplification by bids when applied in online advertising. To this end, we introduce a consistency-oriented pre-ranking framework for online advertising, which employs a chunk-based sampling module and a plug-and-play rank alignment module to explicitly optimize consistency of ECPM-ranked results. A Delta NDCG-based weighting mechanism is adopted to better distinguish the importance of inter-chunk samples in optimization. Both online and offline experiments have validated the superiority of our framework. When deployed in Taobao display advertising system, it achieves an improvement of up to +12.3% CTR and +5.6% RPM.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 6 Jun 2023.

Builds on

18 of 33 references.

References · 18

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2017Squeeze-and-Excitation Networkscited by 4,763
  3. 2017Deep Interest Network for Click-Through Rate Predictioncited by 541
  4. 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 176
  5. 2018Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender Systemcited by 60
  6. 2020AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Predictioncited by 52
  7. 2020An Embedding Learning Framework for Numerical Features in CTR Predictioncited by 37
  8. 2018TF-Ranking: Scalable TensorFlow Library for Learning-to-Rankcited by 32
  9. 2020COLD: Towards the Next Generation of Pre-Ranking Systemcited by 30
  10. 2022Joint Optimization of Ranking and Calibration with Contextualized Hybrid Modelcited by 22
  11. 2022IntTower: the Next Generation of Two-Tower Model for Pre-Ranking Systemcited by 18
  12. 2022PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systemscited by 17
6 more
  1. 2021Towards a Better Tradeoff between Effectiveness and Efficiency in Pre-Ranking: A Learnable Feature Selection based Approachcited by 14
  2. 2022KEEP: An Industrial Pre-Training Framework for Online Recommendation via Knowledge Extraction and Pluggingcited by 11
  3. 2023Capturing Conversion Rate Fluctuation during Sales Promotions: A Novel Historical Data Reuse Approachcited by 8
  4. 2021On Designing a Two-stage Auction for Online Advertisingcited by 4
  5. 2018EENMF: An End-to-End Neural Matching Framework for E-Commerce Sponsored Searchcited by 3
  6. 2022AutoFAS: Automatic Feature and Architecture Selection for Pre-Ranking Systemcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 6; 2026: 2.

10 papers.