PRECTR-V2:Unified Relevance-CTR Framework with Cross-User Preference Mining, Exposure Bias Correction, and LLM-Distilled Encoder Optimization
On the map: LLM alignment / RLHF / preference optimisation → Preference alignment for recommenders and RAG
Abstract (arXiv)
In search systems, effectively coordinating the two core objectives of search relevance matching and click-through rate (CTR) prediction is crucial for discovering users' interests and enhancing platform revenue. In our prior work PRECTR, we proposed a unified framework to integrate these two subtasks,thereby eliminating their inconsistency and leading to mutual benefit.However, our previous work still faces three main challenges. First, low-active users and new users have limited search behavioral data, making it difficult to achieve effective personalized relevance preference modeling. Second, training data for ranking models predominantly come from high-relevance exposures, creating a distribution mismatch with the broader candidate space in coarse-ranking, leading to generalization bias. Third, due to the latency constraint, the original model employs an Emb+MLP architecture with a frozen BERT encoder, which prevents joint optimization and creates misalignment between representation learning and CTR fine-tuning. To solve these issues, we further reinforce our method and propose PRECTR-V2. Specifically, we mitigate the low-activity users' sparse behavior problem by mining global relevance preferences under the specific query, which facilitates effective personalized relevance modeling for cold-start scenarios. Subsequently, we construct hard negative samples through embedding noise injection and relevance label reconstruction, and optimize their relative ranking against positive samples via pairwise loss, thereby correcting exposure bias. Finally, we pretrain a lightweight transformer-based encoder via knowledge distillation from LLM and SFT on the text relevance classification task. This encoder replaces the frozen BERT module, enabling better adaptation to CTR fine-tuning and advancing beyond the traditional Emb+MLP paradigm.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Preference alignment for recommenders and RAG, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 15 of its 32 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
15 of 32 references.
References · 15
- 2023Qwen Technical Reportcited by 3,273
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2016Wide & Deep Learning for Recommender Systemscited by 745
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
- 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 336
- 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 277
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 176
- 2025Qwen2.5-1M Technical Reportcited by 158
- 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
- 2021Contrastive Learning for Cold-Start Recommendationcited by 77
- 2023Knowledge Distillation on Graphs: A Surveycited by 38
3 more
- 2025A Systematic Review of Key Retrieval-Augmented Generation (RAG) Systems: Progress, Gaps, and Future Directionscited by 30
- 2025Unlocking Scaling Law in Industrial Recommendation Systems with a Three-step Paradigm based Large User Modelcited by 15
- 2024Large Language Model Meets Graph Neural Network in Knowledge Distillationcited by 13
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024RAT: Retrieval-Augmented Transformer for Click-Through Rate Prediction
- 2023Large language models can accurately predict searcher preferences
- 2024Enhancing CTR Prediction in Recommendation Domain with Search Query Representation
- 2026Advancing Relevance Measurement with Vision-Language Models for Web-Scale Search
- 2026CORE: A Unified Cascaded Ordinal Relevance Estimation Framework for E-commerce Search ↗
- 2026PRECISE: Reducing the Bias of LLM Evaluations Using Prediction-Powered Ranking Estimation
- 2024Enhancing Retrieval Performance: An Ensemble Approach For Hard Negative Mining
- 2026Unifying Search and Recommendation in LLMs via Gradient Multi-Subspace Tuning ↗