Towards Better Web Search Performance: Pre-training, Fine-tuning and Learning to Rank
Not on the map. Why?
Abstract (arXiv)
This paper describes the approach of the THUIR team at the WSDM Cup 2023 Pre-training for Web Search task. This task requires the participant to rank the relevant documents for each query. We propose a new data pre-processing method and conduct pre-training and fine-tuning with the processed data. Moreover, we extract statistical, axiomatic, and semantic features to enhance the ranking performance. After the feature extraction, diverse learning-to-rank models are employed to merge those features. The experimental results show the superiority of our proposal. We finally achieve second place in this competition.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Feb 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 7; 2024: 7; 2025: 3.
17 papers.
Sort:
By area:
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
- 2024Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Modelscited by 84
- 2024DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language Modelscited by 63
- 2023SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrievalcited by 61
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2024Mitigating Entity-Level Hallucination in Large Language Modelscited by 17
- 2023THUIR@COLIEE 2023: Incorporating Structural Knowledge into Pre-trained Language Models for Legal Case Retrievalcited by 16
- 2023Constructing Tree-based Index for Efficient and Effective Dense Retrievalcited by 15
- 2023Wikiformer: Pre-training with Structured Information of Wikipedia for Ad-hoc Retrievalcited by 15
- 2025Joint Evaluation of Answer and Reasoning Consistency for Hallucination Detection in Large Reasoning Modelscited by 13
- 2024LeKUBE: A Legal Knowledge Update BEnchmarkcited by 12
- 2023THUIR@COLIEE 2023: More Parameters and Legal Knowledge for Legal Case Entailmentcited by 11
5 more
- 2024Unbiased Learning to Rank Meets Reality: Lessons from Baidu's Large-Scale Search Datasetcited by 10
- 2024STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionalscited by 10
- 2023An Intent Taxonomy of Legal Case Retrievalcited by 6
- 2023Pretrained deep models outperform GBDTs in Learning-To-Rank under label scarcitycited by 1
- 2025Industry Insights from Comparing Deep Learning and GBDT Models for E-Commerce Learning-to-Rankcited by 0
- 2025Industry Insights from Comparing Deep Learning and GBDT Models for E-Commerce Learning-to-Rank28 Jul 2025
- 2025Joint Evaluation of Answer and Reasoning Consistency for Hallucination Detection in Large Reasoning Models5 Jun 2025
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Models28 Feb 2025
- 2024LeKUBE: A Legal Knowledge Update BEnchmark19 Jul 2024
- 2024Mitigating Entity-Level Hallucination in Large Language Models12 Jul 2024
- 2024When Search Engine Services meet Large Language Models: Visions and Challenges28 Jun 2024
- 2024STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionals21 Jun 2024
- 2024Unbiased Learning to Rank Meets Reality: Lessons from Baidu's Large-Scale Search Dataset3 Apr 2024
- 2024DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language Models15 Mar 2024
- 2024Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models11 Mar 2024
- 2023Wikiformer: Pre-training with Structured Information of Wikipedia for Ad-hoc Retrieval17 Dec 2023
- 2023Pretrained deep models outperform GBDTs in Learning-To-Rank under label scarcity31 Jul 2023
5 more
- 2023An Intent Taxonomy of Legal Case Retrieval25 Jul 2023
- 2023THUIR@COLIEE 2023: More Parameters and Legal Knowledge for Legal Case Entailment11 May 2023
- 2023THUIR@COLIEE 2023: Incorporating Structural Knowledge into Pre-trained Language Models for Legal Case Retrieval11 May 2023
- 2023Constructing Tree-based Index for Efficient and Effective Dense Retrieval24 Apr 2023
- 2023SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrieval22 Apr 2023
- 2024Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Modelscited by 84
- 2023SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrievalcited by 61
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2024Mitigating Entity-Level Hallucination in Large Language Modelscited by 17
- 2023THUIR@COLIEE 2023: Incorporating Structural Knowledge into Pre-trained Language Models for Legal Case Retrievalcited by 16
- 2023Constructing Tree-based Index for Efficient and Effective Dense Retrievalcited by 15
- 2023Wikiformer: Pre-training with Structured Information of Wikipedia for Ad-hoc Retrievalcited by 15
- 2024LeKUBE: A Legal Knowledge Update BEnchmarkcited by 12
- 2023THUIR@COLIEE 2023: More Parameters and Legal Knowledge for Legal Case Entailmentcited by 11
- 2024Unbiased Learning to Rank Meets Reality: Lessons from Baidu's Large-Scale Search Datasetcited by 10
- 2024STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionalscited by 10
- 2023An Intent Taxonomy of Legal Case Retrievalcited by 6
12 most cited of 14 All 14 (JSON)
- 2025Industry Insights from Comparing Deep Learning and GBDT Models for E-Commerce Learning-to-Rank28 Jul 2025
- 2024LeKUBE: A Legal Knowledge Update BEnchmark19 Jul 2024
- 2024Mitigating Entity-Level Hallucination in Large Language Models12 Jul 2024
- 2024When Search Engine Services meet Large Language Models: Visions and Challenges28 Jun 2024
- 2024STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionals21 Jun 2024
- 2024Unbiased Learning to Rank Meets Reality: Lessons from Baidu's Large-Scale Search Dataset3 Apr 2024
- 2024Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models11 Mar 2024
- 2023Wikiformer: Pre-training with Structured Information of Wikipedia for Ad-hoc Retrieval17 Dec 2023
- 2023Pretrained deep models outperform GBDTs in Learning-To-Rank under label scarcity31 Jul 2023
- 2023An Intent Taxonomy of Legal Case Retrieval25 Jul 2023
- 2023THUIR@COLIEE 2023: More Parameters and Legal Knowledge for Legal Case Entailment11 May 2023
- 2023THUIR@COLIEE 2023: Incorporating Structural Knowledge into Pre-trained Language Models for Legal Case Retrieval11 May 2023
12 newest of 14 All 14 (JSON)