mlsanityData to 14 Oct 2026

ORCAS: 18 Million Clicked Query-Document Pairs for Analyzing Search

arXiv 2006.05324 ↗First posted 9 Jun 2020cs.IR cs.LGcited by 34

Not on the map. Why?

Abstract (arXiv)

Users of Web search engines reveal their information needs through queries and clicks, making click logs a useful asset for information retrieval. However, click logs have not been publicly released for academic use, because they can be too revealing of personally or commercially sensitive information. This paper describes a click data release related to the TREC Deep Learning Track document corpus. After aggregation and filtering, including a k-anonymity requirement, we find 1.4 million of the TREC DL URLs have 18 million connections to 10 million distinct queries. Our dataset of these queries and connections to TREC documents is of similar size to proprietary datasets used in previous papers on query mining and ranking. We perform some preliminary experiments using the click data to augment the TREC DL training data, offering by comparison: 28x more queries, with 49x more connections to 4.4x more URLs in the corpus. We present a description of the dataset's generation process, characteristics, use in ranking and suggest other potential uses.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Jun 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 9; 2022: 5; 2023: 4; 2024: 7; 2025: 5; 2026: 4.

34 papers.

Sort:

By area:

  1. 2021Overview of the TREC 2020 deep learning trackcited by 196
  2. 2021PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrievalcited by 50
  3. 2025Search Arena: Analyzing Search-Augmented LLMscited by 34
  4. 2021Releasing Graph Neural Networks with Differential Privacy Guaranteescited by 32
  5. 2021Simplified Data Wrangling with ir_datasetscited by 27
  6. 2024BASES: Large-scale Web Search User Simulation with Large Language Model based Agentscited by 25
  7. 2021TREC Deep Learning Track: Reusable Test Collections in the Large Data Regimecited by 23
  8. 2022QUILL: Query Intent with Large Language Models using Retrieval Augmentation and Multi-stage Distillationcited by 21
  9. 2022MultiCoNER: A Large-scale Multilingual dataset for Complex Named Entity Recognitioncited by 19
  10. 2022DAMO-NLP at SemEval-2022 Task 11: A Knowledge-based System for Multilingual Named Entity Recognitioncited by 17
  11. 2025vCache: Verified Semantic Prompt Cachingcited by 17
  12. 2024Robust Neural Information Retrieval: An Adversarial and Out-of-distribution Perspectivecited by 15
22 more
  1. 2021PEEK: A Large Dataset of Learner Engagement with Educational Videoscited by 9
  2. 2022USTC-NELSLIP at SemEval-2022 Task 11: Gazetteer-Adapted Integration Network for Multilingual Complex Named Entity Recognitioncited by 8
  3. 2021Siamese BERT-based Model for Web Search Relevance Ranking Evaluated on a New Czech Datasetcited by 7
  4. 2025Auditing Google's AI Overviews and Featured Snippets: A Case Study on Baby Care and Pregnancycited by 7
  5. 2023Noise-Robust Dense Retrieval via Contrastive Alignment Post Trainingcited by 5
  6. 2023A Toolbox for Modelling Engagement with Educational Videoscited by 3
  7. 2025VectorLiteRAG: Latency-Aware and Fine-Grained Resource Partitioning for Efficient RAGcited by 3
  8. 2021Modeling Relevance Ranking under the Pre-training and Fine-tuning Paradigmcited by 2
  9. 2023USTC-NELSLIP at SemEval-2023 Task 2: Statistical Construction and Dual Adaptation of Gazetteer for Multilingual Complex NERcited by 2
  10. 2024CWRCzech: 100M Query-Document Czech Click Dataset and Its Application to Web Relevance Rankingcited by 2
  11. 2024Optimizing Novelty of Top-k Recommendations using Large Language Models and Reinforcement Learningcited by 2
  12. 2026GEO-Flag: Detecting and Measuring GEO-Optimized Web Contentcited by 2
  13. 2021Improving Transformer-Kernel Ranking Model Using Conformer and Query Term Independencecited by 1
  14. 2022Can Population-based Engagement Improve Personalisation? A Novel Dataset and Experimentscited by 1
  15. 2023A Deep Reinforcement Learning Approach for Interactive Search with Sentence-level Feedbackcited by 0
  16. 2024Coarse-Tuning for Ad-hoc Document Retrieval Using Pre-trained Language Modelscited by 0
  17. 2024De-DSI: Decentralised Differentiable Search Indexcited by 0
  18. 2024On the Necessity of World Knowledge for Mitigating Missing Labels in Extreme Classificationcited by 0
  19. 2025A Large-Scale Web Search Dataset for Federated Online Learning to Rankcited by 0
  20. 2026SoftMatcha 2: A Fast and Soft Pattern Matcher for Trillion-Scale Corporacited by 0
  21. 2026Diversity is Not Ambiguity: Toward Accurate and Efficient Ambiguity Detection for Open-Domain QAcited by 0
  22. 2026You Can Tell Who's Asking: What the Web's Questions Are Made Of, and Where They Come Fromcited by 0