mlsanityData to 7 Oct 2026

CWRCzech: 100M Query-Document Czech Click Dataset and Its Application to Web Relevance Ranking

arXiv 2405.20994 ↗First posted 31 May 2024cs.IR cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

We present CWRCzech, Click Web Ranking dataset for Czech, a 100M query-document Czech click dataset for relevance ranking with user behavior data collected from search engine logs of Seznam.cz. To the best of our knowledge, CWRCzech is the largest click dataset with raw text published so far. It provides document positions in the search results as well as information about user behavior: 27.6M clicked documents and 10.8M dwell times. In addition, we also publish a manually annotated Czech test for the relevance task, containing nearly 50k query-document pairs, each annotated by at least 2 annotators. Finally, we analyze how the user behavior data improve relevance ranking and show that models trained on data automatically harnessed at sufficient scale can surpass the performance of models trained on human annotated data. CWRCzech is published under an academic non-commercial license and is available to the research community at https://github.com/seznam/CWRCzech.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 31 May 2024.

Builds on

24 of 41 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  7. 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 373
  8. 2019Multi-Stage Document Ranking with BERTcited by 200
  9. 2022Dense Text Retrieval based on Pretrained Language Models: A Surveycited by 136
  10. 2019Deeper Text Understanding for IR with Contextual Neural Language Modelingcited by 111
  11. 2019CEDR: Contextualized Embeddings for Document Rankingcited by 77
  12. 2018Unbiased Learning to Rank with Unbiased Propensity Estimationcited by 61
12 more
  1. 2023T2Ranking: A large-scale Chinese Benchmark for Passage Rankingcited by 59
  2. 2020PARADE: Passage Representation Aggregation for Document Rerankingcited by 44
  3. 2020ORCAS: 18 Million Clicked Query-Document Pairs for Analyzing Searchcited by 34
  4. 2021Learning a Product Relevance Model from Click-Through Data in E-Commercecited by 22
  5. 2021TripClick: The Log Files of a Large Health Web Search Enginecited by 18
  6. 2022A Large Scale Search Dataset for Unbiased Learning to Rankcited by 13
  7. 2021Comparison of Czech Transformers on Text Classification Taskscited by 10
  8. 2021Siamese BERT-based Model for Web Search Relevance Ranking Evaluated on a New Czech Datasetcited by 7
  9. 2022Reweighting Clicks with Dwell Time in Recommendationcited by 6
  10. 2023Some Like It Small: Czech Semantic Embedding Models for Industry Applicationscited by 3
  11. 2021Hybrid Encoder: Towards Efficient and Precise Native AdsRecommendation via Hybrid Transformer Encoding Networkscited by 2
  12. 2021Modeling Relevance Ranking under the Pre-training and Fine-tuning Paradigmcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.

  1. 2024A Comparative Study of Text Retrieval Models on DaReCzechcited by 0
  2. 2026BETA-Labeling for Multilingual Dataset Construction in Low-Resource IRcited by 0