From Easy to Hard: A Dual Curriculum Learning Framework for Context-Aware Document Ranking
Not on the map. Why?
Abstract (arXiv)
Contextual information in search sessions is important for capturing users' search intents. Various approaches have been proposed to model user behavior sequences to improve document ranking in a session. Typically, training samples of (search context, document) pairs are sampled randomly in each training epoch. In reality, the difficulty to understand user's search intent and to judge document's relevance varies greatly from one search context to another. Mixing up training samples of different difficulties may confuse the model's optimization process. In this work, we propose a curriculum learning framework for context-aware document ranking, in which the ranking model learns matching signals between the search context and the candidate document in an easy-to-hard manner. In so doing, we aim to guide the model gradually toward a global optimum. To leverage both positive and negative examples, two curricula are designed. Experiments on two real query log datasets show that our proposed framework can improve the performance of several existing methods significantly, demonstrating the effectiveness of curriculum learning for context-aware document ranking.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 30 of its 65 references that are in the map. First posted on arXiv 22 Aug 2022.
Builds on
30 of 65 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
- 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 476
- 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413
- 2019Multi-Task Deep Neural Networks for Natural Language Understandingcited by 350
- 2019On The Power of Curriculum Learning in Training Deep Networkscited by 286
18 more
- 2022A Contrastive Framework for Neural Text Generationcited by 225
- 2019Competence-based Curriculum Learning for Neural Machine Translationcited by 202
- 2021Optimizing Dense Retrieval Model Training with Hard Negativescited by 155
- 2017End-to-End Neural Ad-hoc Ranking with Kernel Poolingcited by 85
- 2015Convolutional Neural Network Architectures for Matching Natural Language Sentencescited by 82
- 2015A Hierarchical Recurrent Encoder-Decoder For Generative Context-Aware Query Suggestioncited by 68
- 2016Learning to Match Using Local and Distributed Representations of Text for Web Searchcited by 68
- 2018An Empirical Exploration of Curriculum Learning for Neural Machine Translationcited by 58
- 2018Pytrec_eval: An Extremely Fast Python Interface to trec_evalcited by 46
- 2020PROP: Pre-training with Representative Words Prediction for Ad-hoc Retrievalcited by 40
- 2021TaCL: Improving BERT Pre-training with Token-aware Contrastive Learningcited by 32
- 2020Dialogue Response Selection with Hierarchical Curriculum Learningcited by 27
- 2021Contrastive Learning of User Behavior Sequence for Context-Aware Document Rankingcited by 18
- 2019Context Attentive Document Ranking and Query Suggestioncited by 15
- 2020Training Curricula for Open Domain Answer Re-Rankingcited by 10
- 2021PSSL: Self-supervised Learning for Personalized Search with Contrastive Samplingcited by 9
- 2019Personalizing Search Results Using Hierarchical RNN with Query-aware Attentioncited by 7
- 2018Attention-based Hierarchical Neural Query Suggestioncited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 3.
5 papers.
- 2024HiCuLR: Hierarchical Curriculum Learning for Rhetorical Role Labeling of Legal Documentscited by 6
- 2025Your Pretrained Model Tells the Difficulty Itself: A Self-Adaptive Curriculum Learning Paradigm for Natural Language Understandingcited by 3
- 2025DACL-RAG: Data Augmentation Strategy with Curriculum Learning for Retrieval-Augmented Generationcited by 1
- 2024Query-oriented Data Augmentation for Session Searchcited by 0
- 2025Bridge the Gap between Past and Future: Siamese Model Optimization for Context-Aware Document Rankingcited by 0
- 2025Your Pretrained Model Tells the Difficulty Itself: A Self-Adaptive Curriculum Learning Paradigm for Natural Language Understanding13 Jul 2025
- 2025Bridge the Gap between Past and Future: Siamese Model Optimization for Context-Aware Document Ranking20 May 2025
- 2025DACL-RAG: Data Augmentation Strategy with Curriculum Learning for Retrieval-Augmented Generation15 May 2025
- 2024HiCuLR: Hierarchical Curriculum Learning for Rhetorical Role Labeling of Legal Documents27 Sep 2024
- 2024Query-oriented Data Augmentation for Session Search4 Jul 2024