Query-oriented Data Augmentation for Session Search
Not on the map. Why?
Abstract (arXiv)
Modeling contextual information in a search session has drawn more and more attention when understanding complex user intents. Recent methods are all data-driven, i.e., they train different models on large-scale search log data to identify the relevance between search contexts and candidate documents. The common training paradigm is to pair the search context with different candidate documents and train the model to rank the clicked documents higher than the unclicked ones. However, this paradigm neglects the symmetric nature of the relevance between the session context and document, i.e., the clicked documents can also be paired with different search contexts when training. In this work, we propose query-oriented data augmentation to enrich search logs and empower the modeling. We generate supplemental training pairs by altering the most important part of a search context, i.e., the current query, and train our model to rank the generated sequence along with the original sequence. This approach enables models to learn that the relevance of a document may vary as the session context changes, leading to a better understanding of users' search patterns. We develop several strategies to alter the current query, resulting in new training data with varying degrees of difficulty. Through experimentation on two extensive public search logs, we have successfully demonstrated the effectiveness of our model.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 4 Jul 2024.
Builds on
24 of 55 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
- 2015Generating Sentences from a Continuous Spacecited by 612
- 2015Semi-supervised Sequence Learningcited by 198
- 2021Optimizing Dense Retrieval Model Training with Hard Negativescited by 155
- 2017End-to-End Neural Ad-hoc Ranking with Kernel Poolingcited by 85
- 2015Convolutional Neural Network Architectures for Matching Natural Language Sentencescited by 82
12 more
- 2016Learning to Match Using Local and Distributed Representations of Text for Web Searchcited by 68
- 2018Counterfactual Critic Multi-Agent Training for Scene Graph Generationcited by 53
- 2018Pytrec_eval: An Extremely Fast Python Interface to trec_evalcited by 46
- 2022SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrievalcited by 21
- 2020Neural Retrieval for Question Answering with Cross-Attention Supervised Data Augmentationcited by 18
- 2021Contrastive Learning of User Behavior Sequence for Context-Aware Document Rankingcited by 18
- 2019Context Attentive Document Ranking and Query Suggestioncited by 15
- 2021More Robust Dense Retrieval with Contrastive Dual Learningcited by 15
- 2021Context-Aware Attention-Based Data Augmentation for POI Recommendationcited by 8
- 2021Cross-language Sentence Selection via Data Augmentation and Rationale Trainingcited by 5
- 2022From Easy to Hard: A Dual Curriculum Learning Framework for Context-Aware Document Rankingcited by 5
- 2022Enhancing User Behavior Sequence Modeling by Generative Tasks for Session Searchcited by 5
Built on by
Not cited yet.