mlsanityData to 7 Oct 2026

Effective and Efficient Query-aware Snippet Extraction for Web Search

arXiv 2210.08809 ↗First posted 17 Oct 2022cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Query-aware webpage snippet extraction is widely used in search engines to help users better understand the content of the returned webpages before clicking. Although important, it is very rarely studied. In this paper, we propose an effective query-aware webpage snippet extraction method named DeepQSE, aiming to select a few sentences which can best summarize the webpage content in the context of input query. DeepQSE first learns query-aware sentence representations for each sentence to capture the fine-grained relevance between query and sentence, and then learns document-aware query-sentence relevance representations for snippet extraction. Since the query and each sentence are jointly modeled in DeepQSE, its online inference may be slow. Thus, we further propose an efficient version of DeepQSE, named Efficient-DeepQSE, which can significantly improve the inference speed of DeepQSE without affecting its performance. The core idea of Efficient-DeepQSE is to decompose the query-aware snippet extraction task into two stages, i.e., a coarse-grained candidate sentence selection stage where sentence representations can be cached, and a fine-grained relevance modeling stage. Experiments on two real-world datasets validate the effectiveness and efficiency of our methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 17 Oct 2022.

Builds on

22 of 33 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2020Longformer: The Long-Document Transformercited by 3,362
  7. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
  8. 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 476
  9. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
  10. 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
  11. 2019Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoringcited by 164
  12. 2017A Deep Relevance Matching Model for Ad-hoc Retrievalcited by 126
10 more
  1. 2019Learning to Speak and Act in a Fantasy Text Adventure Gamecited by 122
  2. 2015Convolutional Neural Network Architectures for Matching Natural Language Sentencescited by 82
  3. 2016Text Matching as Image Recognitioncited by 59
  4. 2020PARADE: Passage Representation Aggregation for Document Rerankingcited by 44
  5. 2021Pre-trained Language Model based Ranking in Baidu Searchcited by 33
  6. 2015A Deep Architecture for Semantic Matching with Multiple Positional Sentence Representationscited by 32
  7. 2017DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrievalcited by 21
  8. 2014Semantic Modelling with Long-Short-Term Memory for Information Retrievalcited by 17
  9. 2020Abstractive Snippet Generationcited by 11
  10. 2020QBSUM: a Large-Scale Query-Based Document Summarization Dataset from Real-world Applicationscited by 8

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.