mlsanityData to 13 Oct 2026

Leveraging Contextual Information for Effective Entity Salience Detection

arXiv 2309.07990 ↗First posted 14 Sep 2023cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

In text documents such as news articles, the content and key events usually revolve around a subset of all the entities mentioned in a document. These entities, often deemed as salient entities, provide useful cues of the aboutness of a document to a reader. Identifying the salience of entities was found helpful in several downstream applications such as search, ranking, and entity-centric summarization, among others. Prior work on salient entity detection mainly focused on machine learning models that require heavy feature engineering. We show that fine-tuning medium-sized language models with a cross-encoder style architecture yields substantial performance gains over feature engineering approaches. To this end, we conduct a comprehensive benchmarking of four publicly available datasets using models representative of the medium-sized pre-trained language model family. Additionally, we show that zero-shot prompting of instruction-tuned language models yields inferior results, indicating the task's uniqueness and complexity.

Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 13 of its 44 references that are in the map. First posted on arXiv 14 Sep 2023.

Builds on

13 of 44 references.

References · 13

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,979
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,765
  4. 2020Longformer: The Long-Document Transformercited by 3,393
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,007
  6. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,239
  7. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,049
  8. 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 437
  9. 2018End-to-End Neural Entity Linkingcited by 85
  10. 2022EntSUM: A Data Set for Entity-Centric Summarizationcited by 22
  11. 2020A BERT based Sentiment Analysis and Key Entity Detection Approach for Online Financial Textscited by 21
  12. 2018Towards Better Text Understanding and Retrieval through Kernel Entity Salience Modelingcited by 9
1 more
  1. 2018SWAT: A System for Detecting Salient Wikipedia Entities in Textscited by 3

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.