Leveraging Contextual Information for Effective Entity Salience Detection
Not on the map. Why?
Abstract (arXiv)
In text documents such as news articles, the content and key events usually revolve around a subset of all the entities mentioned in a document. These entities, often deemed as salient entities, provide useful cues of the aboutness of a document to a reader. Identifying the salience of entities was found helpful in several downstream applications such as search, ranking, and entity-centric summarization, among others. Prior work on salient entity detection mainly focused on machine learning models that require heavy feature engineering. We show that fine-tuning medium-sized language models with a cross-encoder style architecture yields substantial performance gains over feature engineering approaches. To this end, we conduct a comprehensive benchmarking of four publicly available datasets using models representative of the medium-sized pre-trained language model family. Additionally, we show that zero-shot prompting of instruction-tuned language models yields inferior results, indicating the task's uniqueness and complexity.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 13 of its 44 references that are in the map. First posted on arXiv 14 Sep 2023.
Builds on
13 of 44 references.
References · 13
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,979
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,765
- 2020Longformer: The Long-Document Transformercited by 3,393
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,007
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,239
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,049
- 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 437
- 2018End-to-End Neural Entity Linkingcited by 85
- 2022EntSUM: A Data Set for Entity-Centric Summarizationcited by 22
- 2020A BERT based Sentiment Analysis and Key Entity Detection Approach for Online Financial Textscited by 21
- 2018Towards Better Text Understanding and Retrieval through Kernel Entity Salience Modelingcited by 9
1 more
Built on by
Citing papers per year: 2025: 2.
2 papers.
- 2025What makes an entity salient in discourse?cited by 0
- 2025Who Is the Story About? Protagonist Entity Recognition in Newscited by 0
- 2025Who Is the Story About? Protagonist Entity Recognition in News10 Nov 2025
- 2025What makes an entity salient in discourse?22 Aug 2025