mlsanityData to 14 Oct 2026

Scalable Detection of Salient Entities in News Articles

arXiv 2405.20461 ↗First posted 30 May 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

News articles typically mention numerous entities, a large fraction of which are tangential to the story. Detecting the salience of entities in articles is thus important to applications such as news search, analysis and summarization. In this work, we explore new approaches for efficient and effective salient entity detection by fine-tuning pretrained transformer models with classification heads that use entity tags or contextualized entity representations directly. Experiments show that these straightforward techniques dramatically outperform prior work across datasets with varying sizes and salience definitions. We also study knowledge distillation techniques to effectively reduce the computational cost of these models without affecting their accuracy. Finally, we conduct extensive analyses and ablation experiments to characterize the behavior of the proposed models.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 47 references that are in the map. First posted on arXiv 30 May 2024.

Builds on

26 of 47 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  6. 2017On Calibration of Modern Neural Networkscited by 4,960
  7. 2020Knowledge Distillation: A Surveycited by 1,603
  8. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
  9. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
  10. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
  11. 2023Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluationcited by 136
  12. 2021Entity-level Factual Consistency of Abstractive Text Summarizationcited by 118
14 more
  1. 2020SciREX: A Challenge Dataset for Document-Level Information Extractioncited by 113
  2. 2019Question Answering as an Automatic Evaluation Metric for News Article Summarizationcited by 63
  3. 2024Language Models for Text Classification: Is In-Context Learning Enough?cited by 40
  4. 2021Document-level Entity-based Extraction as Template Generationcited by 33
  5. 2019An Entity-Driven Framework for Abstractive Summarizationcited by 25
  6. 2022EntSUM: A Data Set for Entity-Centric Summarizationcited by 22
  7. 2021CitationIE: Leveraging the Citation Graph for Scientific Information Extractioncited by 19
  8. 2020Capturing Global Informativeness in Open Domain Keyphrase Extractioncited by 17
  9. 2018Automatic Event Salience Identificationcited by 15
  10. 2020Salience and Market-aware Skill Extraction for Job Targetingcited by 12
  11. 2018Towards Better Text Understanding and Retrieval through Kernel Entity Salience Modelingcited by 9
  12. 2020Extracting Summary Knowledge Graphs from Long Documentscited by 6
  13. 2018SWAT: A System for Detecting Salient Wikipedia Entities in Textscited by 3
  14. 2021Evaluation of Unsupervised Entity and Event Salience Estimationcited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Synergizing Unsupervised Episode Detection with LLMs for Large-Scale News Events
  2. 2025Verifying Cross-modal Entity Consistency in News using Vision-language Models
  3. 2021Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories
  4. 2025KGAlign: Joint Semantic-Structural Knowledge Encoding for Multimodal Fake News Detection
  5. 2025Sparse Autoencoders for Hypothesis Generation
  6. 2024Enhancing Journalism with AI: A Study of Contextualized Image Captioning for News Articles using LLMs and LMMs
  7. 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Texts
  8. 2026Retrieval-Augmented Multimodal Model for Fake News Detection