A Corpus for Sentence-level Subjectivity Detection on English News Articles
Not on the map. Why?
Abstract (arXiv)
We develop novel annotation guidelines for sentence-level subjectivity detection, which are not limited to language-specific cues. We use our guidelines to collect NewsSD-ENG, a corpus of 638 objective and 411 subjective sentences extracted from English news articles on controversial topics. Our corpus paves the way for subjectivity detection in English and across other languages without relying on language-specific tools, such as lexicons or machine translation. We evaluate state-of-the-art multilingual transformer-based models on the task in mono-, multi-, and cross-language settings. For this purpose, we re-annotate an existing Italian corpus. We observe that models trained in the multilingual setting achieve the best performance on the task.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 13 of its 81 references that are in the map. First posted on arXiv 29 May 2023.
Builds on
13 of 81 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
- 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 314
- 2019Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasetscited by 175
- 2018Reducing Gender Bias in Abusive Language Detectioncited by 152
- 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 143
- 2021Toward a Perspectivist Turn in Ground Truthing for Predictive Computingcited by 130
- 2023Sensitivity and Robustness of Large Language Models to Prompt Template in Japanese Text Classification Taskscited by 25
- 2021Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Trainingcited by 21
- 2018Neural Based Statement Classification for Biased Languagecited by 17
1 more
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 3.
6 papers.
- 2024Let Guidelines Guide You: A Prescriptive Guideline-Centered Data Annotation Methodologycited by 3
- 2023DWReCO at CheckThat! 2023: Enhancing Subjectivity Detection through Style-based Data Samplingcited by 2
- 2024ThatiAR: Subjectivity Detection in Arabic News Sentencescited by 2
- 2025AI Wizards at CheckThat! 2025: Enhancing Transformer-Based Embeddings with Sentiment for Subjectivity Detection in News Articlescited by 0
- 2025QU-NLP at CheckThat! 2025: Multilingual Subjectivity in News Articles Detection using Feature-Augmented Transformer Models with Sequential Cross-Lingual Fine-Tuningcited by 0
- 2025XplaiNLP at CheckThat! 2025: Multilingual Subjectivity Detection with Finetuned Transformers and Prompt-Based Inference with Large Language Modelscited by 0
- 2025XplaiNLP at CheckThat! 2025: Multilingual Subjectivity Detection with Finetuned Transformers and Prompt-Based Inference with Large Language Models15 Sep 2025
- 2025AI Wizards at CheckThat! 2025: Enhancing Transformer-Based Embeddings with Sentiment for Subjectivity Detection in News Articles15 Jul 2025
- 2025QU-NLP at CheckThat! 2025: Multilingual Subjectivity in News Articles Detection using Feature-Augmented Transformer Models with Sequential Cross-Lingual Fine-Tuning1 Jul 2025
- 2024Let Guidelines Guide You: A Prescriptive Guideline-Centered Data Annotation Methodology20 Jun 2024
- 2024ThatiAR: Subjectivity Detection in Arabic News Sentences8 Jun 2024
- 2023DWReCO at CheckThat! 2023: Enhancing Subjectivity Detection through Style-based Data Sampling7 Jul 2023