Gpachov at CheckThat! 2023: A Diverse Multi-Approach Ensemble for Subjectivity Detection in News Articles
Not on the map. Why?
Abstract (arXiv)
The wide-spread use of social networks has given rise to subjective, misleading, and even false information on the Internet. Thus, subjectivity detection can play an important role in ensuring the objectiveness and the quality of a piece of information. This paper presents the solution built by the Gpachov team for the CLEF-2023 CheckThat! lab Task~2 on subjectivity detection. Three different research directions are explored. The first one is based on fine-tuning a sentence embeddings encoder model and dimensionality reduction. The second one explores a sample-efficient few-shot learning model. The third one evaluates fine-tuning a multilingual transformer on an altered dataset, using data from multiple languages. Finally, the three approaches are combined in a simple majority voting ensemble, resulting in 0.77 macro F1 on the test set and achieving 2nd place on the English subtask.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 9 of its 16 references that are in the map. First posted on arXiv 13 Sep 2023.
Builds on
9 of 16 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,107
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,916
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,171
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,239
- 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
- 2022Efficient Few-Shot Learning Without Promptscited by 135
- 2022Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasetscited by 12
- 2022Polarity and Subjectivity Detection with Multitask Learning and BERT Embeddingcited by 3
Built on by
Citing papers per year: 2024: 1.
1 paper.