mlsanityData to 7 Oct 2026

SheffieldVeraAI at SemEval-2023 Task 3: Mono and multilingual approaches for news genre, topic and persuasion technique classification

arXiv 2303.09421 ↗First posted 16 Mar 2023cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

This paper describes our approach for SemEval-2023 Task 3: Detecting the category, the framing, and the persuasion techniques in online news in a multi-lingual setup. For Subtask 1 (News Genre), we propose an ensemble of fully trained and adapter mBERT models which was ranked joint-first for German, and had the highest mean rank of multi-language teams. For Subtask 2 (Framing), we achieved first place in 3 languages, and the best average rank across all the languages, by using two separate ensembles: a monolingual RoBERTa-MUPPETLARGE and an ensemble of XLM-RoBERTaLARGE with adapters and task adaptive pretraining. For Subtask 3 (Persuasion Techniques), we train a monolingual RoBERTa-Base model for English and a multilingual mBERT model for the remaining languages, which achieved top 10 for all languages, including 2nd for English. For each subtask, we compared monolingual and multilingual approaches, and considered class imbalance techniques.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 25 of its 41 references that are in the map. First posted on arXiv 16 Mar 2023.

Builds on

25 of 41 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  6. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  7. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  8. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  9. 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 443
  10. 2020AdapterHub: A Framework for Adapting Transformerscited by 441
  11. 2019CamemBERT: a Tasty French Language Modelcited by 368
  12. 2019Simple, Scalable Adaptation for Neural Machine Translationcited by 239
13 more
  1. 2020Are All Languages Created Equal in Multilingual BERT?cited by 206
  2. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  3. 2021On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptationcited by 147
  4. 2020German's Next Language Modelcited by 144
  5. 2019Fine-Grained Analysis of Propaganda in News Articlescited by 130
  6. 2019Adaptation of Deep Bidirectional Multilingual Transformers for Russian Languagecited by 109
  7. 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 89
  8. 2020SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articlescited by 79
  9. 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
  10. 2020ApplicaAI at SemEval-2020 Task 11: On RoBERTa-CRF, Span CLS and Whether Self-Training Helps Themcited by 16
  11. 2019Adversarial Training for Satire Detection: Controlling for Confounding Variablescited by 13
  12. 2020Translating Similar Languages: Role of Mutual Intelligibility in Multilingual Transformerscited by 6
  13. 2022Realistic Zero-Shot Cross-Lingual Transfer in Legal Topic Classificationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 1; 2025: 0; 2026: 1.

5 papers.

  1. 2023Comparison between parameter-efficient techniques and full fine-tuning: A case study on multilingual news article classificationcited by 9
  2. 2023mCPT at SemEval-2023 Task 3: Multilingual Label-Aware Contrastive Pre-Training of Transformers for Few- and Zero-shot Framing Detectioncited by 1
  3. 2023FrameFinder: Explorative Multi-Perspective Framing Extraction from News Headlinescited by 1
  4. 2024Paying Attention to Deflections: Mining Pragmatic Nuances for Whataboutism Detection in Online Discoursecited by 1
  5. 2026Truth with a Twist: The Rhetoric of Persuasion in Professional vs. Community-Authored Fact-Checkscited by 0