SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articles
Not on the map. Why?
Abstract (arXiv)
We present the results and the main findings of SemEval-2020 Task 11 on Detection of Propaganda Techniques in News Articles. The task featured two subtasks. Subtask SI is about Span Identification: given a plain-text document, spot the specific text fragments containing propaganda. Subtask TC is about Technique Classification: given a specific text fragment, in the context of a full document, determine the propaganda technique it uses, choosing from an inventory of 14 possible propaganda techniques. The task attracted a large number of participants: 250 teams signed up to participate and 44 made a submission on the test set. In this paper, we present the task, analyze the results, and discuss the system submissions and the methods they used. For both subtasks, the best systems used pre-trained Transformers and ensembles.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 9; 2023: 18; 2024: 17; 2025: 12; 2026: 14.
79 papers.
Sort:
By area:
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmarkcited by 62
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
- 2022Handling and Presenting Harmful Text in NLP Researchcited by 43
- 2024DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detectioncited by 41
- 2024Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Languagecited by 31
- 2023From Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Modelscited by 26
- 2022Logical Fallacy Detectioncited by 25
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
- 2023Multitask Instruction-based Prompting for Fallacy Recognitioncited by 22
- 2022Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twittercited by 19
38 more
- 2023ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Textcited by 19
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
- 2021Interpretable Propaganda Detection in News Articlescited by 16
- 2023Characterizing the Entities in Harmful Memes: Who is the Hero, the Villain, the Victim?cited by 14
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
- 2021Transformers: "The End of History" for NLP?cited by 12
- 2024Reason from Fallacy: Enhancing Large Language Models' Logical Reasoning through Logical Fallacy Understandingcited by 12
- 2025Must Read: A Comprehensive Survey of Computational Persuasioncited by 12
- 2021The Spread of Propaganda by Coordinated Communities on Social Mediacited by 10
- 2022Challenges and Opportunities in Information Manipulation Detection: An Examination of Wartime Russian Mediacited by 10
- 2024Attacking Misinformation Detection Using Adversarial Examples Generated by Language Modelscited by 10
- 2023Comparison between parameter-efficient techniques and full fine-tuning: A case study on multilingual news article classificationcited by 9
- 2024Think Fast, Think Slow, Think Critical: Designing an Automated Propaganda Detection Toolcited by 9
- 2024PropaInsight: Toward Deeper Understanding of Propaganda in Terms of Techniques, Appeals, and Intentcited by 9
- 2023Verifying the Robustness of Automatic Credibility Assessmentcited by 8
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMscited by 8
- 2022PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Taskscited by 7
- 2022Autonomation, Not Automation: Activities and Needs of European Fact-checkers as a Basis for Designing Human-Centered AI Systemscited by 7
- 2023Large Language Models for Propaganda Detectioncited by 7
- 2024The FIGNEWS Shared Task on News Media Narrativescited by 7
- 2025LLMs as Span Annotators: A Comparative Study of LLMs and Humanscited by 7
- 2021NLRG at SemEval-2021 Task 5: Toxic Spans Detection Leveraging BERT-based Token Classification and Span Prediction Techniquescited by 6
- 2025Fine-grained Fallacy Detection with Human Label Variationcited by 6
- 2021Volta at SemEval-2021 Task 6: Towards Detecting Persuasive Texts and Images using Textual and Multimodal Ensemblecited by 5
- 2023SheffieldVeraAI at SemEval-2023 Task 3: Mono and multilingual approaches for news genre, topic and persuasion technique classificationcited by 5
- 2023Discourse Structures Guided Fine-grained Propaganda Identificationcited by 5
- 2024A Multi-Label Dataset of French Fake News: Human and Machine Insightscited by 5
- 2025Are Large Language Models Good at Detecting Propaganda?cited by 5
- 2023KInITVeraAI at SemEval-2023 Task 3: Simple yet Powerful Multilingual Fine-Tuning for Persuasion Techniques Detectioncited by 4
- 2023Overview of the CLAIMSCAN-2023: Uncovering Truth in Social Media through Claim Detection and Identification of Claim Spanscited by 4
- 2024Exposing propaganda: an analysis of stylistic cues comparing human annotations and machine classificationcited by 4
- 2024Sina at FigNews 2024: Multilingual Datasets Annotated with Bias and Propagandacited by 4
- 2024COBRA: A Continual Learning Approach to Vision-Brain Understandingcited by 4
- 2024What distinguishes conspiracy from critical narratives? A computational analysis of oppositional discoursecited by 3
- 2024Yesterday's News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Modelscited by 3
- 2024A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Modelscited by 3
- 2025Hybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligencecited by 3
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
50 most cited of 79 All 79 (JSON)
- 2026ProBel: Propaganda Detection with Techniques, Spans, and Explanations23 Aug 2026
- 2026Propaganda Forensics: Recovering the Generation Pipeline of an AI-Driven Influence Campaign16 Aug 2026
- 2026A Corpus of Persuasion Techniques in Slavic Languages12 Jul 2026
- 2026Can temporal article-level credibility signals improve domain-level credibility prediction?6 Jul 2026
- 2026Persuasion Index: A Theory-Guided Framework for Persuasion Analysis12 Jun 2026
- 2026Fine-tuning with Hierarchical Prompting for Robust Propaganda Classification Across Annotation Schemas13 May 2026
- 2026Reliable News or Propagandist News? A Neurosymbolic Model Using Genre, Topic, and Persuasion Techniques to Improve Robustness in Classification2 Apr 2026
- 2026VIGIL: An Extensible System for Real-Time Detection and Mitigation of Cognitive Bias Triggers12 Mar 2026
- 2026When Agents Persuade: Rhetoric Generation and Mitigation in LLMs4 Mar 2026
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2026From Emotion to Expression: Theoretical Foundations and Resources for Fear Speech23 Jan 2026
- 2026LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systems23 Jan 2026
38 more
- 2026Can AI-Generated Persuasion Be Detected? Persuaficial Benchmark and AI vs. Human Linguistic Differences8 Jan 2026
- 2026PartisanLens: A Multilingual Dataset of Hyperpartisan and Conspiratorial Immigration Narratives in European Media7 Jan 2026
- 2025Fine-grained Narrative Classification in Biased News Articles3 Dec 2025
- 2025On the Influence of Discourse Relations in Persuasive Texts30 Oct 2025
- 2025BRAIN: Bias-Mitigation Continual Learning Approach to Vision-Brain Understanding25 Aug 2025
- 2025The Enemy from Within: A Study of Political Delegitimization Discourse in Israeli Political Speech21 Aug 2025
- 2025Hybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligence24 Jul 2025
- 2025Hidden Persuasion: Detecting Manipulative Narratives on Social Media During the 2022 Russian Invasion of Ukraine29 May 2025
- 2025Are Large Language Models Good at Detecting Propaganda?19 May 2025
- 2025Must Read: A Comprehensive Survey of Computational Persuasion12 May 2025
- 2025LLMs as Span Annotators: A Comparative Study of LLMs and Humans11 Apr 2025
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
- 2025Effective Yet Ephemeral Propaganda Defense: There Needs to Be More than One-Shot Inoculation to Enhance Critical Thinking11 Mar 2025
- 2025Fine-grained Fallacy Detection with Human Label Variation19 Feb 2025
- 2024COBRA: A Continual Learning Approach to Vision-Brain Understanding25 Nov 2024
- 2024A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models28 Oct 2024
- 2024Attacking Misinformation Detection Using Adversarial Examples Generated by Language Models28 Oct 2024
- 2024Yesterday's News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Models12 Oct 2024
- 2024PropaInsight: Toward Deeper Understanding of Propaganda in Terms of Techniques, Appeals, and Intent19 Sep 2024
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMs11 Sep 2024
- 2024The FIGNEWS Shared Task on News Media Narratives25 Jul 2024
- 2024What distinguishes conspiracy from critical narratives? A computational analysis of oppositional discourse15 Jul 2024
- 2024Sina at FigNews 2024: Multilingual Datasets Annotated with Bias and Propaganda12 Jul 2024
- 2024Analyzing Persuasive Strategies in Meme Texts: A Fusion of Language Models with Paraphrase Enrichment1 Jul 2024
- 2024Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Language25 Jun 2024
- 2024Reason from Fallacy: Enhancing Large Language Models' Logical Reasoning through Logical Fallacy Understanding4 Apr 2024
- 2024A Multi-Label Dataset of French Fake News: Human and Machine Insights24 Mar 2024
- 2024Think Fast, Think Slow, Think Critical: Designing an Automated Propaganda Detection Tool29 Feb 2024
- 2024DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detection16 Feb 2024
- 2024Paying Attention to Deflections: Mining Pragmatic Nuances for Whataboutism Detection in Online Discourse15 Feb 2024
- 2024Exposing propaganda: an analysis of stylistic cues comparing human annotations and machine classification6 Feb 2024
- 2023Nexus at ArAIEval Shared Task: Fine-Tuning Arabic Language Models for Propaganda and Disinformation Detection6 Nov 2023
- 2023ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Text6 Nov 2023
- 2023Overview of the CLAIMSCAN-2023: Uncovering Truth in Social Media through Claim Detection and Identification of Claim Spans30 Oct 2023
- 2023Discourse Structures Guided Fine-grained Propaganda Identification28 Oct 2023
- 2023Large Language Models for Propaganda Detection10 Oct 2023
- 2023Comparison between parameter-efficient techniques and full fine-tuning: A case study on multilingual news article classification14 Aug 2023
- 2023Hierarchical Multi-Instance Multi-Label Learning for Detecting Propaganda Techniques30 May 2023
50 newest of 79 All 79 (JSON)
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmarkcited by 62
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
- 2022Handling and Presenting Harmful Text in NLP Researchcited by 43
- 2024DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detectioncited by 41
- 2024Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Languagecited by 31
- 2023From Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Modelscited by 26
- 2022Logical Fallacy Detectioncited by 25
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
- 2023Multitask Instruction-based Prompting for Fallacy Recognitioncited by 22
- 2022Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twittercited by 19
12 most cited of 77 All 77 (JSON)
- 2026ProBel: Propaganda Detection with Techniques, Spans, and Explanations23 Aug 2026
- 2026Propaganda Forensics: Recovering the Generation Pipeline of an AI-Driven Influence Campaign16 Aug 2026
- 2026A Corpus of Persuasion Techniques in Slavic Languages12 Jul 2026
- 2026Can temporal article-level credibility signals improve domain-level credibility prediction?6 Jul 2026
- 2026Persuasion Index: A Theory-Guided Framework for Persuasion Analysis12 Jun 2026
- 2026Fine-tuning with Hierarchical Prompting for Robust Propaganda Classification Across Annotation Schemas13 May 2026
- 2026Reliable News or Propagandist News? A Neurosymbolic Model Using Genre, Topic, and Persuasion Techniques to Improve Robustness in Classification2 Apr 2026
- 2026VIGIL: An Extensible System for Real-Time Detection and Mitigation of Cognitive Bias Triggers12 Mar 2026
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2026From Emotion to Expression: Theoretical Foundations and Resources for Fear Speech23 Jan 2026
- 2026LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systems23 Jan 2026
- 2026Can AI-Generated Persuasion Be Detected? Persuaficial Benchmark and AI vs. Human Linguistic Differences8 Jan 2026
12 newest of 77 All 77 (JSON)