SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Images
Not on the map. Why?
Abstract (arXiv)
We describe SemEval-2021 task 6 on Detection of Persuasion Techniques in Texts and Images: the data, the annotation guidelines, the evaluation setup, the results, and the participating systems. The task focused on memes and had three subtasks: (i) detecting the techniques in the text, (ii) detecting the text spans where the techniques are used, and (iii) detecting techniques in the entire meme, i.e., both in the text and in the image. It was a popular task, attracting 71 registrations, and 22 teams that eventually made an official submission on the test set. The evaluation results for the third subtask confirmed the importance of both modalities, the text and the image. Moreover, some teams reported benefits when not just combining the two modalities, e.g., by using early or late fusion, but rather modeling the interaction between them in a joint model.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). Builds on 23 of its 90 references that are in the map. First posted on arXiv 25 Apr 2021.
Builds on
23 of 90 references.
References · 23
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
- 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 334
- 2016YouTube-8M: A Large-Scale Video Classification Benchmarkcited by 324
- 2020FastBERT: a Self-distilling BERT with Adaptive Inference Timecited by 224
- 2019Supervised Multimodal Bitransformers for Classifying Images and Textcited by 130
- 2019Fine-Grained Analysis of Propaganda in News Articlescited by 130
- 2020SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articlescited by 79
- 2017SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumourscited by 77
11 more
- 2018RumourEval 2019: Determining Rumour Veracity and Support for Rumourscited by 74
- 2020A Survey on Computational Propaganda Detectioncited by 69
- 2020Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Mediacited by 46
- 2018Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 1: Check-Worthinesscited by 41
- 2018Before Name-calling: Dynamics and Triggers of Ad Hominem Fallacies in Web Argumentationcited by 32
- 2017Argotario: Computational Argumentation Meets Serious Gamescited by 29
- 2020CheckThat! at CLEF 2020: Enabling the Automatic Identification and Verification of Claims in Social Mediacited by 25
- 2019Findings of the NLP4IF-2019 Shared Task on Fine-Grained Propaganda Detectioncited by 24
- 2020Prta: A System to Support the Analysis of Propaganda Techniques in the Newscited by 23
- 2019SemEval-2019 Task 8: Fact Checking in Community Question Answering Forumscited by 18
- 2019Multilingual Multimodal Digital Deception Detection and Disinformation Spread across Social Platformscited by 7
Built on by
Citing papers per year: 2021: 6; 2022: 10; 2023: 9; 2024: 8; 2025: 8; 2026: 8.
49 papers.
Sort:
By area:
- 2021MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targetscited by 85
- 2021Detecting Harmful Memes and Their Targetscited by 77
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2021Detecting Propaganda Techniques in Memescited by 43
- 2024A Closer Look at Classification Evaluation Metrics and a Critical Reflection of Common Evaluation Practicecited by 26
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
- 2024Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articlescited by 21
- 2024LLM-Generated Black-box Explanations Can Be Adversarially Helpfulcited by 20
- 2023ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Textcited by 19
- 2023Large Language Models for Propaganda Span Annotationcited by 19
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
37 more
- 2025Must Read: A Comprehensive Survey of Computational Persuasioncited by 12
- 2025Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Studycited by 12
- 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Contentcited by 11
- 2021The Spread of Propaganda by Coordinated Communities on Social Mediacited by 10
- 2023Comparison between parameter-efficient techniques and full fine-tuning: A case study on multilingual news article classificationcited by 9
- 2023A Template Is All You Memecited by 9
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMscited by 8
- 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memescited by 8
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8
- 2022PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Taskscited by 7
- 2022Using Persuasive Writing Strategies to Explain and Detect Health Misinformationcited by 6
- 2024Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Datacited by 6
- 2022BLUE at Memotion 2.0 2022: You have my Image, my Text and my Transformercited by 5
- 2023SheffieldVeraAI at SemEval-2023 Task 3: Mono and multilingual approaches for news genre, topic and persuasion technique classificationcited by 5
- 2023QCRI at SemEval-2023 Task 3: News Genre, Framing and Persuasion Techniques Detection using Multilingual Modelscited by 5
- 2026MemeLens: Multilingual Multitask VLMs for Memescited by 5
- 2022Multilingual Persuasion Detection: Video Games as an Invaluable Data Source for NLPcited by 4
- 2023KInITVeraAI at SemEval-2023 Task 3: Simple yet Powerful Multilingual Fine-Tuning for Persuasion Techniques Detectioncited by 4
- 2025PVP: An Image Dataset for Personalized Visual Persuasion with Persuasion Strategies, Viewer Characteristics, and Persuasiveness Ratingscited by 4
- 2022IITD at the WANLP 2022 Shared Task: Multilingual Multi-Granularity Network for Propaganda Detectioncited by 3
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
- 2022Detection of Propaganda Techniques in Visuo-Lingual Metaphor in Memescited by 2
- 2024Analyzing Persuasive Strategies in Meme Texts: A Fusion of Language Models with Paraphrase Enrichmentcited by 2
- 2022Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Textcited by 1
- 2023NAP at SemEval-2023 Task 3: Is Less Really More? (Back-)Translation as Data Augmentation Strategies for Detecting Persuasion Techniquescited by 1
- 2023Detecting Propaganda Techniques in Code-Switched Social Media Textcited by 1
- 2026Can AI-Generated Persuasion Be Detected? Persuaficial Benchmark and AI vs. Human Linguistic Differencescited by 1
- 2026LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systemscited by 1
- 2021LIIR at SemEval-2021 task 6: Detection of Persuasion Techniques In Texts and Images using CLIP featurescited by 0
- 2022Large Language Models for Multi-label Propaganda Detectioncited by 0
- 2024BCAmirs at SemEval-2024 Task 4: Beyond Words: A Multimodal and Multilingual Exploration of Persuasion in Memescited by 0
- 2025On the Influence of Discourse Relations in Persuasive Textscited by 0
- 2025Building Resilient Information Ecosystems: Large LLM-Generated Dataset of Persuasion Attackscited by 0
- 2025Fine-grained Narrative Classification in Biased News Articlescited by 0
- 2026When Agents Persuade: Rhetoric Generation and Mitigation in LLMscited by 0
- 2026Persuasion Index: A Theory-Guided Framework for Persuasion Analysiscited by 0
- 2026A Corpus of Persuasion Techniques in Slavic Languagescited by 0
- 2026A Corpus of Persuasion Techniques in Slavic Languages12 Jul 2026
- 2026Persuasion Index: A Theory-Guided Framework for Persuasion Analysis12 Jun 2026
- 2026When Agents Persuade: Rhetoric Generation and Mitigation in LLMs4 Mar 2026
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning1 Feb 2026
- 2026LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systems23 Jan 2026
- 2026MemeLens: Multilingual Multitask VLMs for Memes18 Jan 2026
- 2026Can AI-Generated Persuasion Be Detected? Persuaficial Benchmark and AI vs. Human Linguistic Differences8 Jan 2026
- 2025Fine-grained Narrative Classification in Biased News Articles3 Dec 2025
- 2025Building Resilient Information Ecosystems: Large LLM-Generated Dataset of Persuasion Attacks23 Nov 2025
- 2025On the Influence of Discourse Relations in Persuasive Texts30 Oct 2025
- 2025PVP: An Image Dataset for Personalized Visual Persuasion with Persuasion Strategies, Viewer Characteristics, and Persuasiveness Ratings31 May 2025
37 more
- 2025Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Study21 May 2025
- 2025Must Read: A Comprehensive Survey of Computational Persuasion12 May 2025
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
- 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memes23 Feb 2025
- 2024Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Data19 Dec 2024
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMs11 Sep 2024
- 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Content5 Jul 2024
- 2024Analyzing Persuasive Strategies in Meme Texts: A Fusion of Language Models with Paraphrase Enrichment1 Jul 2024
- 2024LLM-Generated Black-box Explanations Can Be Adversarially Helpful10 May 2024
- 2024A Closer Look at Classification Evaluation Metrics and a Critical Reflection of Common Evaluation Practice25 Apr 2024
- 2024BCAmirs at SemEval-2024 Task 4: Beyond Words: A Multimodal and Multilingual Exploration of Persuasion in Memes3 Apr 2024
- 2024Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articles27 Feb 2024
- 2023Large Language Models for Propaganda Span Annotation16 Nov 2023
- 2023A Template Is All You Meme11 Nov 2023
- 2023ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Text6 Nov 2023
- 2023Comparison between parameter-efficient techniques and full fine-tuning: A case study on multilingual news article classification14 Aug 2023
- 2023Detecting Propaganda Techniques in Code-Switched Social Media Text23 May 2023
- 2023QCRI at SemEval-2023 Task 3: News Genre, Framing and Persuasion Techniques Detection using Multilingual Models5 May 2023
- 2023NAP at SemEval-2023 Task 3: Is Less Really More? (Back-)Translation as Data Augmentation Strategies for Detecting Persuasion Techniques27 Apr 2023
- 2023KInITVeraAI at SemEval-2023 Task 3: Simple yet Powerful Multilingual Fine-Tuning for Persuasion Techniques Detection24 Apr 2023
- 2023SheffieldVeraAI at SemEval-2023 Task 3: Mono and multilingual approaches for news genre, topic and persuasion technique classification16 Mar 2023
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabic18 Nov 2022
- 2022Using Persuasive Writing Strategies to Explain and Detect Health Misinformation11 Nov 2022
- 2022IITD at the WANLP 2022 Shared Task: Multilingual Multi-Granularity Network for Propaganda Detection31 Oct 2022
- 2022PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks17 Oct 2022
- 2022Large Language Models for Multi-label Propaganda Detection15 Oct 2022
- 2022Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Text15 Jul 2022
- 2022Multilingual Persuasion Detection: Video Games as an Invaluable Data Source for NLP10 Jul 2022
- 2022Detecting and Understanding Harmful Memes: A Survey9 May 2022
- 2022Detection of Propaganda Techniques in Visuo-Lingual Metaphor in Memes3 May 2022
- 2022BLUE at Memotion 2.0 2022: You have my Image, my Text and my Transformer15 Feb 2022
- 2021The Spread of Propaganda by Coordinated Communities on Social Media27 Sep 2021
- 2021Detecting Harmful Memes and Their Targets24 Sep 2021
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News23 Sep 2021
- 2021MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targets11 Sep 2021
- 2021Detecting Propaganda Techniques in Memes7 Aug 2021
- 2021LIIR at SemEval-2021 task 6: Detection of Persuasion Techniques In Texts and Images using CLIP features31 May 2021
- 2021MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targetscited by 85
- 2021Detecting Harmful Memes and Their Targetscited by 77
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2021Detecting Propaganda Techniques in Memescited by 43
- 2024A Closer Look at Classification Evaluation Metrics and a Critical Reflection of Common Evaluation Practicecited by 26
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
- 2024Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articlescited by 21
- 2024LLM-Generated Black-box Explanations Can Be Adversarially Helpfulcited by 20
- 2023ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Textcited by 19
- 2023Large Language Models for Propaganda Span Annotationcited by 19
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
12 most cited of 46 All 46 (JSON)
- 2026A Corpus of Persuasion Techniques in Slavic Languages12 Jul 2026
- 2026Persuasion Index: A Theory-Guided Framework for Persuasion Analysis12 Jun 2026
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2026LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systems23 Jan 2026
- 2026MemeLens: Multilingual Multitask VLMs for Memes18 Jan 2026
- 2026Can AI-Generated Persuasion Be Detected? Persuaficial Benchmark and AI vs. Human Linguistic Differences8 Jan 2026
- 2025Fine-grained Narrative Classification in Biased News Articles3 Dec 2025
- 2025Building Resilient Information Ecosystems: Large LLM-Generated Dataset of Persuasion Attacks23 Nov 2025
- 2025On the Influence of Discourse Relations in Persuasive Texts30 Oct 2025
- 2025PVP: An Image Dataset for Personalized Visual Persuasion with Persuasion Strategies, Viewer Characteristics, and Persuasiveness Ratings31 May 2025
- 2025Must Read: A Comprehensive Survey of Computational Persuasion12 May 2025
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
12 newest of 46 All 46 (JSON)