Findings of the NLP4IF-2021 Shared Tasks on Fighting the COVID-19 Infodemic and Censorship Detection
Not on the map. Why?
Abstract (arXiv)
We present the results and the main findings of the NLP4IF-2021 shared tasks. Task 1 focused on fighting the COVID-19 infodemic in social media, and it was offered in Arabic, Bulgarian, and English. Given a tweet, it asked to predict whether that tweet contains a verifiable claim, and if so, whether it is likely to be false, is of general interest, is likely to be harmful, and is worthy of manual fact-checking; also, whether it is harmful to society, and whether it requires the attention of policy makers. Task~2 focused on censorship detection, and was offered in Chinese. A total of ten teams submitted systems for task 1, and one team participated in task 2; nine teams also submitted a system description paper. Here, we present the tasks, analyze the results, and discuss the system submissions and the methods they used. Most submissions achieved sizable improvements over several baselines, and the best systems used pre-trained Transformers and ensembles. The data, the scorers and the leaderboards for the tasks are available at http://gitlab.com/NLP4IF/nlp4if-2021.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 30 of its 63 references that are in the map. First posted on arXiv 23 Sep 2021.
Builds on
30 of 63 references.
References · 30
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 359
- 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 334
- 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
- 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 164
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2018Automated Fact Checking: Task formulations, methods and future directionscited by 96
- 2020KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Mediacited by 84
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2020Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Societycited by 72
- 2020The COVID-19 Social Media Infodemiccited by 64
- 2018Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detectioncited by 55
- 2020ReCOVery: A Multimodal Repository for COVID-19 News Credibility Researchcited by 44
18 more
- 2020Fighting the COVID-19 Infodemic in Social Media: A Holistic Perspective and a Call to Armscited by 41
- 2020Detecting East Asian Prejudice on Social Mediacited by 40
- 2015A Survey on Truth Discoverycited by 36
- 2020A large-scale COVID-19 Twitter chatter dataset for open scientific research -- an international collaborationcited by 33
- 2021A Survey on Predicting the Factuality and the Bias of News Mediacited by 20
- 2020GeoCoV19: A Dataset of Hundreds of Millions of Multilingual COVID-19 Tweets with Location Informationcited by 15
- 2020ArCOV19-Rumors: Arabic COVID-19 Twitter Dataset for Misinformation Detectioncited by 15
- 2020Large Arabic Twitter Dataset on COVID-19cited by 10
- 2020Critical Impact of Social Networks Infodemic on Defeating Coronavirus COVID-19 Pandemic: Twitter-Based Study and Research Directionscited by 6
- 2020Mega-COV: A Billion-Scale Dataset of 100+ Languages for COVID-19cited by 5
- 2020Challenges in Combating COVID-19 Infodemic -- Data, Tools, and Ethicscited by 4
- 2020ArCorona: Analyzing Arabic Tweets in the Early Days of Coronavirus (COVID-19) Pandemiccited by 4
- 2021Transformers to Fight the COVID-19 Infodemiccited by 4
- 2013The Velocity of Censorship: High-Fidelity Detection of Microblog Post Deletionscited by 3
- 2020Analysis of misinformation during the COVID-19 outbreak in China: cultural, social and political entanglementscited by 3
- 2020Classification Aware Neural Topic Model and its Application on a New COVID-19 Disinformation Corpuscited by 3
- 2021Fighting the COVID-19 Infodemic with a Holistic BERT Ensemblecited by 3
- 2020Linguistic Fingerprints of Internet Censorship: the Case of SinaWeibocited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 1; 2024: 3; 2025: 1; 2026: 3.
14 papers.
Sort:
- 2024Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Researchcited by 35
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
- 2022Challenges and Opportunities in Information Manipulation Detection: An Examination of Wartime Russian Mediacited by 10
- 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
- 2021Adversarial Attacks and Defenses for Social Network Text Processing Applications: Techniques, Challenges and Future Research Directionscited by 4
- 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Surveycited by 4
- 2022ArCovidVac: Analyzing Arabic Tweets About COVID-19 Vaccinationcited by 3
- 2023Toxic language detection: a systematic review of Arabic datasetscited by 3
- 2025ViClaim: A Multilingual Multilabel Dataset for Automatic Claim Detection in Videoscited by 3
- 2022Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twittercited by 2
- 2022Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Textcited by 1
- 2026ClaimPT: A Portuguese Dataset of Annotated Claims in News Articlescited by 0
- 2026Multilingual and Cross-Lingual Citation Needed Detection on Wikipedia for Lower-Resource Languages29 May 2026
- 2026ContextClaim: A Context-Driven Paradigm for Verifiable Claim Detection31 Mar 2026
- 2026ClaimPT: A Portuguese Dataset of Annotated Claims in News Articles27 Jan 2026
- 2025ViClaim: A Multilingual Multilabel Dataset for Automatic Claim Detection in Videos17 Apr 2025
- 2024A Guide to Misinformation Detection Data and Evaluation7 Nov 2024
- 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Survey24 Oct 2024
- 2024Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Research22 Jan 2024
- 2023Toxic language detection: a systematic review of Arabic datasets12 Dec 2023
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabic18 Nov 2022
- 2022Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twitter9 Nov 2022
- 2022Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Text15 Jul 2022
- 2022Challenges and Opportunities in Information Manipulation Detection: An Examination of Wartime Russian Media24 May 2022
- 2024Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Researchcited by 35
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
- 2022Challenges and Opportunities in Information Manipulation Detection: An Examination of Wartime Russian Mediacited by 10
- 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
- 2021Adversarial Attacks and Defenses for Social Network Text Processing Applications: Techniques, Challenges and Future Research Directionscited by 4
- 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Surveycited by 4
- 2022ArCovidVac: Analyzing Arabic Tweets About COVID-19 Vaccinationcited by 3
- 2023Toxic language detection: a systematic review of Arabic datasetscited by 3
- 2025ViClaim: A Multilingual Multilabel Dataset for Automatic Claim Detection in Videoscited by 3
- 2022Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twittercited by 2
- 2022Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Textcited by 1
- 2026ClaimPT: A Portuguese Dataset of Annotated Claims in News Articlescited by 0
12 most cited of 14 All 14 (JSON)
- 2026Multilingual and Cross-Lingual Citation Needed Detection on Wikipedia for Lower-Resource Languages29 May 2026
- 2026ContextClaim: A Context-Driven Paradigm for Verifiable Claim Detection31 Mar 2026
- 2026ClaimPT: A Portuguese Dataset of Annotated Claims in News Articles27 Jan 2026
- 2025ViClaim: A Multilingual Multilabel Dataset for Automatic Claim Detection in Videos17 Apr 2025
- 2024A Guide to Misinformation Detection Data and Evaluation7 Nov 2024
- 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Survey24 Oct 2024
- 2024Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Research22 Jan 2024
- 2023Toxic language detection: a systematic review of Arabic datasets12 Dec 2023
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabic18 Nov 2022
- 2022Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twitter9 Nov 2022
- 2022Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Text15 Jul 2022
- 2022Challenges and Opportunities in Information Manipulation Detection: An Examination of Wartime Russian Media24 May 2022
12 newest of 14 All 14 (JSON)