mlsanityData to 7 Oct 2026

SemEval-2023 Task 10: Explainable Detection of Online Sexism

arXiv 2303.04222 ↗First posted 7 Mar 2023cs.CL cs.CYcited by 48

Not on the map. Why?

Abstract (arXiv)

Online sexism is a widespread and harmful phenomenon. Automated tools can assist the detection of sexism at scale. Binary detection, however, disregards the diversity of sexist content, and fails to provide clear explanations for why something is sexist. To address this issue, we introduce SemEval Task 10 on the Explainable Detection of Online Sexism (EDOS). We make three main contributions: i) a novel hierarchical taxonomy of sexist content, which includes granular vectors of sexism to aid explainability; ii) a new dataset of 20,000 social media comments with fine-grained labels, along with larger unlabelled datasets for model adaptation; and iii) baseline models as well as an analysis of the methods, results and errors for participant submissions to our task.

Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 40 of its 88 references that are in the map. First posted on arXiv 7 Mar 2023.

Builds on

40 of 88 references.

References · 40

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  7. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  8. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  9. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  10. 2021Dynabench: Rethinking Benchmarking in NLPcited by 447
  11. 2020Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamicscited by 423
  12. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
28 more
  1. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
  2. 2020BERTweet: A pre-trained language model for English Tweetscited by 346
  3. 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 306
  4. 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 258
  5. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 217
  6. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 206
  7. 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 206
  8. 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 140
  9. 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 139
  10. 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
  11. 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 128
  12. 2021On Releasing Annotator-Level Labels and Information in Datasetscited by 123
  13. 2022When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgmentcited by 93
  14. 2020Contextualizing Hate Speech Classifiers with Post-hoc Explanationcited by 84
  15. 2021Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hatecited by 50
  16. 2020"Call me sexist, but...": Revisiting Sexism Detection Using Psychological Scales and Adversarial Samplescited by 48
  17. 2022TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations at Twittercited by 44
  18. 2022Handling and Presenting Harmful Text in NLP Researchcited by 43
  19. 2020The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understandingcited by 28
  20. 2018Leveraging Intra-User and Inter-User Representation Learning for Automated Hate Speech Detectioncited by 25
  21. 2018What is Gab? A Bastion of Free Speech or an Alt-Right Echo Chamber?cited by 24
  22. 2022Enabling Classifiers to Make Judgements Explicitly Aligned with Human Valuescited by 13
  23. 2018Inside the Right-Leaning Echo Chambers: Characterizing Gab, an Unmoderated Social Systemcited by 10
  24. 2022Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languagescited by 7
  25. 2022Why Is It Hate Speech? Masked Rationale Prediction for Explainable Hate Speech Detectioncited by 7
  26. 2022Hidden behind the obvious: misleading keywords and implicitly abusive language on social mediacited by 6
  27. 2022Is More Data Better? Re-thinking the Importance of Efficiency in Abusive Language Detection with Transformers-Based Active Learningcited by 4
  28. 2022Rethinking Offensive Text Detection as a Multi-Hop Reasoning Problemcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 15; 2024: 13; 2025: 11; 2026: 9.

48 papers.

Sort:

By area:

  1. 2024SPRIG: Improving Large Language Model Performance by System Prompt Optimizationcited by 28
  2. 2024From Languages to Geographies: Towards Evaluating Cultural Bias in Hate Speech Datasetscited by 23
  3. 2024Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?cited by 13
  4. 2023Ambiguity-Aware In-Context Learning with Large Language Modelscited by 11
  5. 2025Explainability in Practice: A Survey of Explainable NLP Across Various Domainscited by 11
  6. 2024Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Fastercited by 7
  7. 2024Re-examining Sexism and Misogyny Classification with Annotator Attitudescited by 7
  8. 2024QueerBench: Quantifying Discrimination in Language Models Toward Queer Identitiescited by 5
  9. 2025Mario at EXIST 2025: A Simple Gateway to Effective Multilingual Sexism Detectioncited by 4
  10. 2025Distilling Knowledge from Large Language Models: A Concept Bottleneck Model for Hate and Counter Speech Recognitioncited by 4
  11. 2023Subtle Misogyny Detection and Mitigation: An Expert-Annotated Datasetcited by 3
  12. 2024Let Guidelines Guide You: A Prescriptive Guideline-Centered Data Annotation Methodologycited by 3
36 more
  1. 2023NLP-LTU at SemEval-2023 Task 10: The Impact of Data Augmentation and Semi-Supervised Learning Techniques on Text Classification Performance on an Imbalanced Datasetcited by 2
  2. 2023Focal Inferential Infusion Coupled with Tractable Density Discrimination for Implicit Hate Detectioncited by 2
  3. 2023Take One Step at a Time to Know Incremental Utility of Demonstration: An Analysis on Reranking for Few-Shot In-Context Learningcited by 2
  4. 2024Sexism Detection on a Data Dietcited by 2
  5. 2025Explaining Matters: Leveraging Definitions and Semantic Expansion for Sexism Detectioncited by 2
  6. 2025Beyond the Explicit: A Bilingual Dataset for Dehumanization Detection in Social Mediacited by 2
  7. 2023SSS at SemEval-2023 Task 10: Explainable Detection of Online Sexism using Majority Voted Fine-Tuned Transformerscited by 1
  8. 2023HausaNLP at SemEval-2023 Task 10: Transfer Learning, Synthetic Data and Side-Information for Multi-Level Sexism Classificationcited by 1
  9. 2023AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learningcited by 1
  10. 2024COT: A Generative Approach for Hate Speech Counter-Narratives via Contrastive Optimal Transportcited by 1
  11. 2024Exploring the Influence of Label Aggregation on Minority Voices: Implications for Dataset Bias and Model Trainingcited by 1
  12. 2025SafeSpeech: A Comprehensive and Interactive Tool for Analysing Sexist and Abusive Language in Conversationscited by 1
  13. 2026Conspiracy Frame: a Semiotically-Driven Approach for Conspiracy Theories Detectioncited by 1
  14. 2026Bye Bye Perspective API: Lessons for Building and Governing Measurement Infrastructurecited by 1
  15. 2023Attention at SemEval-2023 Task 10: Explainable Detection of Online Sexism (EDOS)cited by 0
  16. 2023IUST_NLP at SemEval-2023 Task 10: Explainable Detecting Sexism with Transformers and Task-adaptive Pretrainingcited by 0
  17. 2023CL-UZH at SemEval-2023 Task 10: Sexism Detection through Incremental Fine-Tuning and Multi-Task Learning with Label Descriptionscited by 0
  18. 2023LCT-1 at SemEval-2023 Task 10: Pre-training and Multi-task Learning for Sexism Detection and Classificationcited by 0
  19. 2023AI-UPV at EXIST 2023 -- Sexism Characterization Using Large Language Models Under The Learning with Disagreements Regimecited by 0
  20. 2023DoDo Learning: DOmain-DemOgraphic Transfer in Language Models for Detecting Abuse Targeted at Public Figurescited by 0
  21. 2023On the Challenges of Building Datasets for Hate Speech Detectioncited by 0
  22. 2024Exploratory Data Analysis on Code-mixed Misogynistic Commentscited by 0
  23. 2024A multitask learning framework for leveraging subjectivity of annotators to identify misogynycited by 0
  24. 2024Detecting Sexism in German Online Newspaper Comments with Open-Source Text Embeddings (Team GDA, GermEval2024 Shared Task 1: GerMS-Detect, Subtasks 1 and 2, Closed Track)cited by 0
  25. 2025Tackling Social Bias against the Poor: A Dataset and Taxonomy on Aporophobiacited by 0
  26. 2025Web(er) of Hate: A Survey on How Hate Speech Is Typedcited by 0
  27. 2025Can NLP Tackle Hate Speech in the Real World? Stakeholder-Informed Feedback and Survey on Counterspeechcited by 0
  28. 2025Classification is a RAG problem: A case study on hate speech detectioncited by 0
  29. 2025Dataset Creation and Baseline Models for Sexism Detection in Hausacited by 0
  30. 2026Beyond Binary Classification: Detecting Fine-Grained Sexism in Social Media Videoscited by 0
  31. 2026ToxiREX: A Dataset on Toxic REasoning in ConteXtcited by 0
  32. 2026AI Wizards at EXIST 2026: Hierarchical Soft-Label Learning for Multimodal Sexism Identification in Memescited by 0
  33. 2026BioSentinel at EXIST 2026: Soft-Label Optimization with XLM-RoBERTa for Sexism Intent Classification in Memescited by 0
  34. 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girlscited by 0
  35. 2026From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigationcited by 0
  36. 2026Two Centuries of Sexism in British Parliament: A Computational Analysis of Women's Representation in the Hansard Corpuscited by 0