mlsanityData to 7 Oct 2026

BioSentinel at EXIST 2026: Soft-Label Optimization with XLM-RoBERTa for Sexism Intent Classification in Memes

arXiv 2607.24137 ↗First posted 27 Jul 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper describes the BioSentinel team's participation in EXIST 2026 Task 2.2: Source Intention in Memes, part of the CLEF 2026 evaluation campaign. The task requires classifying the communicative intent behind memes as direct, judgemental, or no (non-sexist), under a Learning with Disagreement (Le-Wi-Di) paradigm that mandates both hard-label and soft-label (probability distribution) predictions. We present a text-centric approach built on xlm-roberta-base (270M parameters) trained with a composite loss function combining KL divergence on soft annotator distributions and weighted cross-entropy on hard labels. On the official test set, the system achieved an ICM-Soft-Norm of 0.3229 and ICM-Norm of 0.3778, with a hard F1-score of 0.4236, ranking 40th (out of 118 submissions) in the soft-soft evaluation and 49th (out of 187 submissions) in the hard-hard evaluation. We provide an analysis of the dataset characteristics, exploratory larger-architecture runs, and the role of annotator disagreement in shaping model design for subjective NLP tasks. Ablation results show that KL loss improves soft-label metrics, while CE loss improves hard-label accuracy. We also report a separate validation-set temperature analysis.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 20 references that are in the map. First posted on arXiv 27 Jul 2026.

Builds on

10 of 20 references.

References · 10

  1. 2017On Calibration of Modern Neural Networkscited by 4,860
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  3. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 580
  4. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
  5. 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 306
  6. 2019Human uncertainty makes classification more robustcited by 231
  7. 2014Label Distribution Learningcited by 122
  8. 2020Hate Speech Detection and Racial Bias Mitigation in Social Media based on BERT modelcited by 87
  9. 2023SemEval-2023 Task 10: Explainable Detection of Online Sexismcited by 48
  10. 2024Re-examining Sexism and Misogyny Classification with Annotator Attitudescited by 7

Built on by

Not cited yet.