BioSentinel at EXIST 2026: Soft-Label Optimization with XLM-RoBERTa for Sexism Intent Classification in Memes
Not on the map. Why?
Abstract (arXiv)
This paper describes the BioSentinel team's participation in EXIST 2026 Task 2.2: Source Intention in Memes, part of the CLEF 2026 evaluation campaign. The task requires classifying the communicative intent behind memes as direct, judgemental, or no (non-sexist), under a Learning with Disagreement (Le-Wi-Di) paradigm that mandates both hard-label and soft-label (probability distribution) predictions. We present a text-centric approach built on xlm-roberta-base (270M parameters) trained with a composite loss function combining KL divergence on soft annotator distributions and weighted cross-entropy on hard labels. On the official test set, the system achieved an ICM-Soft-Norm of 0.3229 and ICM-Norm of 0.3778, with a hard F1-score of 0.4236, ranking 40th (out of 118 submissions) in the soft-soft evaluation and 49th (out of 187 submissions) in the hard-hard evaluation. We provide an analysis of the dataset characteristics, exploratory larger-architecture runs, and the role of annotator disagreement in shaping model design for subjective NLP tasks. Ablation results show that KL loss improves soft-label metrics, while CE loss improves hard-label accuracy. We also report a separate validation-set temperature analysis.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 20 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
10 of 20 references.
References · 10
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 580
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
- 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 306
- 2019Human uncertainty makes classification more robustcited by 231
- 2014Label Distribution Learningcited by 122
- 2020Hate Speech Detection and Racial Bias Mitigation in Social Media based on BERT modelcited by 87
- 2023SemEval-2023 Task 10: Explainable Detection of Online Sexismcited by 48
- 2024Re-examining Sexism and Misogyny Classification with Annotator Attitudescited by 7
Built on by
Not cited yet.