mlsanityData to 7 Oct 2026

RMS@CC-MMD 2026: Multimodal Misogyny Detection via Geometric Interaction and Multi-View Consensus

arXiv 2607.22709 ↗First posted 20 Jul 2026cs.CV cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The proliferation of internet memes has introduced new complexities to automated content moderation, particularly in detecting misogyny. Memes often rely on a semantic clash between visual and textual modalities, where hateful intent is implicit and culturally grounded. This paper presents GeoMVC (Geometric Interaction and Multi-View Consensus), developed for the CC-MMD Grand Challenge at ICMI 2026. To address the limitations of static feature concatenation, a Geometric Interaction Layer is proposed that models cross-modal alignment via Hadamard products and cosine similarity between frozen visual and textual embeddings. We further mitigate distribution shifts caused by noisy OCR and code-mixed transliteration through a Multi-View Consensus strategy, aggregating predictions across raw, length-filtered, and English-translated text views. The system achieved Rank 2 in the Malayalam partition (Macro F1: 0.892) and Rank 3 in the Chinese partition (Macro F1: 0.895) on Task A, while securing Rank 5 in the Tamil partition (Macro F1: 0.521). A detailed error analysis on the development partition highlights open challenges in modeling localized transliteration and code-mixed sarcasm across Dravidian and Chinese cultural contexts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 14 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

6 of 14 references.

References · 6

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
  3. 2019MUREL: Multimodal Relational Reasoning for Visual Question Answeringcited by 68
  4. 2019BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detectioncited by 62
  5. 2020Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challengecited by 51
  6. 2020Classification of Multimodal Hate Speech -- The Winning Solution of Hateful Memes Challengecited by 7

Built on by

Not cited yet.