mlsanityData to 7 Oct 2026

Multi-Agent VLMs Guided Self-Training with PNU Loss for Low-Resource Offensive Content Detection

arXiv 2511.13759 ↗First posted 14 Nov 2025cs.LG cs.AIcited by 2

On the map: LLM agents and tool use → Social simulation and multi-agent debate

also in 1 more
Abstract (arXiv)

Accurate detection of offensive content on social media demands high-quality labeled data; however, such data is often scarce due to the low prevalence of offensive instances and the high cost of manual annotation. To address this low-resource challenge, we propose a self-training framework that leverages abundant unlabeled data through collaborative pseudo-labeling. Starting with a lightweight classifier trained on limited labeled data, our method iteratively assigns pseudo-labels to unlabeled instances with the support of Multi-Agent Vision-Language Models (MA-VLMs). Un-labeled data on which the classifier and MA-VLMs agree are designated as the Agreed-Unknown set, while conflicting samples form the Disagreed-Unknown set. To enhance label reliability, MA-VLMs simulate dual perspectives, moderator and user, capturing both regulatory and subjective viewpoints. The classifier is optimized using a novel Positive-Negative-Unlabeled (PNU) loss, which jointly exploits labeled, Agreed-Unknown, and Disagreed-Unknown data while mitigating pseudo-label noise. Experiments on benchmark datasets demonstrate that our framework substantially outperforms baselines under limited supervision and approaches the performance of large-scale models

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 11 of its 55 references that are in the map. First posted on arXiv 14 Nov 2025.

Builds on

11 of 55 references.

References · 11

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  3. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  4. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  5. 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 257
  6. 2021Detecting Hate Speech with GPT-3cited by 55
  7. 2023Evaluating GPT-3 Generated Explanations for Hateful Content Moderationcited by 44
  8. 2023Improving Hateful Meme Detection through Retrieval-Guided Contrastive Learningcited by 20
  9. 2024Towards Interpretable Hate Speech Detection using Large Language Model-extracted Rationalescited by 16
  10. 2024Combating Adversarial Attacks with Multi-Agent Debatecited by 15
  11. 2023DST-Det: Simple Dynamic Self-Training for Open-Vocabulary Object Detectioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Shallow Humor to Metaphor: Towards Label-Free Harmful Meme Detection via LMM Agent Self-Improvement
  2. 2025Labels or Input? Rethinking Augmentation in Multimodal Hate Detection
  3. 2025MV-Debate: Multi-view Agent Debate with Dynamic Reflection Gating for Multimodal Harmful Content Detection in Social Media
  4. 2025Detecting Offensive Memes with Social Biases in Singapore Context Using Multimodal Large Language Models
  5. 2024Exploring the Limits of Zero Shot Vision Language Models for Hate Meme Detection: The Vulnerabilities and their Interpretations
  6. 2026Adapting Reinforcement Learning with Chain-of-Thought Supervision for Explainable Detection of Hateful and Propagandistic Memes
  7. 2024Towards Low-Resource Harmful Meme Detection with LMM Agents
  8. 2026Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection