Moltbook Moderation: Uncovering Hidden Intent Through Multi-Turn Dialogue
Not on the map. Why?
Abstract (arXiv)
The emergence of multi-agent systems introduces novel moderation challenges that extend beyond content filtering. Agents with malicious intent may contribute harmful content that appears benign to evade content-based moderation, while compromising the system through exploitative and malicious behavior manifested across their overall interaction patterns within the community. To address this, we introduce BOT-MOD (BOT-MODeration), a moderation framework that grounds detection in agent intent rather than traditional content level signals. BOT-MOD identifies the underlying intent by engaging with the target agent in a multi-turn exchange guided by Gibbs-based sampling over candidate intent hypotheses. This progressively narrows the space of plausible agent objectives to identify the underlying behavior. To evaluate our approach, we construct a dataset derived from Moltbook that encompasses diverse benign and malicious behaviors based on actual community structures, posts, and comments. Results demonstrate that BOT-MOD reliably identifies agent intent across a range of adversarial configurations, while maintaining a low false positive rate on benign behaviors. This work advances the foundation for scalable, intent-aware moderation of agents in open multi-agent environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 44 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
17 of 44 references.
References · 17
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
- 2025DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Researchcited by 114
- 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 99
- 2014The Rise of Social Botscited by 96
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 66
- 2017Online Human-Bot Interactions: Detection, Estimation, and Characterizationcited by 64
- 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
5 more
- 2024Content Moderation by LLM: From Accuracy to Legitimacycited by 30
- 2024Intent Detection in the Age of LLMscited by 25
- 2020Intentonomy: a Dataset and Study towards Human Intent Understandingcited by 22
- 2025Deep Learning Approaches for Multimodal Intent Recognition: A Surveycited by 6
- 2023Distilled Self-Critique of LLMs with Synthetic Data: a Bayesian Perspectivecited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When Agents Talk: Discourse, Manipulation, and Risk in an Agentic Social Network
- 2026The Rise of AI Agent Communities: Large-Scale Analysis of Discourse and Interaction on Moltbook
- 2026"Humans welcome to observe": A First Look at the Agent Social Network Moltbook
- 2025MV-Debate: Multi-view Agent Debate with Dynamic Reflection Gating for Multimodal Harmful Content Detection in Social Media
- 2026Social Simulacra in the Wild: AI Agent Communities on Moltbook
- 2026Agents in the Wild: Safety, Society, and the Illusion of Sociality on Moltbook
- 2025HarmTransform: Transforming Explicit Harmful Queries into Stealthy via Multi-Agent Debate
- 2026One Turn Too Late: Learning When to Intervene Against Multi-Turn Malicious Intent