MISID: A Multimodal Multi-turn Dataset for Complex Intent Recognition in Strategic Deception Games
Not on the map. Why?
Abstract (arXiv)
Understanding human intent in complex multi-turn interactions remains a fundamental challenge in human-computer interaction and behavioral analysis. While existing intent recognition datasets focus mainly on single utterances or simple dialogues, real-world scenarios often involve sophisticated strategic interactions where participants must maintain complex deceptive narratives over extended periods. To address this gap, we introduce MISID, a comprehensive multimodal, multi-turn, and multi-participant benchmark for intent recognition. Sourced from high-stakes social strategy games, MISID features a fine-grained, two-tier multi-dimensional annotation scheme tailored for long-context discourse analysis and evidence-based causal tracking. Our systematic evaluation of state-of-the-art Multimodal Large Language Models (MLLMs) on MISID reveals critical deficiencies in complex scenarios, including text-prior visual hallucination, impaired cross-modal synergy, and limited capacity in chaining causal cues. Consequently, we propose FRACTAM as a baseline framework. Using a ``Decouple-Anchor-Reason'' paradigm, FRACTAM reduces text bias by extracting pure unimodal factual representations, employs two-stage retrieval for long-range factual anchoring, and constructs explicit cross-modal evidence chains. Extensive experiments demonstrate that FRACTAM enhances mainstream models' performance in complex strategic tasks, improving hidden intent detection and inference while maintaining robust perceptual accuracy. Our dataset is available at https://naislab.cn/datasets/MISID.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 59 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
22 of 59 references.
References · 22
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
- 2020Experience Grounds Languagecited by 242
- 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 186
- 2019Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)cited by 174
- 2025MiniMax-01: Scaling Foundation Models with Lightning Attentioncited by 166
10 more
- 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 162
- 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 111
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
- 2021Multilingual and Cross-Lingual Intent Detection from Spoken Datacited by 35
- 2021Multimodal Emotion-Cause Pair Extraction in Conversationscited by 31
- 2024MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversationscited by 26
- 2024Emotion and Intent Joint Understanding in Multimodal Conversation: A Benchmarking Datasetcited by 15
- 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospectscited by 11
- 2024Impact of Stickers on Multimodal Sentiment and Intent in Social Media: A New Task, Dataset and Baselinecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Can MLLMs Read the Room? A Multimodal Benchmark for Verifying Truthfulness in Multi-Party Social Interactions
- 2025Can MLLMs Read the Room? A Multimodal Benchmark for Assessing Deception in Multi-Party Social Interactions
- 2026Hidden in Plain Text: Measuring LLM Deception Quality Against Human Baselines Using Social Deduction Games
- 2026ThinkDeception: A Progressive Reinforcement Learning Framework for Interpretable Multimodal Deception Detection
- 2026Lying to Win: Assessing LLM Deception through Human-AI Games and Parallel-World Probing
- 2025Among Us: A Sandbox for Measuring and Detecting Agentic Deception
- 2025Debate with Images: Detecting Deceptive Behaviors in Multimodal Large Language Models
- 2026Evaluating Large Language Models in a Complex Hidden Role Game