MMHBench: A Multi-Perspective Benchmark for Mental Health Understanding in Long-Form Videos
Not on the map. Why?
Abstract (arXiv)
Mental health understanding in long-form videos requires nuanced reasoning over observable behavior, interpersonal context, and latent psychological states. Existing benchmarks largely reduce this task to coarse-grained classification, providing limited insight into whether models truly understand psychological phenomena or rely on superficial correlations. To address this limitation, we introduce MMHBench, a comprehensive multimodal benchmark for multi-perspective mental health understanding, comprising 268 long-form videos and 2,184 carefully curated questions. MMHBench organizes the evaluation into two complementary settings: (1) third-person assessment, consisting of 605 questions that focus on the interpretation of observable behaviors and multimodal evidence, and (2) first-person perspective-taking, comprising 1,579 questions that require perspective-conditioned reasoning to identify the interpretation of the mental state supported by the available multimodal evidence. We propose a Multi-Agent Question Generation (MAQG) framework that simulates diverse social roles to synthesize questions from multiple perspectives. The generated questions are refined through multi-role feedback and iterative optimization, followed by expert-guided verification to ensure quality and validity. Extensive evaluation of 22 representative multimodal large language models (MLLMs), spanning both open-source and leading closed-source models, demonstrates that long-form video mental health understanding remains highly challenging.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
28 of 45 references.
References · 28
- 2023GPT-4 Technical Reportcited by 18,278
- 2025Qwen2.5-VL Technical Reportcited by 5,499
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,452
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,389
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,070
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 672
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 653
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 637
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 406
- 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 283
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 177
16 more
- 2025BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understandingcited by 73
- 2022M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Databasecited by 50
- 2022Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Modelcited by 37
- 2022D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chatcited by 37
- 2025Video-MMLU: A Massive Multi-Discipline Lecture Understanding Benchmarkcited by 37
- 2023SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Modelscited by 28
- 2024Depression Detection on Social Media with Large Language Modelscited by 20
- 2024InfiniBench: A Benchmark for Large Multi-Modal Models in Long-Form Movies and TV Showscited by 20
- 2025Beyond Emotion Recognition: A Multi-Turn Multimodal Emotion Understanding and Reasoning Benchmarkcited by 12
- 2024MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social Mediacited by 9
- 2024LMVD: A Large-Scale Multimodal Vlog Dataset for Depression Detection in the Wildcited by 8
- 2025PsyScam: A Benchmark for Psychological Techniques in Real-World Scamscited by 8
- 2026Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responsescited by 6
- 2025The First MPDD Challenge: Multimodal Personality-aware Depression Detectioncited by 5
- 2025AgentMental: An Interactive Multi-Agent Framework for Explainable and Adaptive Mental Health Assessmentcited by 5
- 2025M-HELP: Using Social Media Data to Detect Mental Health Help-Seeking Signalscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Towards Interpretable Mental Health Analysis with Large Language Models
- 2025MindEval: Benchmarking Language Models on Multi-turn Mental Health Support
- 2026OMIND: Framework for Knowledge Grounded Finetuning and Multi-Turn Dialogue Benchmark for Mental Health LLMs
- 2025Reasoning Is Not All You Need: Examining LLMs for Multi-Turn Mental Health Conversations
- 2026MOTOR-Bench: A Real-world Dataset and Multi-agent Framework for Zero-shot Human Mental State Understanding
- 2025MiraMind: Benchmarking Reliable Mental Health Reasoning beyond Answer Accuracy
- 2025MAGI: Multi-Agent Guided Interview for Psychiatric Assessment
- 2025Cognitive-Mental-LLM: Evaluating Reasoning in Large Language Models for Mental Health Prediction via Online Text