mlsanityData to 7 Oct 2026

MHPR: Multidimensional Human Perception and Reasoning Benchmark for Large Vision-Languate Models

arXiv 2605.03485 ↗First posted 5 May 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Multidimensional human understanding is essential for real-world applications such as film analysis and virtual digital humans, yet current LVLM benchmarks largely focus on single-task settings and lack fine-grained, human-centric evaluation. In this work, we introduce MHPR, a comprehensive benchmark for joint perception-reasoning over human-centric scenes spanning individual, multi-person, and human-object interaction dimensions. MHPR comprises a multi-level data design-Captioned Raw Data (C-RD), Supervised Fine-Tuning Data (SFT-D), Reinforcement Learning Data (RL-D), and Test Data (T-D)-together with an automated caption/VQA generation pipeline (ACVG) that performs category-wise attribute decomposition, attribute-specific rewriting, and multi-model voting to ensure high-quality, scalable annotations. We evaluate state-of-the-art vision-language models on fine-grained attributes (appearance, clothing, pose, parts) and high-level semantics (social relations, action semantics, spatial relations, intent and functionality). Our findings show that: 1) format-aligned SFT data substantially improves instruction following and stability; 2) challenge-focused RL data derived from bad-case analysis further enhances perception and reasoning on difficult instances; and 3) training Qwen2.5-VL-7B with MHPR yields significant gains, achieving near-parity with considerably larger models. We release ACVG and MHPR to facilitate reproducible, extensible research on human-centric perception and reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 25 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

23 of 25 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Perception-Aware Policy Optimization for Multimodal Reasoning8 Jul
  2. 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning19 Jun
  3. 2025VLM-R3: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thought22 May
  4. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  5. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Models4 Dec
  6. 2024CounterCurate: Enhancing Physical and Semantic Visio-Linguistic Compositional Reasoning via Counterfactual Examples20 Feb

Other references · 17

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  3. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  4. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  5. 2016Modeling Context in Referring Expressionscited by 1,054
  6. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
  7. 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
  8. 2025Boosting MLLM Reasoning with Text-Debiased Hint-GRPOcited by 32
  9. 2025Referring to Any Personcited by 20
  10. 2025M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoningcited by 16
  11. 2025Face-Human-Bench: A Comprehensive Benchmark of Face and Human Understanding for Multi-modal Assistantscited by 12
  12. 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
5 more
  1. 2024HumanVBench: Probing Human-Centric Video Understanding in MLLMs with Automatically Synthesized Benchmarkscited by 10
  2. 2024HumanVLM: Foundation for Human-Scene Vision-Language Modelcited by 8
  3. 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstructioncited by 8
  4. 2024HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understandingcited by 7
  5. 2023Delving Deeper into Data Scaling in Masked Image Modelingcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025HumanPCR: Probing MLLM Capabilities in Diverse Human-Centric Scenes
  2. 2025HumanVideo-MME: Benchmarking MLLMs for Human-Centric Video Understanding
  3. 2024MVP-Bench: Can Large Vision--Language Models Conduct Multi-level Visual Perception Like Humans?
  4. 2025Human-MME: A Holistic Evaluation Benchmark for Human-Centric Multimodal Large Language Models
  5. 2026Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI Models
  6. 2025Do You See Me : A Multidimensional Benchmark for Evaluating Visual Perception in Multimodal LLMs
  7. 2026A Dataset for Dynamic Human Preferences for Vision Language Models
  8. 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning