MA-Bench: Towards Fine-grained Micro-Action Understanding
On the map: Multimodal LLMs / vision-language models → Multimodal emotion understanding
Abstract (arXiv)
With the rapid development of Multimodal Large Language Models (MLLMs), their potential in Micro-Action understanding, a vital role in human emotion analysis, remains unexplored due to the absence of specialized benchmarks. To tackle this issue, we present MA-Bench, a benchmark comprising 1,000 videos and a three-tier evaluation architecture that progressively examines micro-action perception, relational comprehension, and interpretive reasoning. MA-Bench contains 12,000 structured question-answer pairs, enabling systematic assessment of both recognition accuracy and action interpretation. The results of 23 representative MLLMs reveal that there are significant challenges in capturing motion granularity and fine-grained body-part dynamics. To address these challenges, we further construct MA-Bench-Train, a large-scale training corpus with 20.5K videos annotated with structured micro-action captions for fine-tuning MLLMs. The results of Qwen3-VL-8B fine-tuned on MA-Bench-Train show clear performance improvements across micro-action reasoning and explanation tasks. Our work aims to establish a foundation benchmark for advancing MLLMs in understanding subtle micro-action and human-related behaviors. Project Page: https://MA-Bench.github.io
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Multimodal emotion understanding, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 54 of its 72 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
54 of 72 references.
References · 54
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen3 Technical Reportcited by 8,195
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
38 more
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
- 2024Phi-4 Technical Reportcited by 675
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
- 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 559
- 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 310
- 2015MovieQA: Understanding Stories in Movies through Question-Answeringcited by 304
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 212
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
- 2024Pixtral 12Bcited by 174
- 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 131
- 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 112
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuningcited by 86
- 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 69
- 2021iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysiscited by 63
- 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
- 2023STPrivacy: Spatio-Temporal Privacy-Preserving Action Recognitioncited by 29
- 2023Joint Skeletal and Semantic Embedding Loss for Micro-gesture Classificationcited by 24
- 2025FAVOR-Bench: A Comprehensive Benchmark for Fine-Grained Video Motion Understandingcited by 24
- 2024Prototypical Calibrating Ambiguous Samples for Micro-Action Recognitioncited by 22
- 2024MMAD: Multi-label Micro-Action Detection in Videoscited by 20
- 2022Bodily Behaviors in Social Interaction: Novel Annotations and State-of-the-Art Evaluationcited by 19
- 2024Micro-gesture Online Recognition using Learnable Query Pointscited by 17
- 2023Data Augmentation for Human Behavior Analysis in Multi-Person Conversationscited by 15
- 2024Repetitive Action Counting with Hybrid Temporal Relation Modelingcited by 13
- 2025MM-Gesture: Towards Precise Micro-Gesture Recognition through Multimodal Fusioncited by 13
- 2025Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognitioncited by 11
- 2024Temporal-Frequency State Space Duality: An Efficient Paradigm for Speech Emotion Recognitioncited by 10
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Self-supervised Learning Matters: A Simple Ensemble Solution for Micro-Gesture Recognitioncited by 4
- 2026Rethinking the Role of Feature Engineering and Learning Strategies in Few-Shot Hidden Emotion Recognitioncited by 3
- 2026MAC 2026: Advancing Micro-Action Analysis Towards Fine-Grained Understandingcited by 2
- 2026Motion Reinforces Appearance: RGB-Skeleton Gated Residual Fusion for Micro-Gesture Online Recognitioncited by 0
- 2026A Multi-Modal Framework with Cross-Subject Pseudo-Labeling and Semantic Alignment for Micro-Gesture Recognitioncited by 0
- 2026A New Multi-Domain Benchmark for Micro-Action Recognition and Detectioncited by 0
- 2026TextGaze: Prompting Gaze Target Estimation with Textual Scene Cuescited by 0
- 2026TextGaze: Prompting Gaze Target Estimation with Textual Scene Cues11 Jul 2026
- 2026MAC 2026: Advancing Micro-Action Analysis Towards Fine-Grained Understanding10 Jul 2026
- 2026Rethinking the Role of Feature Engineering and Learning Strategies in Few-Shot Hidden Emotion Recognition30 Jun 2026
- 2026A New Multi-Domain Benchmark for Micro-Action Recognition and Detection12 Jun 2026
- 2026A Multi-Modal Framework with Cross-Subject Pseudo-Labeling and Semantic Alignment for Micro-Gesture Recognition11 Jun 2026
- 2026Motion Reinforces Appearance: RGB-Skeleton Gated Residual Fusion for Micro-Gesture Online Recognition10 Jun 2026
- 2026Self-supervised Learning Matters: A Simple Ensemble Solution for Micro-Gesture Recognition8 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Recognition-Conditioned Reasoning: A Training-Free Multimodal-LLM Pipeline for Fine-Grained Micro-Action Understanding
- 2025LLaVAction: evaluating and training multi-modal large language models for action understanding
- 2025HumanVideo-MME: Benchmarking MLLMs for Human-Centric Video Understanding
- 2025MME-Emotion: A Holistic Evaluation Benchmark for Emotional Intelligence in Multimodal Large Language Models
- 2025Beyond Emotion Recognition: A Multi-Turn Multimodal Emotion Understanding and Reasoning Benchmark
- 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Models
- 2026AULLM++: Structured-Token-Conditioned Large Language Models for Micro-Expression Action Unit Detection
- 2026Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognition