Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognition
On the map: Multimodal LLMs / vision-language models → Multimodal emotion understanding
Abstract (arXiv)
While Multimodal Large Language Models (MLLMs) excel in general video understanding, their capability in fine-grained and motion-centric tasks remains limited. This limitation is particularly critical in micro-gesture recognition (MGR), where micro-gestures (MGs) - subtle, short-duration, and spatially localized human movements - serve as key discriminative signals for implicit affective analysis, yet are easily neglected following common prompting practices. Although MGR has been intensively studied by many discriminative approaches, the use of MLLMs for MGR is underexplored, with notably poor performance. We hypothesize that the motion-sensitive representation ability of MLLMs is constrained by their inherent single-pass forward inference, which can be substantially enhanced through carefully designed test-time guidance. Motivated by this, building on our prior findings regarding temporal insensitivity in Video LLMs, we diagnose zero-shot MGR errors in the Negative Log-Likelihood (NLL) space. We observe that MLLMs suffer from two bottlenecks: 1) insufficient localized evidence and 2) severe score biases driven by language and motion-agnostic appearances. Thus, we propose a novel test-time evidence calibration framework that improves both reasoning details and prediction reliability. Specifically, we introduce a tree search mechanism to progressively acquire localized, fine-grained visual evidence, coupled with a test-time calibration module to mitigate score biases. The multi-cue fusion module then integrates evidence from multiple cues without relying on a single cue for final prediction. Our framework achieves mean-class accuracies of 26.84% on iMiGUE and 22.10% on MA-52, significantly outperforming the Qwen2.5-VL baseline, which produces 16.15% and 10.20%, respectively. The code will be available at https://zero-melo.github.io/Zero-MELO.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal emotion understanding, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 41 of its 71 references that are in the map. First posted on arXiv 14 Aug 2026.
Builds on
41 of 71 references.
Closest ancestors · 1
Same direction, newest first
Other references · 40
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
- 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 688
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 686
- 2022Contrastive Decoding: Open-ended Text Generation as Optimizationcited by 609
28 more
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
- 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
- 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
- 2025Thyme: Think Beyond Imagescited by 167
- 2024Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Attention Lenscited by 143
- 2024IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decodingcited by 118
- 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 103
- 2024Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attentioncited by 74
- 2021iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysiscited by 63
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 50
- 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learningcited by 34
- 2025Token Activation Map to Visually Explain Multimodal LLMscited by 32
- 2025Octopus: Alleviating Hallucination via Dynamic Contrastive Decodingcited by 24
- 2025Retrieval-Augmented Perception: High-Resolution Image Perception Meets Visual RAGcited by 23
- 2024MMAD: Multi-label Micro-Action Detection in Videoscited by 20
- 2022Bodily Behaviors in Social Interaction: Novel Annotations and State-of-the-Art Evaluationcited by 19
- 2025Zoom-Refine: Boosting High-Resolution Multimodal Understanding via Localized Zoom and Self-Refinementcited by 18
- 2025MM-Gesture: Towards Precise Micro-Gesture Recognition through Multimodal Fusioncited by 14
- 2025Online Micro-gesture Recognition Using Data Augmentation and Spatial-Temporal Attentioncited by 11
- 2024Identity-free Artificial Emotional Intelligence via Micro-Gesture Understandingcited by 8
- 2025DEEMO: De-identity Multimodal Emotion Recognition and Reasoningcited by 7
- 2025CLIP-MG: Guiding Semantic Attention with Skeletal Pose Features and RGB Data for Micro-Gesture Recognition on the iMiGUE Datasetcited by 4
- 2025Hybrid-supervised Hypergraph-enhanced Transformer for Micro-gesture Based Emotion Recognitioncited by 3
- 2026MAC 2026: Advancing Micro-Action Analysis Towards Fine-Grained Understandingcited by 2
- 2026SayNext-Bench: Why Do LLMs Struggle with Next-Utterance Anticipation?cited by 1
- 2026iMiGUE-Speech: A Spontaneous Speech Dataset for Affective Analysiscited by 1
- 2026MOTOR-Bench: A Real-world Dataset and Multi-agent Framework for Zero-shot Human Mental State Understandingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MA-Bench: Towards Fine-grained Micro-Action Understanding
- 2026GMoT: Gated Motion-Aware Tokenization for Fine-Grained Micro-Gesture Video Reasoning with Multimodal LLMs
- 2026Recognition-Conditioned Reasoning: A Training-Free Multimodal-LLM Pipeline for Fine-Grained Micro-Action Understanding
- 2026FewMMBench: A Benchmark for Multimodal Few-Shot Learning
- 2026Benchmarking Multimodal Large Language Models for Zero-Shot Human-Object Interaction
- 2024MicroEmo: Time-Sensitive Multimodal Emotion Recognition with Micro-Expression Dynamics in Video Dialogues
- 2026MAF: Multimodal Adaptive Few-shot Prompting for Sentiment Analysis with MLLMs
- 2025MSF-Mamba: Motion-aware State Fusion Mamba for Efficient Micro-Gesture Recognition