mlsanityData to 14 Oct 2026

A New Multi-Domain Benchmark for Micro-Action Recognition and Detection

arXiv 2606.14096 ↗First posted 12 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Micro-actions are short-duration, low-amplitude subtle body movements at the whole-body level that can reveal latent intentions, involuntary reactions, and fine-grained affective changes. Our previous MA-52 benchmark has provided an important foundation for micro-action recognition, but it remains limited in scale, scene diversity, task coverage, and evaluation protocols. To advance micro-action analysis toward more realistic and comprehensive settings, we introduce MMA-82, a large-scale multi-domain extension of MA-52. MMA-82 expands the label space from 52 to 82 fine-grained micro-action categories and covers four distinct domains, including laboratory interviews, street interviews, psychiatric patient interviews, and emotion-rich television videos, resulting in 77,856 annotated instances from 454 subjects. Built upon MMA-82, we establish two core tasks: Micro-Action Recognition and Multi-label Micro-Action Detection. For recognition, we further define in-domain and cross-domain protocols, including few-shot and zero-shot settings, to evaluate model robustness, transferability, and generalization. Extensive experiments show that current methods still struggle with realistic micro-action understanding, especially under domain shift, long-tailed category distributions, and complex temporal localization. Beyond benchmarking, we investigate the relationship between micro-actions and emotion, showing that micro-actions are strongly associated with emotional states and provide complementary cues to facial micro-expressions for improved emotion recognition. These results demonstrate that MMA-82 serves as a comprehensive and challenging benchmark for realistic micro-action analysis and a valuable resource for human-centered AI. MMA-82 is available at https://lpynow.github.io/MMA-82-AIM/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

29 of 46 references.

References · 29

  1. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  2. 2018SlowFast Networks for Video Recognitioncited by 1,867
  3. 2021ViViT: A Video Vision Transformercited by 1,620
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  5. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  6. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  7. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
  8. 2021Video Swin Transformercited by 1,091
  9. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
  10. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 686
  11. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 533
  12. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 311
17 more
  1. 2021Revisiting Skeleton-based Action Recognitioncited by 257
  2. 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
  3. 2019Context-Aware Emotion Recognition Networkscited by 99
  4. 2022PYSKL: Towards Good Practices for Skeleton Action Recognitioncited by 83
  5. 2018Diagnosing Error in Temporal Action Detectorscited by 71
  6. 2021iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysiscited by 63
  7. 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
  8. 2023End-to-End Temporal Action Detection with 1B Parameters Across 1000 Framescited by 47
  9. 2024OpenDataLab: Empowering General Artificial Intelligence with Open Datasetscited by 29
  10. 2022PointTAD: Multi-Label Temporal Action Detection with Learnable Query Pointscited by 22
  11. 2024Prototypical Calibrating Ambiguous Samples for Micro-Action Recognitioncited by 22
  12. 2024MMAD: Multi-label Micro-Action Detection in Videoscited by 20
  13. 2022Group Contextualization for Video Recognitioncited by 18
  14. 2025Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognitioncited by 11
  15. 2026MA-Bench: Towards Fine-grained Micro-Action Understandingcited by 9
  16. 2024GPT4Ego: Unleashing the Potential of Pre-trained Models for Zero-Shot Egocentric Action Recognitioncited by 8
  17. 2024Towards Student Actions in Classroom Scenes: New Dataset and Baselinecited by 2

Built on by

Not cited yet.