mlsanityData to 7 Oct 2026

Self-supervised Learning Matters: A Simple Ensemble Solution for Micro-Gesture Recognition

arXiv 2606.09261 ↗First posted 8 Jun 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

In this paper, we present XInsight Lab's solution to the micro-gesture classification track of the 4th MiGA Challenge at IJCAI 2026, in which our solution ranked first and achieved a new state-of-the-art result. We propose a multimodal ensemble framework that integrates a self-supervised RGB-based model with supervised multi-stream models from previous solutions. The self-supervised RGB model is pretrained on 120K unlabeled clips via masked video modeling and then fine-tuned on iMiGUE. This simple yet effective RGB baseline achieves 69.224% top-1 accuracy on the iMiGUE test set, demonstrating the benefit of learning transferable representations from unlabeled in-domain videos. By incorporating this model as a complementary branch, the final ensemble reaches 74.419% top-1 accuracy, surpassing the previous state of the art by 1.206 percentage points. Experimental results on iMiGUE, including ablation studies on the ensemble strategy, validate the effectiveness of self-supervised RGB representation learning for micro-gesture recognition.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

32 of 47 references.

References · 32

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  4. 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
  5. 2021Revisiting Skeleton-based Action Recognitioncited by 256
  6. 20213D Human Action Representation Learning via Cross-View Consistency Pursuitcited by 105
  7. 2020MS2L: Multi-Task Self-Supervised Learning for Skeleton Based Action Recognitioncited by 92
  8. 2021Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised Action Recognitioncited by 89
  9. 2021iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysiscited by 63
  10. 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
  11. 2023Masked Motion Predictors are Strong 3D Action Representation Learnerscited by 41
  12. 2024Frequency Decoupling for Motion Magnification via Multi-Level Isomorphic Architecturecited by 28
20 more
  1. 2023EulerMormer: Robust Eulerian Motion Magnification via Dynamic Filtering within Transformercited by 27
  2. 2023Joint Skeletal and Semantic Embedding Loss for Micro-gesture Classificationcited by 24
  3. 2024Prototypical Calibrating Ambiguous Samples for Micro-Action Recognitioncited by 22
  4. 2024MMAD: Multi-label Micro-Action Detection in Videoscited by 20
  5. 2022Group Contextualization for Video Recognitioncited by 18
  6. 2024Micro-gesture Online Recognition using Learnable Query Pointscited by 17
  7. 2024Prototype Learning for Micro-gesture Classificationcited by 17
  8. 2023Data Augmentation for Human Behavior Analysis in Multi-Person Conversationscited by 15
  9. 2025MM-Gesture: Towards Precise Micro-Gesture Recognition through Multimodal Fusioncited by 13
  10. 2022Attention in Attention: Modeling Context Correlation for Efficient Video Classificationcited by 12
  11. 2025Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognitioncited by 11
  12. 2025Exploiting Ensemble Learning for Cross-View Isolated Sign Language Recognitioncited by 10
  13. 2025Online Micro-gesture Recognition Using Data Augmentation and Spatial-Temporal Attentioncited by 10
  14. 2025SMILE: Infusing Spatial and Motion Semantics in Masked Video Learningcited by 9
  15. 2026XInsight: Integrative Stage-Consistent Psychological Counseling Support Agents for Digital Well-Beingcited by 9
  16. 2026MA-Bench: Towards Fine-grained Micro-Action Understandingcited by 7
  17. 2025Towards Fine-Grained Emotion Understanding via Skeleton-Based Micro-Gesture Recognitioncited by 4
  18. 2025Hybrid-supervised Hypergraph-enhanced Transformer for Micro-gesture Based Emotion Recognitioncited by 3
  19. 2026Weak to Strong: VLM-Based Pseudo-Labeling as a Weakly Supervised Training Strategy in Multimodal Video-based Hidden Emotion Understanding Taskscited by 2
  20. 2026iMiGUE-3K: A Large-Scale Benchmark for Micro-Gesture Analysis with Self-Supervised Learningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.