mlsanityData to 14 Oct 2026

FG-SGL: Fine-Grained Semantic Guidance Learning via Motion Process Decomposition for Micro-Gesture Recognition

arXiv 2603.16269 ↗First posted 17 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Micro-gesture recognition (MGR) is challenging due to subtle inter-class variations. Existing methods rely on category-level supervision, which is insufficient for capturing subtle and localized motion differences. Thus, this paper proposes a Fine-Grained Semantic Guidance Learning (FG-SGL) framework that jointly integrates fine-grained and category-level semantics to guide vision--language models in perceiving local MG motions. FG-SA adopts fine-grained semantic cues to guide the learning of local motion features, while CP-A enhances the separability of MG features through category-level semantic guidance. To support fine-grained semantic guidance, this work constructs a fine-grained textual dataset with human annotations that describes the dynamic process of MGs in four refined semantic dimensions. Furthermore, a Multi-Level Contrastive Optimization strategy is designed to jointly optimize both modules in a coarse-to-fine pattern. Experiments show that FG-SGL achieves competitive performance, validating the effectiveness of fine-grained semantic guidance for MGR.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

18 of 26 references.

References · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  4. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  5. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  6. 2023VideoChat: Chat-Centric Video Understandingcited by 857
  7. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
  8. 2020Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognitioncited by 343
  9. 2021iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysiscited by 63
  10. 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
  11. 2023Joint Skeletal and Semantic Embedding Loss for Micro-gesture Classificationcited by 25
  12. 2024Prototype Learning for Micro-gesture Classificationcited by 18
6 more
  1. 2025Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognitioncited by 11
  2. 2024Identity-free Artificial Emotional Intelligence via Micro-Gesture Understandingcited by 8
  3. 2024Enhancing Micro Gesture Recognition for Emotion Understanding via Context-aware Visual-Text Contrastive Learningcited by 6
  4. 2025Towards Fine-Grained Emotion Understanding via Skeleton-Based Micro-Gesture Recognitioncited by 4
  5. 2025CLIP-MG: Guiding Semantic Attention with Skeletal Pose Features and RGB Data for Micro-Gesture Recognition on the iMiGUE Datasetcited by 4
  6. 2025Hybrid-supervised Hypergraph-enhanced Transformer for Micro-gesture Based Emotion Recognitioncited by 3

Built on by

Not cited yet.