Active Inference for Micro-Gesture Recognition: EFE-Guided Temporal Sampling and Adaptive Learning
Not on the map. Why?
Abstract (arXiv)
Micro-gestures are subtle and transient movements triggered by unconscious neural and emotional activities, holding great potential for human-computer interaction and clinical monitoring. However, their low amplitude, short duration, and strong inter-subject variability make existing deep models prone to degradation under low-sample, noisy, and cross-subject conditions. This paper presents an active inference-based framework for micro-gesture recognition, featuring Expected Free Energy (EFE)-guided temporal sampling and uncertainty-aware adaptive learning. The model actively selects the most discriminative temporal segments under EFE guidance, enabling dynamic observation and information gain maximization. Meanwhile, sample weighting driven by predictive uncertainty mitigates the effects of label noise and distribution shift. Experiments on the SMG dataset demonstrate the effectiveness of the proposed method, achieving consistent improvements across multiple mainstream backbones. Ablation studies confirm that both the EFE-guided observation and the adaptive learning mechanism are crucial to the performance gains. This work offers an interpretable and scalable paradigm for temporal behavior modeling under low-resource and noisy conditions, with broad applicability to wearable sensing, HCI, and clinical emotion monitoring.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 35 references that are in the map. First posted on arXiv 8 Mar 2026.
Builds on
19 of 35 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,067
- 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
- 2014Long-term Recurrent Convolutional Networks for Visual Recognition and Descriptioncited by 483
- 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 325
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 242
- 2015Variable Rate Image Compression with Recurrent Neural Networkscited by 168
- 2023Uncertainty Estimation by Fisher Information-based Evidential Deep Learningcited by 58
- 2021Active Inference in Robotics and Artificial Agents: Survey and Challengescited by 52
7 more
- 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
- 2022UMIX: Improving Importance Weighting for Subpopulation Shift via Uncertainty-Aware Mixupcited by 34
- 2025Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understandingcited by 30
- 2020Active Inference and Behavior Trees for Reactive Action Planning and Execution in Roboticscited by 23
- 2023U-CE: Uncertainty-aware Cross-Entropy for Semantic Segmentationcited by 11
- 2024AdaGlimpse: Active Visual Exploration with Arbitrary Glimpse Position and Scalecited by 7
- 2023Scale-Dropout: Estimating Uncertainty in Deep Neural Networks Using Stochastic Scalecited by 6
Built on by
Not cited yet.