Focus on What Matters: Constraining Spatial-Temporal Attention via Action-Units for Noise-Resilient AQA
Not on the map. Why?
Abstract (arXiv)
The core challenge in Action Quality Assessment (AQA) lies in extracting fine-grained motion features from redundant and complex video backgrounds. Existing global feature learning methods are constrained by extremely low "signal-to-noise ratios", making it difficult to distinguish intrinsic actions from background clutter. To address this, we propose a Pose-Guided Intrinsic Motion Distillation Framework that explicitly enforces physical constraints to focus on motion subjects and decouple motion execution from environmental outcomes. First, we design an Action-Unit Parser that constructs dynamic regions of interest (ROIs) using human pose topology as prior knowledge. This functions as a spatial hard-attention filter that physically removes background noise at the input stage, forcing the model to learn appearance and geometric features only from pure body regions. Second, to resolve factor entanglement, we introduce a dual-stream decoupling mechanism: the Motion Parser focuses on capturing purified joint motion details, while the Condition Parser independently processes non-body-related environmental feedback (e.g., splash in diving) to create two orthogonal evaluation dimensions in feature space. Finally, adaptive weight modules integrate these decoupled features to generate final scores. Experimental results on large-scale datasets including FineDiving, FineDiving-HM, and MTL-AQA demonstrate that this method achieves state-of-the-art (SOTA) performance in both action segmentation and scoring accuracy, validating the effectiveness of "noise suppression focusing" and "motion disentanglement" strategies in fine-grained action evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 6 Nov 2025.
Builds on
21 of 41 references.
References · 21
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 373
- 2021ASFormer: Transformer for Action Segmentationcited by 168
- 2022FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessmentcited by 107
- 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
- 2016Learning To Score Olympic Eventscited by 88
- 2020Alleviating Over-segmentation Errors by Detecting Action Boundariescited by 87
- 2020Uncertainty-aware Score Distribution Learning for Action Quality Assessmentcited by 80
- 2021Group-aware Contrastive Regression for Action Quality Assessmentcited by 75
- 2018Learning to score the figure skating sports videoscited by 73
- 2021FineAction: A Fine-Grained Video Dataset for Temporal Action Localizationcited by 61
9 more
- 2022Fine-grained Temporal Contrastive Learning for Weakly-supervised Temporal Action Localizationcited by 33
- 2024FineParser: A Fine-grained Spatio-temporal Action Parser for Human-centric Action Quality Assessmentcited by 25
- 2025Action Quality Assessment via Hierarchical Pose-guided Multi-stage Contrastive Regressioncited by 21
- 2018Fine-grained Activity Recognition in Baseball Videoscited by 20
- 2021Auto-Encoding Score Distribution Regression for Action Quality Assessmentcited by 18
- 2024CoFInAl: Enhancing Action Quality Assessment with Coarse-to-Fine Instruction Alignmentcited by 17
- 2024Hierarchical NeuroSymbolic Approach for Comprehensive and Explainable Action Quality Assessmentcited by 14
- 2024TimeMIL: Advancing Multivariate Time Series Classification via a Time-aware Multiple Instance Learningcited by 12
- 2024Multi-Stage Contrastive Regression for Action Quality Assessmentcited by 8
Built on by
Not cited yet.