A Survey of Video-based Action Quality Assessment
Not on the map. Why?
Abstract (arXiv)
Human action recognition and analysis have great demand and important application significance in video surveillance, video retrieval, and human-computer interaction. The task of human action quality evaluation requires the intelligent system to automatically and objectively evaluate the action completed by the human. The action quality assessment model can reduce the human and material resources spent in action evaluation and reduce subjectivity. In this paper, we provide a comprehensive survey of existing papers on video-based action quality assessment. Different from human action recognition, the application scenario of action quality assessment is relatively narrow. Most of the existing work focuses on sports and medical care. We first introduce the definition and challenges of human action quality assessment. Then we present the existing datasets and evaluation metrics. In addition, we summarized the methods of sports and medical care according to the model categories and publishing institutions according to the characteristics of the two fields. At the end, combined with recent work, the promising development direction in action quality assessment is discussed.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 31 of its 66 references that are in the map. First posted on arXiv 20 Apr 2022.
Builds on
31 of 66 references.
References · 31
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,067
- 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 852
- 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 635
- 2017Learning Spatio-Temporal Representation with Pseudo-3D Residual Networkscited by 386
- 2016Convolutional Two-Stream Network Fusion for Video Action Recognitioncited by 384
- 2017Temporal Relational Reasoning in Videoscited by 324
- 2017Temporal Segment Networks for Action Recognition in Videoscited by 279
- 2020Self-Supervised MultiModal Versatile Networkscited by 276
- 2019Self-Supervised Learning by Cross-Modal Audio-Video Clusteringcited by 264
19 more
- 2020FineGym: A Hierarchical Video Dataset for Fine-grained Action Understandingcited by 232
- 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 221
- 2020SpeedNet: Learning the Speediness in Videoscited by 171
- 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
- 2016Learning To Score Olympic Eventscited by 87
- 2020Uncertainty-aware Score Distribution Learning for Action Quality Assessmentcited by 80
- 2018Action Quality Assessment Across Multiple Actionscited by 78
- 2020Evolving Losses for Unsupervised Video Representation Learningcited by 74
- 2018Learning to score the figure skating sports videoscited by 72
- 2018The Pros and Cons: Rank-aware Temporal Attention for Skill Determination in Long Videoscited by 68
- 2018LSTA: Long Short-Term Attention for Egocentric Action Recognitioncited by 57
- 2016Am I a Baller? Basketball Performance Assessment from First-Person Videoscited by 40
- 2022TSA-Net: Tube Self-Attention Network for Action Quality Assessmentcited by 36
- 2019Manipulation-skill Assessment from Videos with Spatial Attention Networkcited by 29
- 2017Joint Discovery of Object States and Manipulation Actionscited by 28
- 2017Video and Accelerometer-Based Motion Analysis for Automated Surgical Skills Assessmentcited by 28
- 2016Recognizing Surgical Activities with Recurrent Neural Networkscited by 21
- 2015You-Do, I-Learn: Unsupervised Multi-User egocentric Approach Towards Video-Based Guidancecited by 17
- 2017EvaluationNet: Can Human Skill be Evaluated by Deep Networks?cited by 2
Built on by
Citing papers per year: 2023: 5; 2024: 3; 2025: 3; 2026: 3.
14 papers.
Sort:
By area:
- 2023AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perceptioncited by 39
- 2023Context De-confounded Emotion Recognitioncited by 34
- 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmarkcited by 20
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
- 2025PHI: Bridging Domain Shift in Long-Term Action Quality Assessment via Progressive Hierarchical Instructioncited by 10
- 2025A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directionscited by 7
- 2024TechCoach: Towards Technical-Point-Aware Descriptive Action Coachingcited by 6
- 2023CPR-Coach: Recognizing Composite Error Actions based on Single-class Trainingcited by 4
- 2024HandGCAT: Occlusion-Robust 3D Hand Mesh Reconstruction from Monocular Imagescited by 4
- 2023An X3D Neural Network Analysis for Runner's Performance Assessment in a Wild Sporting Environmentcited by 1
- 2025FineSkiing: A Fine-grained Benchmark for Skiing Action Quality Assessmentcited by 0
- 2026Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Trainingcited by 0
- 2026Can Vision-Language Models Judge Olympic Diving? From Reasoning to Scores in Zero-Shot Action Quality Assessment16 Sep 2026
- 2026SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos30 Jun 2026
- 2026Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Training26 Jun 2026
- 2025FineSkiing: A Fine-grained Benchmark for Skiing Action Quality Assessment13 Nov 2025
- 2025PHI: Bridging Domain Shift in Long-Term Action Quality Assessment via Progressive Hierarchical Instruction26 May 2025
- 2025A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directions5 Feb 2025
- 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmark15 Dec 2024
- 2024TechCoach: Towards Technical-Point-Aware Descriptive Action Coaching26 Nov 2024
- 2024HandGCAT: Occlusion-Robust 3D Hand Mesh Reconstruction from Monocular Images27 Feb 2024
- 2023CPR-Coach: Recognizing Composite Error Actions based on Single-class Training21 Sep 2023
- 2023AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perception26 Jul 2023
- 2023An X3D Neural Network Analysis for Runner's Performance Assessment in a Wild Sporting Environment22 Jul 2023
2 more
- 2023AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perceptioncited by 39
- 2023Context De-confounded Emotion Recognitioncited by 34
- 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmarkcited by 20
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
- 2025PHI: Bridging Domain Shift in Long-Term Action Quality Assessment via Progressive Hierarchical Instructioncited by 10
- 2025A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directionscited by 7
- 2024TechCoach: Towards Technical-Point-Aware Descriptive Action Coachingcited by 6
- 2023CPR-Coach: Recognizing Composite Error Actions based on Single-class Trainingcited by 4
- 2024HandGCAT: Occlusion-Robust 3D Hand Mesh Reconstruction from Monocular Imagescited by 4
- 2023An X3D Neural Network Analysis for Runner's Performance Assessment in a Wild Sporting Environmentcited by 1
- 2025FineSkiing: A Fine-grained Benchmark for Skiing Action Quality Assessmentcited by 0
- 2026Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Trainingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos30 Jun 2026
- 2026Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Training26 Jun 2026
- 2025FineSkiing: A Fine-grained Benchmark for Skiing Action Quality Assessment13 Nov 2025
- 2025PHI: Bridging Domain Shift in Long-Term Action Quality Assessment via Progressive Hierarchical Instruction26 May 2025
- 2025A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directions5 Feb 2025
- 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmark15 Dec 2024
- 2024TechCoach: Towards Technical-Point-Aware Descriptive Action Coaching26 Nov 2024
- 2024HandGCAT: Occlusion-Robust 3D Hand Mesh Reconstruction from Monocular Images27 Feb 2024
- 2023CPR-Coach: Recognizing Composite Error Actions based on Single-class Training21 Sep 2023
- 2023AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perception26 Jul 2023
- 2023An X3D Neural Network Analysis for Runner's Performance Assessment in a Wild Sporting Environment22 Jul 2023
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decision7 Jul 2023
12 newest of 13 All 13 (JSON)