Learning to Score Sign Language with Two-stage Method
Not on the map. Why?
Abstract (arXiv)
Human action recognition and performance assessment have been hot research topics in recent years. Recognition problems have mature solutions in the field of sign language, but past research in performance analysis has focused on competitive sports and medical training, overlooking the scoring assessment ,which is an important part of sign language teaching digitalization. In this paper, we analyze the existing technologies for performance assessment and adopt methods that perform well in human pose reconstruction tasks combined with motion rotation embedded expressions, proposing a two-stage sign language performance evaluation pipeline. Our analysis shows that choosing reconstruction tasks in the first stage can provide more expressive features, and using smoothing methods can provide an effective reference for assessment. Experiments show that our method provides good score feedback mechanisms and high consistency with professional assessments compared to end-to-end evaluations.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 16 Apr 2024.
Builds on
18 of 33 references.
References · 18
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
- 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
- 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 155
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 130
- 2022FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessmentcited by 107
- 2019Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videoscited by 104
6 more
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 101
- 2016Learning To Score Olympic Eventscited by 88
- 2020Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimationcited by 81
- 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
- 2017Using a single RGB frame for real time 3D hand pose estimation in the wildcited by 39
- 2020Action Quality Assessment using Siamese Network-Based Deep Metric Learningcited by 12
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.