3D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approach
Not on the map. Why?
Abstract (arXiv)
Understanding human actions from videos is essential in many domains, including sports. In figure skating, technical judgments are performed by watching skaters' 3D movements, and its part of the judging procedure can be regarded as a Temporal Action Segmentation (TAS) task. TAS tasks in figure skating that automatically assign temporal semantics to video are actively researched. However, there is a lack of datasets and effective methods for TAS tasks requiring 3D pose data. In this study, we first created the FS-Jump3D dataset of complex and dynamic figure skating jumps using optical markerless motion capture. We also propose a new fine-grained figure skating jump TAS dataset annotation method with which TAS models can learn jump procedures. In the experimental results, we validated the usefulness of 3D pose features as input and the fine-grained dataset for the TAS model in figure skating. FS-Jump3D Dataset is available at https://github.com/ryota-skating/FS-Jump3D.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 36 of its 76 references that are in the map. First posted on arXiv 29 Aug 2024.
Builds on
36 of 76 references.
References · 36
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2020Rescaling Egocentric Visioncited by 529
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 370
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2020Whole-Body Human Pose Estimation in the Wildcited by 178
- 2021ASFormer: Transformer for Action Segmentationcited by 166
- 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 148
24 more
- 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
- 2020The IKEA ASM Dataset: Understanding People Assembling Furniture through Actions, Objects and Posecited by 95
- 2022Temporal Action Segmentation: An Analysis of Modern Techniquescited by 85
- 2022My View is the Best View: Procedure Learning from Egocentric Videoscited by 81
- 2020The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-like Domaincited by 79
- 2018Action Quality Assessment Across Multiple Actionscited by 78
- 2018Learning to score the figure skating sports videoscited by 72
- 2023MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Networkcited by 62
- 2022Spotting Temporally Precise, Fine-Grained Events in Videocited by 40
- 2023VARS: Video Assistant Referee System for Automated Soccer Decision Making from Multiple Viewscited by 38
- 2021Video Pose Distillation for Few-Shot, Fine-Grained Sports Action Recognitioncited by 29
- 2023SportsPose -- A Dynamic 3D sports pose datasetcited by 26
- 2022Semi-Supervised Training to Improve Player and Ball Detection in Soccercited by 25
- 2022MonoTrack: Shuttle trajectory reconstruction from monocular badminton videocited by 24
- 2024T-DEED: Temporal-Discriminability Enhancer Encoder-Decoder for Precise Event Spotting in Sports Videoscited by 21
- 2018Fine-grained Activity Recognition in Baseball Videoscited by 20
- 2020Group Activity Detection from Trajectory and Video Data in Soccercited by 17
- 2022Ball 3D Localization From A Single Calibrated Imagecited by 17
- 2024AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movementscited by 15
- 2023Towards Active Learning for Action Spotting in Association Football Videoscited by 14
- 2024Hierarchical NeuroSymbolic Approach for Comprehensive and Explainable Action Quality Assessmentcited by 14
- 2022FenceNet: Fine-grained Footwork Recognition in Fencingcited by 12
- 2024Table tennis ball spin estimation with an event cameracited by 11
- 2023Automatic Edge Error Judgment in Figure Skating Using 3D Pose Estimation from a Monocular Camera and IMUscited by 6
Built on by
Citing papers per year: 2025: 5; 2026: 2.
7 papers.
- 2025AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movementscited by 14
- 2025AthleticsPose: Authentic Sports Motion Dataset on Athletic Field and Evaluation of Monocular 3D Pose Estimation Abilitycited by 6
- 2025KASportsFormer: Kinematic Anatomy Enhanced Transformer for 3D Human Pose Estimation on Short Sports Scene Videocited by 0
- 2025VIFSS: View-Invariant and Figure Skating-Specific Pose Representation Learning for Temporal Action Segmentationcited by 0
- 2025Avatar4D: Synthesizing Domain-Specific 4D Humans for Real-World Pose Estimationcited by 0
- 2026Spectral Scalpel: Amplifying Adjacent Action Discrepancy via Frequency-Selective Filtering for Skeleton-Based Action Segmentationcited by 0
- 2026Wiring diagram extraction and gluing: a case study in classifying figure skating jumps using 3D datasetcited by 0
- 2026Wiring diagram extraction and gluing: a case study in classifying figure skating jumps using 3D dataset30 Jul 2026
- 2026Spectral Scalpel: Amplifying Adjacent Action Discrepancy via Frequency-Selective Filtering for Skeleton-Based Action Segmentation25 Mar 2026
- 2025Avatar4D: Synthesizing Domain-Specific 4D Humans for Real-World Pose Estimation18 Dec 2025
- 2025VIFSS: View-Invariant and Figure Skating-Specific Pose Representation Learning for Temporal Action Segmentation14 Aug 2025
- 2025KASportsFormer: Kinematic Anatomy Enhanced Transformer for 3D Human Pose Estimation on Short Sports Scene Video28 Jul 2025
- 2025AthleticsPose: Authentic Sports Motion Dataset on Athletic Field and Evaluation of Monocular 3D Pose Estimation Ability17 Jul 2025
- 2025AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movements10 Mar 2025