TaiChi Action Capture and Performance Analysis with Multi-view RGB Cameras
Not on the map. Why?
Abstract (arXiv)
Recent advances in computer vision and deep learning have influenced the field of sports performance analysis for researchers to track and reconstruct freely moving humans without any marker attachment. However, there are few works for vision-based motion capture and intelligent analysis for professional TaiChi movement. In this paper, we propose a framework for TaiChi performance capture and analysis with multi-view geometry and artificial intelligence technology. The main innovative work is as follows: 1) A multi-camera system suitable for TaiChi motion capture is built and the multi-view TaiChi data is collected and processed; 2) A combination of traditional visual method and implicit neural radiance field is proposed to achieve sparse 3D skeleton fusion and dense 3D surface reconstruction. 3) The normalization modeling of movement sequences is carried out based on motion transfer, so as to realize TaiChi performance analysis for different groups. We have carried out evaluation experiments, and the experimental results have shown the efficiency of our method.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 26 Jun 2023.
Builds on
20 of 36 references.
References · 20
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2017Learning Spatio-Temporal Representation with Pseudo-3D Residual Networkscited by 386
- 2021Revisiting Skeleton-based Action Recognitioncited by 256
- 2020FineGym: A Hierarchical Video Dataset for Fine-grained Action Understandingcited by 232
- 2022FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessmentcited by 106
- 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
- 2018Action Quality Assessment Across Multiple Actionscited by 78
8 more
- 2021DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Camerascited by 67
- 2021SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videoscited by 40
- 2020TransMoMo: Invariance-Driven Unsupervised Video Motion Retargetingcited by 36
- 2020Motion Capture from Internet Videoscited by 33
- 2020Yoga-82: A New Dataset for Fine-grained Classification of Human Posescited by 25
- 2022Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessmentcited by 25
- 2019GolfDB: A Video Database for Golf Swing Sequencingcited by 21
- 2021Unsupervised 3D Pose Estimation for Hierarchical Dance Video Recognitioncited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.