mlsanityData to 7 Oct 2026

Piano Skills Assessment

arXiv 2101.04884 ↗First posted 13 Jan 2021cs.CV cs.LG cs.MMcited by 16

Not on the map. Why?

Abstract (arXiv)

Can a computer determine a piano player's skill level? Is it preferable to base this assessment on visual analysis of the player's performance or should we trust our ears over our eyes? Since current CNNs have difficulty processing long video videos, how can shorter clips be sampled to best reflect the players skill level? In this work, we collect and release a first-of-its-kind dataset for multimodal skill assessment focusing on assessing piano player's skill level, answer the asked questions, initiate work in automated evaluation of piano playing skills and provide baselines for future work. Dataset is available from: https://github.com/ParitoshParmar/Piano-Skills-Assessment.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 20 of its 61 references that are in the map. First posted on arXiv 13 Jan 2021.

Builds on

20 of 61 references.

References · 20

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
  5. 2016Learning To Score Olympic Eventscited by 87
  6. 2020Foley Music: Learning to Generate Music from Videoscited by 82
  7. 2020Uncertainty-aware Score Distribution Learning for Action Quality Assessmentcited by 80
  8. 2018Action Quality Assessment Across Multiple Actionscited by 78
  9. 2018Learning to score the figure skating sports videoscited by 72
  10. 2018The Pros and Cons: Rank-aware Temporal Attention for Skill Determination in Long Videoscited by 68
  11. 2016Creating A Multi-track Classical Musical Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applicationscited by 60
  12. 2020Audeo: Audio Generation for a Silent Performance Videocited by 47
8 more
  1. 2019Manipulation-skill Assessment from Videos with Spatial Attention Networkcited by 29
  2. 2016Measuring the Quality of Exercisescited by 17
  3. 2020Action Quality Assessment using Siamese Network-Based Deep Metric Learningcited by 12
  4. 2020VI-Net: View-Invariant Quality of Human Movement Assessmentcited by 8
  5. 2019HalluciNet-ing Spatiotemporal Representations Using a 2D-CNNcited by 2
  6. 2019Virtual Piano using Computer Visioncited by 1
  7. 2020Modeling User Behaviors in Machine Operation Tasks for Adaptive Guidancecited by 1
  8. 2020A Multi-Task Learning Approach for Human Activity Segmentation and Ergonomics Risk Assessmentcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 4; 2025: 5; 2026: 3.

16 papers.

Sort:

  1. 2022Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessmentcited by 25
  2. 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmarkcited by 20
  3. 2023PECoP: Parameter Efficient Continual Pretraining for Action Quality Assessmentcited by 19
  4. 2024ExpertAF: Expert Actionable Feedback from Videocited by 17
  5. 2022Uncertainty-Driven Action Quality Assessmentcited by 7
  6. 2025A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directionscited by 7
  7. 2024TechCoach: Towards Technical-Point-Aware Descriptive Action Coachingcited by 6
  8. 2021Win-Fail Action Recognitioncited by 4
  9. 2025SkillSight: Efficient First-Person Skill Assessment with Gazecited by 4
  10. 2025FineCausal: A Causal-Based Framework for Interpretable Fine-Grained Action Quality Assessmentcited by 3
  11. 2025FLEX: A Largescale Multimodal, Multiview Dataset for Learning Structured Representations for Fitness Action Quality Assessmentcited by 1
  12. 2024Siamese Residual Neural Network for Musical Shape Evaluation in Piano Performance Assessmentcited by 0
4 more
  1. 2025Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotationcited by 0
  2. 2026ProSkill: Segment-Level Skill Assessment in Procedural Videoscited by 0
  3. 2026Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessmentcited by 0
  4. 2026MyoMechanix: Biomechanically-Grounded Compositional Skilled Activity Understanding and Coachingcited by 0