mlsanityData to 14 Oct 2026

A Point Cloud Transformer for Remote Monitoring and Automated Assessment of Physical Rehabilitation Exercises

arXiv 2606.30309 ↗First posted 29 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Rehabilitation exercises are essential in restoring lost physical functions of patients suffering from various diseases (e.g., Parkinson's, back pain). Carrying out these rehabilitation exercises, often prescribed by health experts, is costly, unavailable, and requires expert supervision. The availability of RGBD images and movement/position data of joints along with expert annotation of exercise data has prompted the use of automatic assessment of the quality of rehabilitation exercises, which is cost-effective and can be carried out at home. However, existing approaches do not extract relevant features, lack practical application, require expensive pre-processing, or overlook crucial features. This study proposes a transformer-based framework for point clouds to extract features and assess rehabilitation exercises by analyzing joint positions collected through RGBD data. We adapt and utilize a curve-based point-cloud feature aggregation technique to augment point-cloud information that aids model output. The transformer architecture also uses axial self-attention, recognizing important joints and their roles to assist users in performing the exercise better. The guided system outperforms existing approaches and is also practically relevant due to its small size, fast inference, and generalization on specific joints in similar exercises. We conduct our experiments on three crucial baseline datasets for rehabilitation exercises: Kimore, UI-PRMD, and IRDS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 74 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

30 of 74 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  5. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  6. 2017Non-local Neural Networkscited by 2,293
  7. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  8. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  9. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  10. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 686
  11. 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 585
  12. 2019Graph U-Netscited by 492
18 more
  1. 2019Axial Attention in Multidimensional Transformerscited by 358
  2. 2020Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentationcited by 326
  3. 2020PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Samplingcited by 239
  4. 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
  5. 2021Walk in the Cloud: Learning Curves for Point Clouds Shape Analysiscited by 172
  6. 2019Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognitioncited by 135
  7. 2019Skeleton-Based Action Recognition with Multi-Stream Adaptive Graph Convolutional Networkscited by 103
  8. 2018View Adaptive Neural Networks for High Performance Skeleton-based Human Action Recognitioncited by 84
  9. 2019An Alternative Probabilistic Interpretation of the Huber Losscited by 43
  10. 2021When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarkscited by 41
  11. 2020Richly Activated Graph Convolutional Network for Robust Skeleton-based Action Recognitioncited by 36
  12. 2019A Deep Learning Framework for Assessing Physical Rehabilitation Exercisescited by 26
  13. 2016Space-Time Representation of People Based on 3D Skeletal Data: A Reviewcited by 24
  14. 2016Transition Forests: Learning Discriminative Temporal Transitions for Action Recognition and Detectioncited by 18
  15. 2023D-STGCNT: A Dense Spatio-Temporal Graph Conv-GRU Network based on transformer for assessment of patient physical rehabilitationcited by 9
  16. 2018Shoulder Physiotherapy Exercise Recognition: Machine Learning the Inertial Signals from a Smartwatchcited by 5
  17. 2023MR-STGN: Multi-Residual Spatio Temporal Graph Network Using Attention Fusion for Patient Action Assessmentcited by 5
  18. 2022Less is More: Facial Landmarks can Recognize a Spontaneous Smilecited by 3

Built on by

Not cited yet.