Cognitive-Motor Integration in Assessing Bimanual Motor Skills
Not on the map. Why?
Abstract (arXiv)
Accurate assessment of bimanual motor skills is essential across various professions, yet, traditional methods often rely on subjective assessments or focus solely on motor actions, overlooking the integral role of cognitive processes. This study introduces a novel approach by leveraging deep neural networks (DNNs) to analyze and integrate both cognitive decision-making and motor execution. We tested this methodology by assessing laparoscopic surgery skills within the Fundamentals of Laparoscopic Surgery program, which is a prerequisite for general surgery certification. Utilizing video capture of motor actions and non-invasive functional near-infrared spectroscopy (fNIRS) for measuring neural activations, our approach precisely classifies subjects by expertise level and predicts FLS behavioral performance scores, significantly surpassing traditional single-modality assessments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 62 references that are in the map. First posted on arXiv 16 Apr 2024.
Builds on
18 of 62 references.
References · 18
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2017Mask R-CNNcited by 7,259
- 2013Network In Networkcited by 600
- 2018Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networkscited by 120
- 2019Video-based surgical skill assessment using 3D convolutional neural networkscited by 57
- 2018Tool Detection and Operative Skill Assessment in Surgical Videos Using Region-Based Convolutional Neural Networkscited by 56
- 2020Detection and Localization of Robotic Tools in Robot-Assisted Surgery Videos Using Deep Neural Networks for Region Proposal and Detectioncited by 22
- 2018Evaluating surgical skills from kinematic data using convolutional neural networkscited by 19
- 2020How Much Can We Really Trust You? Towards Simple, Interpretable Trust Quantification Metrics for Deep Neural Networkscited by 19
- 2019Accurate and interpretable evaluation of surgical skills from kinematic data using fully convolutional neural networkscited by 18
- 2022Deep Learning in fNIRS: A reviewcited by 12
- 2021Deep Neural Networks for the Assessment of Surgical Skills: A Systematic Reviewcited by 9
6 more
- 2022Video-based Formative and Summative Assessment of Surgical Tasks using Deep Learningcited by 8
- 2020Where Does Trust Break Down? A Quantitative Trust Analysis of Deep Neural Networks via Trust Matrix and Conditional Trust Densitiescited by 7
- 2018Joint Surgical Gesture and Task Classification with Multi-Task and Multimodal Learningcited by 5
- 2017Who's Better? Who's Best? Pairwise Deep Ranking for Skill Determinationcited by 4
- 2019Knowledge-based Analysis for Mortality Prediction from CT Imagescited by 4
- 2022One-shot skill assessment in high-stakes domains with limited data via meta learningcited by 4
Built on by
Not cited yet.