Automated Procedural Analysis via Video-Language Models for AI-assisted Nursing Skills Assessment
Not on the map. Why?
Abstract (arXiv)
Consistent high-quality nursing care is essential for patient safety, yet current nursing education depends on subjective, time-intensive instructor feedback in training future nurses, which limits scalability and efficiency in their training, and thus hampers nursing competency when they enter the workforce. In this paper, we introduce a video-language model (VLM) based framework to develop the AI capability of automated procedural assessment and feedback for nursing skills training, with the potential of being integrated into existing training programs. Mimicking human skill acquisition, the framework follows a curriculum-inspired progression, advancing from high-level action recognition, fine-grained subaction decomposition, and ultimately to procedural reasoning. This design supports scalable evaluation by reducing instructor workload while preserving assessment quality. The system provides three core capabilities: 1) diagnosing errors by identifying missing or incorrect subactions in nursing skill instruction videos, 2) generating explainable feedback by clarifying why a step is out of order or omitted, and 3) enabling objective, consistent formative evaluation of procedures. Validation on synthesized videos demonstrates reliable error detection and temporal localization, confirming its potential to handle real-world training variability. By addressing workflow bottlenecks and supporting large-scale, standardized evaluation, this work advances AI applications in nursing education, contributing to stronger workforce development and ultimately safer patient care.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 47 references that are in the map. First posted on arXiv 20 Sep 2025.
Builds on
15 of 47 references.
References · 15
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2024Large Language Models: A Surveycited by 525
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2024LongVLM: Efficient Long Video Understanding via Large Language Modelscited by 147
- 2024LITA: Language Instructed Temporal-Localization Assistantcited by 125
- 2024Apollo: An Exploration of Video Understanding in Large Multimodal Modelscited by 89
- 2024VLM See, Robot Do: Human Demo Video to Robot Action Plan via Vision Language Modelcited by 37
- 2023A Systematic Review of Few-Shot Learning in Medical Imagingcited by 28
- 2024ExpertAF: Expert Actionable Feedback from Videocited by 17
- 2024ReWind: Understanding Long Videos with Instructed Learnable Memorycited by 17
3 more
- 2025Survey on Hand Gesture Recognition from Visual Inputcited by 10
- 2024Language Model Guided Interpretable Video Action Reasoningcited by 8
- 2024TemporalVLM: Video LLMs for Temporal Reasoning in Long Videoscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AI-Assisted Competency Assessment from Egocentric Video in Simulation-Based Nursing Education
- 2026SiMing-Bench: Evaluating Procedural Correctness from Continuous Interactions in Clinical Skill Videos
- 2025MedSimAI: Simulation and Formative Feedback Generation to Enhance Deliberate Practice in Medical Education
- 2026A Multi-Agent LLM Framework for Rating the Quality of Surgical Feedback
- 2026A Unified XAI-LLM Approach for EndotrachealSuctioning Activity Recognition
- 2026CodeClinic: Evaluating Automation of Coding Skills for Clinical Reasoning Agents
- 2026The Unreasonable Effectiveness of VLMs for Zero-shot Procedural Mistake Detection
- 2025A Multi-faceted Analysis of Cognitive Abilities: Evaluating Prompt Methods with Large Language Models on the CONSORT Checklist