An Interpretable Closed-Loop Intelligent Tutoring System for Multimodal Affective Feedback in Asynchronous Presentation Training
Not on the map. Why?
Abstract (arXiv)
This paper presents an interpretable closed-loop Intelligent Tutoring System (ITS) that supports feedback-guided practice for developing on-camera oral presentation skills at scale. The system operationalizes a seven-dimensional Behaviorally Anchored Rating Scale (BARS) and implements a three-layer interpretable feedback architecture that connects rubric-aligned multimodal scoring, audience-perceived expressive diagnostics, and retrieval-augmented conversational coaching to support deliberate practice. Built on an XGBoost backbone, the ITS maps multimodal inputs (facial, vocal, textual, and oculomotor features) into evidence-based feedback that can be traced back to observable performance cues. Trained on 10,360 Massive Open Online Course (MOOC) video segments, the system achieved rubric-aligned scoring with performance levels comparable to expert ratings (R2 = 0.48-0.61, Spearman's rho = 0.69-0.78, MAE = 0.43-0.57). In a pre-post validation study with 204 adult learners over a 30-day practice window, participants demonstrated significant improvements across all seven BARS dimensions (Cohen's d = 0.39-0.90), with practice frequency showing a strong positive association with posttest performance after controlling for baseline scores and demographics. The results demonstrate how multimodal analytic outputs can be systematically transformed into observable behavioral change through an integrated feedback architecture, advancing explainable and pedagogically grounded ITS design for performance-based competencies.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 55 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
7 of 55 references.
References · 7
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2021Automatic Gaze Analysis: A Survey of Deep Learning based Approachescited by 33
- 2022Adapting and Evaluating Influence-Estimation Methods for Gradient-Boosted Decision Treescited by 16
- 2024Comparing the Pearson and Spearman Correlation Coefficients Across Distributions and Sample Sizes: A Tutorial Using Simulations and Empirical Datacited by 16
- 2023Learning Through AI-Clones: Enhancing Self-Perception and Presentation Performancecited by 4
- 2023Heuristics for Supporting Cooperative Dashboard Designcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Micro-level AI Feedback Features and Student Responses in Consecutive LLM Tutoring Interactions ↗
- 2026TutorLoop: Regulating Student Learning Behaviors via Sensor-in-the-Loop Generative Feedback
- 2025Exploring Automated Recognition of Instructional Activity and Discourse from Multimodal Classroom Data
- 2025Enhancing tutoring systems by leveraging tailored promptings and domain knowledge with Large Language Models
- 2025Integrating emotional intelligence, memory architecture, and gestures to achieve empathetic humanoid robot interaction in an educational setting
- 2025Toward Automated Qualitative Analysis: Leveraging Large Language Models for Tutoring Dialogue Evaluation
- 2025SlideItRight: Using AI to Find Relevant Slides and Provide Feedback for Open-Ended Questions
- 2026PIVOT: Preference-based Intervention Vectors for Pedagogical Tutor Steering