# REsCUE: A framework for REal-time feedback on behavioral CUEs using multimodal anomaly detection

arXiv: https://arxiv.org/abs/1903.11485 · HTML: https://mlsanity.com/paper/1903.11485/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 27 Mar 2019.

## Built on by (most cited first, 7 of 7)

- [PrISM-Observer: Intervention Agent to Help Users Perform Everyday Procedures Sensed using a Smartwatch](https://mlsanity.com/paper/2407.16785/) (2024)
- [Coaching Copilot: Blended Form of an LLM-Powered Chatbot and a Human Coach to Effectively Support Self-Reflection for Leadership Growth](https://mlsanity.com/paper/2405.15250/) (2024)
- [HardVis: Visual Analytics to Handle Instance Hardness Using Undersampling and Oversampling Techniques](https://mlsanity.com/paper/2203.15753/) (2022)
- [AI for human assessment: What do professional assessors need?](https://mlsanity.com/paper/2204.08471/) (2022)
- [Supporting Experts with a Multimodal Machine-Learning-Based Tool for Human Behavior Analysis of Conversational Videos](https://mlsanity.com/paper/2402.11145/) (2024)
- [Human-AI communication for human-human communication: Applying interpretable unsupervised anomaly detection to executive coaching](https://mlsanity.com/paper/2206.10987/) (2022)
- [DISCOVER: A Data-driven Interactive System for Comprehensive Observation, Visualization, and ExploRation of Human Behaviour](https://mlsanity.com/paper/2407.13408/) (2024)

## Abstract (arXiv)

Executive coaching has been drawing more and more attention for developing corporate managers. While conversing with managers, coach practitioners are also required to understand internal states of coachees through objective observations. In this paper, we present REsCUE, an automated system to aid coach practitioners in detecting unconscious behaviors of their clients. Using an unsupervised anomaly detection algorithm applied to multimodal behavior data such as the subject's posture and gaze, REsCUE notifies behavioral cues for coaches via intuitive and interpretive feedback in real-time. Our evaluation with actual coaching scenes confirms that REsCUE provides the informative cues to understand internal states of coachees. Since REsCUE is based on the unsupervised method and does not assume any prior knowledge, further applications beside executive coaching are conceivable using our framework.