# Captivate! Contextual Language Guidance for Parent-Child Interaction

arXiv: https://arxiv.org/abs/2202.06806 · HTML: https://mlsanity.com/paper/2202.06806/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Feb 2022.

## Built on by (most cited first, 3 of 3)

- [AACessTalk: Fostering Communication between Minimally Verbal Autistic Children and Parents with Contextual Guidance and Card Recommendation](https://mlsanity.com/paper/2409.09641/) (2024)
- [Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network](https://mlsanity.com/paper/2407.01645/) (2024)
- [Towards Aligning Multimodal LLMs with Human Experts: A Focus on Parent-Child Interaction](https://mlsanity.com/paper/2511.04366/) (2025)

## Abstract (arXiv)

To acquire language, children need rich language input. However, many parents find it difficult to provide children with sufficient language input, which risks delaying their language development. To aid these parents, we design Captivate!, the first system that provides contextual language guidance to parents during play. Our system tracks both visual and spoken language cues to infer targets of joint attention, enabling the real-time suggestion of situation-relevant phrases for the parent. We design our system through a user-centered process with immigrant families--a highly vulnerable yet understudied population--as well as professional speech language therapists. Next, we evaluate Captivate! on parents with children aged 1-3 to observe improvements in responsive language use. We share insights into developing contextual guidance technology for linguistically diverse families.