mlsanityData to 7 Oct 2026

Human-Inspired Social Engagement Analysis via Interpretable Mutual Visual Attention

arXiv 2608.24580 ↗First posted 25 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding social interactions from non-verbal visual data is important for behavior analysis and activity monitoring. We propose an interpretable computational model of social engagement inspired by psychological theories of mutual visual attention. Rather than learning interaction patterns end-to-end, our framework explicitly models dyadic visual attention and aggregates these cues into interpretable measures of individual and group engagement. The resulting modular framework combines state-of-the-art head orientation estimation with lightweight geometric reasoning, producing explanations that remain accessible to non-technical users. We evaluate the proposed approach on a variety of data through quantitative experiments and demonstrate its practical usefulness with qualitative visualizations designed to support teachers, caregivers, and social workers in understanding group interaction dynamics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 38 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

10 of 38 references.

References · 10

  1. 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 118
  2. 2019Towards Social Artificial Intelligence: Nonverbal Social Signal Prediction in A Triadic Interactioncited by 48
  3. 2014F-formation Detection: Individuating Free-standing Conversational Groups in Imagescited by 16
  4. 2021HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertaintycited by 9
  5. 2022Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Surveycited by 6
  6. 2022MGTR: End-to-End Mutual Gaze Detection with Transformercited by 3
  7. 2025Learning in Focus: Detecting Behavioral and Collaborative Engagement Using Vision Transformerscited by 3
  8. 2023Social Visual Behavior Analytics for Autism Therapy of Children Based on Automated Mutual Gaze Detectioncited by 2
  9. 2025ViBED-Net: Video Based Engagement Detection Network Using Face-Aware and Scene-Aware Spatiotemporal Cuescited by 2
  10. 2024Modeling social interaction dynamics using temporal graph networkscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Social AI: A Survey on Understanding Social Interactions
  2. 2025SIV-Bench: A Video Benchmark for Social Interaction Understanding and Reasoning
  3. 2026GRASP: Learning to Ground Social Reasoning in Multi-Person Non-Verbal Interactions
  4. 2025R^3-VQA: "Read the Room" by Video Social Reasoning
  5. 2025SoMi-ToM: Evaluating Multi-Perspective Theory of Mind in Embodied Social Interactions
  6. 2026Eyes on VLM: Benchmarking Gaze Following and Social Gaze Prediction in Vision Language Models
  7. 2025Human Behavior Atlas: Benchmarking Unified Psychological and Social Behavior Understanding
  8. 2025Using Vision-Language Models as Proxies for Social Intelligence in Human-Robot Interaction