# AffectAI-Capture: A Reproducible Multimodal Protocol for Small-Group Meeting Research

arXiv: https://arxiv.org/abs/2605.19794 · HTML: https://mlsanity.com/paper/2605.19794/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 27 references that are in the map.
- First posted on arXiv 19 May 2026.

## Builds on (most cited first, 5 of 5)

- [K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations](https://mlsanity.com/paper/2005.04120/) (2020)
- [Advancing Face-to-Face Emotion Communication: A Multimodal Dataset (AFFEC)](https://mlsanity.com/paper/2504.18969/) (2025)
- [MuMTAffect: A Multimodal Multitask Affective Framework for Personality and Emotion Recognition from Physiological Signals](https://mlsanity.com/paper/2509.04254/) (2025)
- [Modeling Face Emotion Perception from Naturalistic Face Viewing: Insights from Fixational Events and Gaze Strategies](https://mlsanity.com/paper/2503.15926/) (2025)
- [Modelling Emotions in Face-to-Face Setting: The Interplay of Eye-Tracking, Personality, and Temporal Dynamics](https://mlsanity.com/paper/2503.16532/) (2025)

## Built on by (most cited first, 1 of 1)

- [Pseudo-Label Augmentation for Affect Sensing in Small Collaborative Groups](https://mlsanity.com/paper/2609.16077/) (2026)

## Abstract (arXiv)

We present AffectAI-Capture, a protocol for collecting synchronized multimodal data in four-person meeting-like interactions, combining eye tracking, wearable physiology, close-talk and room audio, multi-view video, event logging, and structured self-report. Sessions use fixed task blocks grounded in established group-interaction paradigms, while acquisition and post-processing are organized around a single authoritative event timeline and standardized outputs. We describe the experimental rationale, synchronization philosophy, data organization, and practical trade-offs. Pilot-level validation of audio quality and video synchronization has been conducted using controlled bench tests; full protocol sessions with participants remain ongoing work. The contribution is a reproducible protocol architecture linking task design, instrumentation, timing provenance, and data packaging for affective, behavioral, and meeting-analytics research.
