# Context-Aware Personality Inference in Dyadic Scenarios: Introducing the UDIVA Dataset

arXiv: https://arxiv.org/abs/2012.14259 · HTML: https://mlsanity.com/paper/2012.14259/

## Key facts

- Cited by 31 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 28 Dec 2020.

## Built on by (most cited first, 30 of 31)

- [Bodily Behaviors in Social Interaction: Novel Annotations and State-of-the-Art Evaluation](https://mlsanity.com/paper/2207.12817/) (2022)
- [ReactFace: Online Multiple Appropriate Facial Reaction Generation in Dyadic Interactions](https://mlsanity.com/paper/2305.15748/) (2023)
- [Dyadformer: A Multi-modal Transformer for Long-Range Modeling of Dyadic Interactions](https://mlsanity.com/paper/2109.09487/) (2021)
- [Multiple Appropriate Facial Reaction Generation in Dyadic Interaction Settings: What, Why and How?](https://mlsanity.com/paper/2302.06514/) (2023)
- [REACT 2024: the Second Multiple Appropriate Facial Reaction Generation Challenge](https://mlsanity.com/paper/2401.05166/) (2024)
- [Beyond Talking -- Generating Holistic 3D Human Dyadic Motion for Communication](https://mlsanity.com/paper/2403.19467/) (2024)
- [An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognition](https://mlsanity.com/paper/2210.09138/) (2022)
- [Reversible Graph Neural Network-based Reaction Distribution Learning for Multiple Appropriate Facial Reactions Generation](https://mlsanity.com/paper/2305.15270/) (2023)
- [REACT 2025: the Third Multiple Appropriate Facial Reaction Generation Challenge](https://mlsanity.com/paper/2505.17223/) (2025)
- [Comparison of Spatio-Temporal Models for Human Motion and Pose Forecasting in Face-to-Face Interaction Scenarios](https://mlsanity.com/paper/2203.03245/) (2022)
- [Revealing Personality Traits: A New Benchmark Dataset for Explainable Personality Recognition on Dialogues](https://mlsanity.com/paper/2409.19723/) (2024)
- [Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey](https://mlsanity.com/paper/2207.10574/) (2022)
- [Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognition](https://mlsanity.com/paper/2110.13570/) (2021)
- [Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encoding](https://mlsanity.com/paper/2112.12180/) (2021)
- [REACT2023: the first Multi-modal Multiple Appropriate Facial Reaction Generation Challenge](https://mlsanity.com/paper/2306.06583/) (2023)
- [OmniResponse: Online Multimodal Conversational Response Generation in Dyadic Interactions](https://mlsanity.com/paper/2505.21724/) (2025)
- [Multimodal Vision Transformers with Forced Attention for Behavior Analysis](https://mlsanity.com/paper/2212.03968/) (2022)
- [Joint Engagement Classification using Video Augmentation Techniques for Multi-person Human-robot Interaction](https://mlsanity.com/paper/2212.14128/) (2022)
- [Forecasting Nonverbal Social Signals during Dyadic Interactions with Generative Adversarial Neural Networks](https://mlsanity.com/paper/2110.09378/) (2021)
- [Perceived personality state estimation in dyadic and small group interaction with deep learning methods](https://mlsanity.com/paper/2211.04979/) (2022)
- [Efficient Listener: Dyadic Facial Motion Synthesis via Action Diffusion](https://mlsanity.com/paper/2504.20685/) (2025)
- [Traits Run Deep: Enhancing Personality Assessment via Psychology-Guided LLM Representations and Multimodal Apparent Behaviors](https://mlsanity.com/paper/2507.22367/) (2025)
- [Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?](https://mlsanity.com/paper/2605.22109/) (2026)
- [QUB-PHEO: A Visual-Based Dyadic Multi-View Dataset for Intention Inference in Collaborative Assembly](https://mlsanity.com/paper/2409.15560/) (2024)
- [CM3T: Framework for Efficient Multimodal Learning for Inhomogeneous Interaction Datasets](https://mlsanity.com/paper/2501.03332/) (2025)
- [CloSE: A Geometric Shape-Agnostic Cloth State Representation](https://mlsanity.com/paper/2504.05033/) (2025)
- [Learning Personalised Human Internal Cognition from External Expressive Behaviours for Real Personality Recognition](https://mlsanity.com/paper/2508.00205/) (2025)
- [A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques](https://mlsanity.com/paper/2512.09005/) (2025)
- [Enhancing Personality Recognition by Comparing the Predictive Power of Traits, Facets, and Nuances](https://mlsanity.com/paper/2602.05650/) (2026)
- [GroupAffect-4: A Multimodal Dataset of Four-Person Collaborative Interaction](https://mlsanity.com/paper/2605.19765/) (2026)

## Abstract (arXiv)

This paper introduces UDIVA, a new non-acted dataset of face-to-face dyadic interactions, where interlocutors perform competitive and collaborative tasks with different behavior elicitation and cognitive workload. The dataset consists of 90.5 hours of dyadic interactions among 147 participants distributed in 188 sessions, recorded using multiple audiovisual and physiological sensors. Currently, it includes sociodemographic, self- and peer-reported personality, internal state, and relationship profiling from participants. As an initial analysis on UDIVA, we propose a transformer-based method for self-reported personality inference in dyadic scenarios, which uses audiovisual data and different sources of context from both interlocutors to regress a target person's personality traits. Preliminary results from an incremental study show consistent improvements when using all available context information.