mlsanityData to 14 Oct 2026

Context-Aware Personality Inference in Dyadic Scenarios: Introducing the UDIVA Dataset

arXiv 2012.14259 ↗First posted 28 Dec 2020cs.CV cs.AI cs.LGcited by 31

Not on the map. Why?

Abstract (arXiv)

This paper introduces UDIVA, a new non-acted dataset of face-to-face dyadic interactions, where interlocutors perform competitive and collaborative tasks with different behavior elicitation and cognitive workload. The dataset consists of 90.5 hours of dyadic interactions among 147 participants distributed in 188 sessions, recorded using multiple audiovisual and physiological sensors. Currently, it includes sociodemographic, self- and peer-reported personality, internal state, and relationship profiling from participants. As an initial analysis on UDIVA, we propose a transformer-based method for self-reported personality inference in dyadic scenarios, which uses audiovisual data and different sources of context from both interlocutors to regress a target person's personality traits. Preliminary results from an incremental study show consistent improvements when using all available context information.

Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 4; 2022: 7; 2023: 4; 2024: 4; 2025: 8; 2026: 4.

31 papers.

Sort:

By area:

  1. 2022Bodily Behaviors in Social Interaction: Novel Annotations and State-of-the-Art Evaluationcited by 19
  2. 2023ReactFace: Online Multiple Appropriate Facial Reaction Generation in Dyadic Interactionscited by 17
  3. 2021Dyadformer: A Multi-modal Transformer for Long-Range Modeling of Dyadic Interactionscited by 16
  4. 2023Multiple Appropriate Facial Reaction Generation in Dyadic Interaction Settings: What, Why and How?cited by 16
  5. 2024REACT 2024: the Second Multiple Appropriate Facial Reaction Generation Challengecited by 16
  6. 2024Beyond Talking -- Generating Holistic 3D Human Dyadic Motion for Communicationcited by 14
  7. 2022An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognitioncited by 12
  8. 2023Reversible Graph Neural Network-based Reaction Distribution Learning for Multiple Appropriate Facial Reactions Generationcited by 11
  9. 2025REACT 2025: the Third Multiple Appropriate Facial Reaction Generation Challengecited by 9
  10. 2022Comparison of Spatio-Temporal Models for Human Motion and Pose Forecasting in Face-to-Face Interaction Scenarioscited by 8
  11. 2024Revealing Personality Traits: A New Benchmark Dataset for Explainable Personality Recognition on Dialoguescited by 7
  12. 2022Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Surveycited by 6
19 more
  1. 2021Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognitioncited by 5
  2. 2021Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encodingcited by 5
  3. 2023REACT2023: the first Multi-modal Multiple Appropriate Facial Reaction Generation Challengecited by 5
  4. 2025OmniResponse: Online Multimodal Conversational Response Generation in Dyadic Interactionscited by 5
  5. 2022Multimodal Vision Transformers with Forced Attention for Behavior Analysiscited by 3
  6. 2022Joint Engagement Classification using Video Augmentation Techniques for Multi-person Human-robot Interactioncited by 2
  7. 2021Forecasting Nonverbal Social Signals during Dyadic Interactions with Generative Adversarial Neural Networkscited by 1
  8. 2022Perceived personality state estimation in dyadic and small group interaction with deep learning methodscited by 1
  9. 2025Efficient Listener: Dyadic Facial Motion Synthesis via Action Diffusioncited by 1
  10. 2025Traits Run Deep: Enhancing Personality Assessment via Psychology-Guided LLM Representations and Multimodal Apparent Behaviorscited by 1
  11. 2026Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?cited by 1
  12. 2024QUB-PHEO: A Visual-Based Dyadic Multi-View Dataset for Intention Inference in Collaborative Assemblycited by 0
  13. 2025CM3T: Framework for Efficient Multimodal Learning for Inhomogeneous Interaction Datasetscited by 0
  14. 2025CloSE: A Geometric Shape-Agnostic Cloth State Representationcited by 0
  15. 2025Learning Personalised Human Internal Cognition from External Expressive Behaviours for Real Personality Recognitioncited by 0
  16. 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniquescited by 0
  17. 2026Enhancing Personality Recognition by Comparing the Predictive Power of Traits, Facets, and Nuancescited by 0
  18. 2026GroupAffect-4: A Multimodal Dataset of Four-Person Collaborative Interactioncited by 0
  19. 2026FriendBench: Benchmarking Dyadic Familiarity Inference in Humans and Multimodal Large Language Modelscited by 0