# Bi-modal First Impressions Recognition using Temporally Ordered Deep Audio and Stochastic Visual Features

arXiv: https://arxiv.org/abs/1610.10048 · HTML: https://mlsanity.com/paper/1610.10048/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 31 Oct 2016.

## Built on by (most cited first, 13 of 13)

- [SVFAP: Self-supervised Video Facial Affect Perceiver](https://mlsanity.com/paper/2401.00416/) (2023)
- [An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognition](https://mlsanity.com/paper/2210.09138/) (2022)
- [Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognition](https://mlsanity.com/paper/2110.13570/) (2021)
- [Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encoding](https://mlsanity.com/paper/2112.12180/) (2021)
- [Multimodal Vision Transformers with Forced Attention for Behavior Analysis](https://mlsanity.com/paper/2212.03968/) (2022)
- [To Whom are You Talking? A Deep Learning Model to Endow Social Robots with Addressee Estimation Skills](https://mlsanity.com/paper/2308.10757/) (2023)
- [Graph-Driven Multimodal Feature Learning Framework for Apparent Personality Assessment](https://mlsanity.com/paper/2504.11515/) (2025)
- [Domain-specific Learning of Multi-scale Facial Dynamics for Apparent Personality Traits Prediction](https://mlsanity.com/paper/2209.04148/) (2022)
- [Personality Analysis from Online Short Video Platforms with Multi-domain Adaptation](https://mlsanity.com/paper/2411.00813/) (2024)
- [GAME: Learning Multimodal Interactions via Graph Structures for Personality Trait Estimation](https://mlsanity.com/paper/2505.03846/) (2025)
- [Traits Run Deep: Enhancing Personality Assessment via Psychology-Guided LLM Representations and Multimodal Apparent Behaviors](https://mlsanity.com/paper/2507.22367/) (2025)
- [PhoenixNest-Video: Evidence-Grounded Multimodal Agent Framework for Automated Video Interview Assessment](https://mlsanity.com/paper/2609.02231/) (2026)
- [Debiased Multimodal Personality Understanding through Dual Causal Intervention](https://mlsanity.com/paper/2605.06371/) (2026)

## Abstract (arXiv)

We propose a novel approach for First Impressions Recognition in terms of the Big Five personality-traits from short videos. The Big Five personality traits is a model to describe human personality using five broad categories: Extraversion, Agreeableness, Conscientiousness, Neuroticism and Openness. We train two bi-modal end-to-end deep neural network architectures using temporally ordered audio and novel stochastic visual features from few frames, without over-fitting. We empirically show that the trained models perform exceptionally well, even after training from a small sub-portions of inputs. Our method is evaluated in ChaLearn LAP 2016 Apparent Personality Analysis (APA) competition using ChaLearn LAP APA2016 dataset and achieved excellent performance.