Deep Impression: Audiovisual Deep Residual Networks for Multimodal Apparent Personality Trait Recognition
Not on the map. Why?
Abstract (arXiv)
Here, we develop an audiovisual deep residual network for multimodal apparent personality trait recognition. The network is trained end-to-end for predicting the Big Five personality traits of people from their videos. That is, the network does not require any feature engineering or visual analysis such as face detection, face landmark alignment or facial expression recognition. Recently, the network won the third place in the ChaLearn First Impressions Challenge with a test accuracy of 0.9109.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 2; 2024: 1; 2025: 5; 2026: 2.
15 papers.
Sort:
By area:
- 2023SVFAP: Self-supervised Video Facial Affect Perceivercited by 18
- 2022An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognitioncited by 12
- 2021Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognitioncited by 5
- 2021Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encodingcited by 5
- 2022Multimodal Vision Transformers with Forced Attention for Behavior Analysiscited by 3
- 2025Graph-Driven Multimodal Feature Learning Framework for Apparent Personality Assessmentcited by 2
- 2022Domain-specific Learning of Multi-scale Facial Dynamics for Apparent Personality Traits Predictioncited by 1
- 2025Traits Run Deep: Enhancing Personality Assessment via Psychology-Guided LLM Representations and Multimodal Apparent Behaviorscited by 1
- 2023Learning Person-specific Network Representation for Apparent Personality Traits Recognitioncited by 0
- 2024Personality Analysis from Online Short Video Platforms with Multi-domain Adaptationcited by 0
- 2025Multi-modal expressive personality recognition in data non-ideal audiovisual based on multi-scale feature enhancement and modal augmentcited by 0
- 2025Learning Personalised Human Internal Cognition from External Expressive Behaviours for Real Personality Recognitioncited by 0
- 2026Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?21 May 2026
- 2026Debiased Multimodal Personality Understanding through Dual Causal Intervention7 May 2026
- 2025Joint Modeling of Big Five and HEXACO for Multimodal Apparent Personality-trait Recognition16 Oct 2025
- 2025Learning Personalised Human Internal Cognition from External Expressive Behaviours for Real Personality Recognition31 Jul 2025
- 2025Traits Run Deep: Enhancing Personality Assessment via Psychology-Guided LLM Representations and Multimodal Apparent Behaviors30 Jul 2025
- 2025Graph-Driven Multimodal Feature Learning Framework for Apparent Personality Assessment15 Apr 2025
- 2025Multi-modal expressive personality recognition in data non-ideal audiovisual based on multi-scale feature enhancement and modal augment8 Mar 2025
- 2024Personality Analysis from Online Short Video Platforms with Multi-domain Adaptation26 Oct 2024
- 2023SVFAP: Self-supervised Video Facial Affect Perceiver31 Dec 2023
- 2023Learning Person-specific Network Representation for Apparent Personality Traits Recognition1 Mar 2023
- 2022Multimodal Vision Transformers with Forced Attention for Behavior Analysis7 Dec 2022
- 2022An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognition17 Oct 2022
3 more
- 2022Domain-specific Learning of Multi-scale Facial Dynamics for Apparent Personality Traits Prediction9 Sep 2022
- 2021Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encoding22 Dec 2021
- 2021Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognition26 Oct 2021
- 2023SVFAP: Self-supervised Video Facial Affect Perceivercited by 18
- 2022An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognitioncited by 12
- 2021Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognitioncited by 5
- 2021Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encodingcited by 5
- 2022Multimodal Vision Transformers with Forced Attention for Behavior Analysiscited by 3
- 2025Graph-Driven Multimodal Feature Learning Framework for Apparent Personality Assessmentcited by 2
- 2022Domain-specific Learning of Multi-scale Facial Dynamics for Apparent Personality Traits Predictioncited by 1
- 2025Traits Run Deep: Enhancing Personality Assessment via Psychology-Guided LLM Representations and Multimodal Apparent Behaviorscited by 1
- 2023Learning Person-specific Network Representation for Apparent Personality Traits Recognitioncited by 0
- 2024Personality Analysis from Online Short Video Platforms with Multi-domain Adaptationcited by 0
- 2025Multi-modal expressive personality recognition in data non-ideal audiovisual based on multi-scale feature enhancement and modal augmentcited by 0
- 2025Learning Personalised Human Internal Cognition from External Expressive Behaviours for Real Personality Recognitioncited by 0
12 most cited of 14 All 14 (JSON)
- 2026Debiased Multimodal Personality Understanding through Dual Causal Intervention7 May 2026
- 2025Joint Modeling of Big Five and HEXACO for Multimodal Apparent Personality-trait Recognition16 Oct 2025
- 2025Learning Personalised Human Internal Cognition from External Expressive Behaviours for Real Personality Recognition31 Jul 2025
- 2025Traits Run Deep: Enhancing Personality Assessment via Psychology-Guided LLM Representations and Multimodal Apparent Behaviors30 Jul 2025
- 2025Graph-Driven Multimodal Feature Learning Framework for Apparent Personality Assessment15 Apr 2025
- 2025Multi-modal expressive personality recognition in data non-ideal audiovisual based on multi-scale feature enhancement and modal augment8 Mar 2025
- 2024Personality Analysis from Online Short Video Platforms with Multi-domain Adaptation26 Oct 2024
- 2023SVFAP: Self-supervised Video Facial Affect Perceiver31 Dec 2023
- 2023Learning Person-specific Network Representation for Apparent Personality Traits Recognition1 Mar 2023
- 2022Multimodal Vision Transformers with Forced Attention for Behavior Analysis7 Dec 2022
- 2022An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognition17 Oct 2022
- 2022Domain-specific Learning of Multi-scale Facial Dynamics for Apparent Personality Traits Prediction9 Sep 2022
12 newest of 14 All 14 (JSON)