mlsanityData to 14 Oct 2026

Traits Run Deeper: Trait-Specific Asymmetric Fusion for Multimodal Personality Assessment

arXiv 2606.11269 ↗First posted 9 Jun 2026cs.CV cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Personality assessment aims to infer stable traits from dynamic behaviors across modalities like language, voice, and facial expressions. Existing approaches often adopt a uniform multimodal fusion strategy for all personality dimensions, overlooking trait-specific modality preferences and causing cross-modal interference. To address this, we propose Traits Run Deeper, a novel personality assessment framework consisting of three components. First, the Multimodal Foundation Representation (MFR) module constructs personality-oriented inputs and incorporates psychology-informed semantic templates as anchors, enabling foundation models to capture trait-relevant behaviors. Second, the Trait-Specific Modality Fusion (TSMF) module employs an asymmetric fusion mechanism, allowing each dimension to selectively exploit different modality pathways to capture heterogeneous preferences while reducing cross-modal contamination. Third, the Distribution-Calibrated Personality Regression (DCPR) module mitigates label imbalance and central tendency bias through target distribution calibration, improving robustness and stability. Experimental results on the AVI Challenge 2026 validation set show that our framework reduces mean squared error (MSE) by approximately 25% compared with the baseline. Consistent improvements on the official test set demonstrate that our method achieves the best performance and ranks first in the AVI Challenge 2026 Personality Assessment Track. The source code will be made available at [https://github.com/MSA-LMC/TraitsRunDeeper](https://github.com/MSA-LMC/TraitsRunDeeper).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 51 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

14 of 51 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
  5. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  6. 2022Balanced MSE for Imbalanced Visual Regressioncited by 89
  7. 2020K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversationscited by 30
  8. 2022Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognitioncited by 22
  9. 2022An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognitioncited by 12
  10. 2019On the Effect of Observed Subject Biases in Apparent Personality Analysis from Audio-visual Signalscited by 11
  11. 2024Static for Dynamic: Towards a Deeper Understanding of Dynamic Facial Expressions Using Static Expression Datacited by 9
  12. 2025VAEmo: Efficient Representation Learning for Visual-Audio Emotion with Knowledge Injectioncited by 5
2 more
  1. 2025Traits Run Deep: Enhancing Personality Assessment via Psychology-Guided LLM Representations and Multimodal Apparent Behaviorscited by 1
  2. 2026AffectSpeech: A Large-Scale Emotional Speech Dataset with Fine-Grained Textual Descriptions for Speech Emotion Captioning and Synthesiscited by 1

Built on by

Not cited yet.