mlsanityData to 7 Oct 2026

Traits Run Deep: Enhancing Personality Assessment via Psychology-Guided LLM Representations and Multimodal Apparent Behaviors

arXiv 2507.22367 ↗First posted 30 Jul 2025cs.CL cs.MMcited by 1

Not on the map. Why?

Abstract (arXiv)

Accurate and reliable personality assessment plays a vital role in many fields, such as emotional intelligence, mental health diagnostics, and personalized education. Unlike fleeting emotions, personality traits are stable, often subconsciously leaked through language, facial expressions, and body behaviors, with asynchronous patterns across modalities. It was hard to model personality semantics with traditional superficial features and seemed impossible to achieve effective cross-modal understanding. To address these challenges, we propose a novel personality assessment framework called textitTraits Run Deep. It employs textitpsychology-informed prompts to elicit high-level personality-relevant semantic representations. Besides, it devises a textitText-Centric Trait Fusion Network that anchors rich text semantics to align and integrate asynchronous signals from other modalities. To be specific, such fusion module includes a Chunk-Wise Projector to decrease dimensionality, a Cross-Modal Connector and a Text Feature Enhancer for effective modality fusion and an ensemble regression head to improve generalization in data-scarce situations. To our knowledge, we are the first to apply personality-specific prompts to guide large language models (LLMs) in extracting personality-aware semantics for improved representation quality. Furthermore, extracting and fusing audio-visual apparent behavior features further improves the accuracy. Experimental results on the AVI validation set have demonstrated the effectiveness of the proposed components, i.e., approximately a 45% reduction in mean squared error (MSE). Final evaluations on the test set of the AVI Challenge 2025 confirm our method's superiority, ranking first in the Personality Assessment track. The source code will be made available at https://github.com/MSA-LMC/TraitsRunDeep.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 46 references that are in the map. First posted on arXiv 30 Jul 2025.

Builds on

17 of 46 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  6. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  7. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  8. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  9. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
  10. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  11. 2024Arc2Face: A Foundation Model for ID-Consistent Human Facescited by 101
  12. 2020Context-Aware Personality Inference in Dyadic Scenarios: Introducing the UDIVA Datasetcited by 31
5 more
  1. 2016Deep Impression: Audiovisual Deep Residual Networks for Multimodal Apparent Personality Trait Recognitioncited by 15
  2. 2018First Impressions: A Survey on Vision-Based Apparent Personality Trait Analysiscited by 14
  3. 2016Bi-modal First Impressions Recognition using Temporally Ordered Deep Audio and Stochastic Visual Featurescited by 13
  4. 2022An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognitioncited by 12
  5. 2024MDPE: A Multimodal Deception Dataset with Personality and Emotional Characteristicscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.