Post-hoc and manifold explanations analysis of facial expression data based on deep learning
Not on the map. Why?
Abstract (arXiv)
The complex information processing system of humans generates a lot of objective and subjective evaluations, making the exploration of human cognitive products of great cutting-edge theoretical value. In recent years, deep learning technologies, which are inspired by biological brain mechanisms, have made significant strides in the application of psychological or cognitive scientific research, particularly in the memorization and recognition of facial data. This paper investigates through experimental research how neural networks process and store facial expression data and associate these data with a range of psychological attributes produced by humans. Researchers utilized deep learning model VGG16, demonstrating that neural networks can learn and reproduce key features of facial data, thereby storing image memories. Moreover, the experimental results reveal the potential of deep learning models in understanding human emotions and cognitive processes and establish a manifold visualization interpretation of cognitive products or psychological attributes from a non-Euclidean space perspective, offering new insights into enhancing the explainability of AI. This study not only advances the application of AI technology in the field of psychology but also provides a new psychological theoretical understanding the information processing of the AI. The code is available in here: https://github.com/NKUShaw/Psychoinformatics.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 63 references that are in the map. First posted on arXiv 29 Apr 2024.
Builds on
18 of 63 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2014Going Deeper with Convolutionscited by 4,231
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017Dynamic Routing Between Capsulescited by 689
- 2017Interpretable Convolutional Neural Networkscited by 161
- 2020Reliable Post hoc Explanations: Modeling Uncertainty in Explainabilitycited by 125
- 2019Visualizing Deep Networks by Optimizing with Integrated Gradientscited by 59
6 more
- 2018Multi-task Learning of Hierarchical Vision-Language Representationcited by 26
- 2015From One Point to A Manifold: Knowledge Graph Embedding For Precise Link Predictioncited by 19
- 2022The Manifold Hypothesis for Gradient-Based Explanationscited by 15
- 2019A Replication Study: Machine Learning Models Are Capable of Predicting Sexual Orientation From Facial Imagescited by 7
- 2024SAGMAN: Stability Analysis of Graph Neural Networks on the Manifoldscited by 4
- 2017Learning to see people like peoplecited by 1
Built on by
Not cited yet.