# Facial Expression Recognition using Visual Saliency and Deep Learning

arXiv: https://arxiv.org/abs/1708.08016 · HTML: https://mlsanity.com/paper/1708.08016/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Aug 2017.

## Built on by (most cited first, 6 of 6)

- [CASP-Net: Rethinking Video Saliency Prediction from an Audio-VisualConsistency Perceptual Perspective](https://mlsanity.com/paper/2303.06357/) (2023)
- [Critically examining the Domain Generalizability of Facial Expression Recognition models](https://mlsanity.com/paper/2106.15453/) (2021)
- [FaceTopoNet: Facial Expression Recognition using Face Topology Learning](https://mlsanity.com/paper/2209.06322/) (2022)
- [Minimalistic Video Saliency Prediction via Efficient Decoder & Spatio Temporal Action Cues](https://mlsanity.com/paper/2502.00397/) (2025)
- [Mitigating Bias Using Model-Agnostic Data Attribution](https://mlsanity.com/paper/2405.05031/) (2024)
- [Complex Emotion Recognition System using basic emotions via Facial Expression, EEG, and ECG Signals: a review](https://mlsanity.com/paper/2409.07493/) (2024)

## Abstract (arXiv)

We have developed a convolutional neural network for the purpose of recognizing facial expressions in human beings. We have fine-tuned the existing convolutional neural network model trained on the visual recognition dataset used in the ILSVRC2012 to two widely used facial expression datasets - CFEE and RaFD, which when trained and tested independently yielded test accuracies of 74.79% and 95.71%, respectively. Generalization of results was evident by training on one dataset and testing on the other. Further, the image product of the cropped faces and their visual saliency maps were computed using Deep Multi-Layer Network for saliency prediction and were fed to the facial expression recognition CNN. In the most generalized experiment, we observed the top-1 accuracy in the test set to be 65.39%. General confusion trends between different facial expressions as exhibited by humans were also observed.