Neuromorphic Event-based Facial Expression Recognition
Not on the map. Why?
Abstract (arXiv)
Recently, event cameras have shown large applicability in several computer vision fields especially concerning tasks that require high temporal resolution. In this work, we investigate the usage of such kind of data for emotion recognition by presenting NEFER, a dataset for Neuromorphic Event-based Facial Expression Recognition. NEFER is composed of paired RGB and event videos representing human faces labeled with the respective emotions and also annotated with face bounding boxes and facial landmarks. We detail the data acquisition process as well as providing a baseline method for RGB and event data. The collected data captures subtle micro-expressions, which are hard to spot with RGB data, yet emerge in the event domain. We report a double recognition accuracy for the event-based approach, proving the effectiveness of a neuromorphic approach for analyzing fast and hardly detectable expressions and the emotions they conceal.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 34 of its 75 references that are in the map. First posted on arXiv 13 Apr 2023.
Builds on
34 of 75 references.
References · 34
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
- 2019Event-based Vision: A Surveycited by 1,010
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
- 2014Learning Face Representation from Scratchcited by 451
- 2018Deep Facial Expression Recognition: A Surveycited by 269
- 2015The MegaFace Benchmark: 1 Million Faces for Recognition at Scalecited by 199
- 2021N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Camerascited by 91
- 2021Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Predictioncited by 88
- 2019Focus Is All You Need: Loss Functions For Event-based Visioncited by 83
22 more
- 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 83
- 2020Masked Face Recognition Dataset and Applicationcited by 66
- 2018The Devil of Face Recognition is in the Noisecited by 65
- 2018Facial Landmark Detection: a Literature Surveycited by 63
- 2020Temporal Binary Representation for Event-Based Action Recognitioncited by 50
- 2016Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-related Applicationscited by 45
- 2017DART: Distribution Aware Retinal Transform for Event-based Camerascited by 39
- 2022DEVO: Depth-Event Camera Visual Odometry in Challenging Conditionscited by 36
- 2018Semi-supervised Adversarial Learning to Generate Photorealistic Face Images of New Identities from 3D Morphable Modelcited by 28
- 2021Moving Object Detection for Event-based vision using Graph Spectral Clusteringcited by 28
- 2020Real-Time Face & Eye Tracking and Blink Detection using Event Camerascited by 27
- 2022Efficient Human Pose Estimation via 3D Event Point Cloudcited by 25
- 2016A Comprehensive Analysis of Deep Learning Based Representation for Face Recognitioncited by 23
- 2021Comparing Representations in Tracking for Event Camera-based SLAMcited by 23
- 2021Spatiotemporal Registration for Event-based Visual Odometrycited by 21
- 2018Event-based Face Detection and Tracking in the Blink of an Eyecited by 16
- 2021Lifting Monocular Events to 3D Human Posescited by 16
- 2019Event-based attention and tracking on neuromorphic hardwarecited by 14
- 2021Visual Odometry with an Event Camera Using Continuous Ray Warping and Volumetric Contrast Maximizationcited by 14
- 2016Temporal Activity Detection in Untrimmed Videos with Recurrent Neural Networkscited by 10
- 2022Real-time event simulation with frame-based camerascited by 7
- 2021Event Camera Simulator Design for Modeling Attention-based Inference Architecturescited by 6
Built on by
Citing papers per year: 2024: 6; 2025: 7; 2026: 5.
18 papers.
Sort:
- 2025FRED: The Florence RGB-Event Drone Datasetcited by 16
- 2024Neuromorphic Drone Detection: an Event-RGB Multimodal Approachcited by 14
- 2024Neuromorphic Face Analysis: a Surveycited by 9
- 2024Neuromorphic Facial Analysis with Cross-Modal Supervisioncited by 7
- 2025Exploring Spatial-Temporal Dynamics in Event-based Facial Micro-Expression Analysiscited by 4
- 2024Event Trojan: Asynchronous Event-based Backdoor Attackscited by 3
- 2024Evaluating Image-Based Face and Eye Tracking with Event Camerascited by 3
- 2025evTransFER: A Transfer Learning Framework for Event-based Facial Expression Recognitioncited by 3
- 2024Spatio-temporal Transformers for Action Unit Classification with Event Camerascited by 2
- 2025Event-based Solutions for Human-centered Applications: A Comprehensive Reviewcited by 2
- 2025CS3D: An Efficient Facial Expression Recognition via Event Visioncited by 2
- 2025Spike-TBR: a Noise Resilient Neuromorphic Event Representationcited by 1
6 more
- 2025Event-based Facial Keypoint Alignment via Cross-Modal Fusion Attention and Self-Supervised Multi-Event Representation Learningcited by 1
- 2026LiFR-Seg: Anytime High-Frame-Rate Segmentation via Event-Guided Propagationcited by 1
- 2026Locally Adaptive Decay Surfaces for High-Speed Face and Landmark Detection with Event Camerascited by 0
- 2026Generative Anonymization in Event Streamscited by 0
- 2026Event-based Liveness Detection using Temporal Ocular Dynamics: An Exploratory Approachcited by 0
- 2026CDER-SME: A Cross-Device Event-RGB Micro-Expression Dataset under Multi-Level Stress Inductioncited by 0
- 2026CDER-SME: A Cross-Device Event-RGB Micro-Expression Dataset under Multi-Level Stress Induction16 Jun 2026
- 2026Event-based Liveness Detection using Temporal Ocular Dynamics: An Exploratory Approach29 Apr 2026
- 2026Generative Anonymization in Event Streams14 Apr 2026
- 2026LiFR-Seg: Anytime High-Frame-Rate Segmentation via Event-Guided Propagation22 Mar 2026
- 2026Locally Adaptive Decay Surfaces for High-Speed Face and Landmark Detection with Event Cameras26 Feb 2026
- 2025CS3D: An Efficient Facial Expression Recognition via Event Vision10 Dec 2025
- 2025Event-based Facial Keypoint Alignment via Cross-Modal Fusion Attention and Self-Supervised Multi-Event Representation Learning29 Sep 2025
- 2025Exploring Spatial-Temporal Dynamics in Event-based Facial Micro-Expression Analysis16 Aug 2025
- 2025evTransFER: A Transfer Learning Framework for Event-based Facial Expression Recognition5 Aug 2025
- 2025FRED: The Florence RGB-Event Drone Dataset5 Jun 2025
- 2025Spike-TBR: a Noise Resilient Neuromorphic Event Representation5 Jun 2025
- 2025Event-based Solutions for Human-centered Applications: A Comprehensive Review17 Feb 2025
6 more
- 2024Spatio-temporal Transformers for Action Unit Classification with Event Cameras29 Oct 2024
- 2024Neuromorphic Drone Detection: an Event-RGB Multimodal Approach24 Sep 2024
- 2024Neuromorphic Facial Analysis with Cross-Modal Supervision16 Sep 2024
- 2024Evaluating Image-Based Face and Eye Tracking with Event Cameras19 Aug 2024
- 2024Event Trojan: Asynchronous Event-based Backdoor Attacks9 Jul 2024
- 2024Neuromorphic Face Analysis: a Survey18 Feb 2024
- 2025FRED: The Florence RGB-Event Drone Datasetcited by 16
- 2024Neuromorphic Drone Detection: an Event-RGB Multimodal Approachcited by 14
- 2024Neuromorphic Face Analysis: a Surveycited by 9
- 2024Neuromorphic Facial Analysis with Cross-Modal Supervisioncited by 7
- 2025Exploring Spatial-Temporal Dynamics in Event-based Facial Micro-Expression Analysiscited by 4
- 2024Event Trojan: Asynchronous Event-based Backdoor Attackscited by 3
- 2024Evaluating Image-Based Face and Eye Tracking with Event Camerascited by 3
- 2025evTransFER: A Transfer Learning Framework for Event-based Facial Expression Recognitioncited by 3
- 2024Spatio-temporal Transformers for Action Unit Classification with Event Camerascited by 2
- 2025Event-based Solutions for Human-centered Applications: A Comprehensive Reviewcited by 2
- 2025CS3D: An Efficient Facial Expression Recognition via Event Visioncited by 2
- 2025Spike-TBR: a Noise Resilient Neuromorphic Event Representationcited by 1
12 most cited of 18 All 18 (JSON)
- 2026CDER-SME: A Cross-Device Event-RGB Micro-Expression Dataset under Multi-Level Stress Induction16 Jun 2026
- 2026Event-based Liveness Detection using Temporal Ocular Dynamics: An Exploratory Approach29 Apr 2026
- 2026Generative Anonymization in Event Streams14 Apr 2026
- 2026LiFR-Seg: Anytime High-Frame-Rate Segmentation via Event-Guided Propagation22 Mar 2026
- 2026Locally Adaptive Decay Surfaces for High-Speed Face and Landmark Detection with Event Cameras26 Feb 2026
- 2025CS3D: An Efficient Facial Expression Recognition via Event Vision10 Dec 2025
- 2025Event-based Facial Keypoint Alignment via Cross-Modal Fusion Attention and Self-Supervised Multi-Event Representation Learning29 Sep 2025
- 2025Exploring Spatial-Temporal Dynamics in Event-based Facial Micro-Expression Analysis16 Aug 2025
- 2025evTransFER: A Transfer Learning Framework for Event-based Facial Expression Recognition5 Aug 2025
- 2025FRED: The Florence RGB-Event Drone Dataset5 Jun 2025
- 2025Spike-TBR: a Noise Resilient Neuromorphic Event Representation5 Jun 2025
- 2025Event-based Solutions for Human-centered Applications: A Comprehensive Review17 Feb 2025
12 newest of 18 All 18 (JSON)