# Enriched Long-term Recurrent Convolutional Network for Facial Micro-Expression Recognition

arXiv: https://arxiv.org/abs/1805.08417 · HTML: https://mlsanity.com/paper/1805.08417/

## Key facts

- Cited by 27 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 May 2018.

## Built on by (most cited first, 27 of 27)

- [Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms](https://mlsanity.com/paper/2201.12728/) (2022)
- [Deep Learning for Micro-expression Recognition: A Survey](https://mlsanity.com/paper/2107.02823/) (2021)
- [Feature refinement: An expression-specific feature learning and fusion method for micro-expression recognition](https://mlsanity.com/paper/2101.04838/) (2021)
- [Short and Long Range Relation Based Spatio-Temporal Transformer for Micro-Expression Recognition](https://mlsanity.com/paper/2112.05851/) (2021)
- [Feature Representation Learning with Adaptive Displacement Generation and Transformer Fusion for Micro-Expression Recognition](https://mlsanity.com/paper/2304.04420/) (2023)
- [DFME: A New Benchmark for Dynamic Facial Micro-expression Recognition](https://mlsanity.com/paper/2301.00985/) (2023)
- [MOL: Joint Estimation of Micro-Expression, Optical Flow, and Landmark via Transformer-Graph-Style Convolution](https://mlsanity.com/paper/2506.14511/) (2025)
- [Data Leakage and Evaluation Issues in Micro-Expression Analysis](https://mlsanity.com/paper/2211.11425/) (2022)
- [Geometric Graph Representation with Learnable Graph Structure and Adaptive AU Constraint for Micro-Expression Recognition](https://mlsanity.com/paper/2205.00380/) (2022)
- [A comparative study on movement feature in different directions for micro-expression recognition](https://mlsanity.com/paper/2102.08068/) (2021)
- [How to Synthesize a Large-Scale and Trainable Micro-Expression Dataset?](https://mlsanity.com/paper/2112.01730/) (2021)
- [MPFNet: A Multi-Prior Fusion Network with a Progressive Training Strategy for Micro-Expression Recognition](https://mlsanity.com/paper/2506.09735/) (2025)
- [Weakly Supervised Learning for Facial Affective Behavior Analysis : A Review](https://mlsanity.com/paper/2101.09858/) (2021)
- [Deep Insights of Learning based Micro Expression Recognition: A Perspective on Promises, Challenges and Research Needs](https://mlsanity.com/paper/2210.04935/) (2022)
- [Transferring Dual Stochastic Graph Convolutional Network for Facial Micro-expression Recognition](https://mlsanity.com/paper/2203.05208/) (2022)
- [Multimodal Latent Emotion Recognition from Micro-expression and Physiological Signals](https://mlsanity.com/paper/2308.12156/) (2023)
- [Hierarchical Space-Time Attention for Micro-Expression Recognition](https://mlsanity.com/paper/2405.03202/) (2024)
- [Micro-Expression Recognition by Motion Feature Extraction based on Pre-training](https://mlsanity.com/paper/2407.07345/) (2024)
- [AMMSM: Adaptive Motion Magnification and Sparse Mamba for Micro-Expression Recognition](https://mlsanity.com/paper/2503.24057/) (2025)
- [Micro-Expression Recognition via Fine-Grained Dynamic Perception](https://mlsanity.com/paper/2509.06015/) (2025)
- [Region attention and graph embedding network for occlusion objective class-based micro-expression recognition](https://mlsanity.com/paper/2107.05904/) (2021)
- [A Dynamic 3D Spontaneous Micro-expression Database: Establishment and Evaluation](https://mlsanity.com/paper/2108.00166/) (2021)
- [Micro-Expression Recognition Based on Attribute Information Embedding and Cross-modal Contrastive Learning](https://mlsanity.com/paper/2205.14643/) (2022)
- [Three-Stream Temporal-Shift Attention Network Based on Self-Knowledge Distillation for Micro-Expression Recognition](https://mlsanity.com/paper/2406.17538/) (2024)
- [AHMSA-Net: Adaptive Hierarchical Multi-Scale Attention Network for Micro-Expression Recognition](https://mlsanity.com/paper/2501.02539/) (2025)
- [MMME: A Spontaneous Multi-Modal Micro-Expression Dataset Enabling Visual-Physiological Fusion](https://mlsanity.com/paper/2506.09834/) (2025)
- [Micro-expression Recognition Based on Dual-branch Feature Extraction and Fusion](https://mlsanity.com/paper/2602.23950/) (2026)

## Abstract (arXiv)

Facial micro-expression (ME) recognition has posed a huge challenge to researchers for its subtlety in motion and limited databases. Recently, handcrafted techniques have achieved superior performance in micro-expression recognition but at the cost of domain specificity and cumbersome parametric tunings. In this paper, we propose an Enriched Long-term Recurrent Convolutional Network (ELRCN) that first encodes each micro-expression frame into a feature vector through CNN module(s), then predicts the micro-expression by passing the feature vector through a Long Short-term Memory (LSTM) module. The framework contains two different network variants: (1) Channel-wise stacking of input data for spatial enrichment, (2) Feature-wise stacking of features for temporal enrichment. We demonstrate that the proposed approach is able to achieve reasonably good performance, without data augmentation. In addition, we also present ablation studies conducted on the framework and visualizations of what CNN "sees" when predicting the micro-expression classes.
