Altering Facial Expression Based on Textual Emotion
Not on the map. Why?
Abstract (arXiv)
Faces and their expressions are one of the potent subjects for digital images. Detecting emotions from images is an ancient task in the field of computer vision; however, performing its reverse -- synthesizing facial expressions from images -- is quite new. Such operations of regenerating images with different facial expressions, or altering an existing expression in an image require the Generative Adversarial Network (GAN). In this paper, we aim to change the facial expression in an image using GAN, where the input image with an initial expression (i.e., happy) is altered to a different expression (i.e., disgusted) for the same person. We used StarGAN techniques on a modified version of the MUG dataset to accomplish this objective. Moreover, we extended our work further by remodeling facial expressions in an image indicated by the emotion from a given text. As a result, we applied a Long Short-Term Memory (LSTM) method to extract emotion from the text and forwarded it to our expression-altering module. As a demonstration of our working pipeline, we also create an application prototype of a blog that regenerates the profile picture with different expressions based on the user's textual emotion.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 12 of its 32 references that are in the map. First posted on arXiv 2 Dec 2021.
Builds on
12 of 32 references.
References · 12
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
- 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 420
- 2017ExprGAN: Facial Expression Editing with Controllable Expression Intensitycited by 47
- 2017Geometry Guided Adversarial Facial Expression Synthesiscited by 29
- 2018Geometry-Contrastive GAN for Facial Expression Transfercited by 16
- 2017Photorealistic Facial Expression Synthesis by the Conditional Difference Adversarial Autoencodercited by 10
Built on by
Citing papers per year: 2025: 2.
2 papers.