mlsanityData to 7 Oct 2026

Photorealistic Facial Synthesis in the Dimensional Affect Space

arXiv 1811.08004 ↗First posted 11 Nov 2018cs.GR cs.CV cs.LGcited by 33

Not on the map. Why?

Abstract (arXiv)

This paper presents a novel approach for synthesizing facial affect, which is based on our annotating 600,000 frames of the 4DFAB database in terms of valence and arousal. The input of this approach is a pair of these emotional state descriptors and a neutral 2D image of a person to whom the corresponding affect will be synthesized. Given this target pair, a set of 3D facial meshes is selected, which is used to build a blendshape model and generate the new facial affect. To synthesize the affect on the 2D neutral image, 3DMM fitting is performed and the reconstructed face is deformed to generate the target facial expressions. Last, the new face is rendered into the original image. Both qualitative and quantitative experimental studies illustrate the generation of realistic images, when the neutral image is sampled from a variety of well known databases, such as the Aff-Wild, AFEW, Multi-PIE, AFEW-VA, BU-3DFE, Bosphorus.

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Nov 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 19; 2023: 4; 2024: 6; 2025: 2.

33 papers.

Sort:

  1. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  2. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
  3. 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
  4. 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
  5. 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
  6. 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
  7. 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
  8. 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
  9. 2023A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and Decision Making in Medical Imagingcited by 39
  10. 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
  11. 2024Domain adaptation, Explainability & Fairness in AI for Medical Image Analysis: Diagnosis of COVID-19 based on 3-D Chest CT-scanscited by 30
  12. 2024COVID-19 Computer-aided Diagnosis through AI-assisted CT Imaging Analysis: Deploying a Medical AI Systemcited by 23
21 more
  1. 2022AI-MIA: COVID-19 Detection & Severity Analysis through Medical Imagingcited by 20
  2. 2023BTDNet: a Multi-Modal Approach for Brain Tumor Radiogenomic Classificationcited by 20
  3. 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarioscited by 13
  4. 2022Multi-Task Learning Framework for Emotion Recognition in-the-wildcited by 10
  5. 2022Facial Affect Analysis: Learning from Synthetic Data & Multi-Task Learning Challengescited by 10
  6. 2022Affective Behaviour Analysis Using Pretrained Model with Facial Prioricited by 10
  7. 2022Affective Behavior Analysis using Action Unit Relation Graph and Multi-task Cross Attentioncited by 8
  8. 2022HSE-NN Team at the 4th ABAW Competition: Multi-task Emotion Recognition and Learning from Synthetic Imagescited by 6
  9. 2022Mid-level Representation Enhancement and Graph Embedded Uncertainty Suppressing for Facial Expression Recognitioncited by 6
  10. 2022Learning from Synthetic Data: Facial Expression Classification based on Ensemble of Multi-task Networkscited by 5
  11. 2022Hybrid CNN-Transformer Model For Facial Affect Recognition In the ABAW4 Challengecited by 5
  12. 2024Robust Facial Reactions Generation: An Emotion-Aware Framework with Modality Compensationcited by 4
  13. 2022Multi-Task Learning for Emotion Descriptors Estimation at the fourth ABAW Challengecited by 3
  14. 2022BYEL : Bootstrap Your Emotion Latentcited by 3
  15. 2022An Ensemble Approach for Multiple Emotion Descriptors Estimation Using Multi-task Learningcited by 3
  16. 2022Two-Aspect Information Fusion Model For ABAW4 Multi-task Challengecited by 3
  17. 2023ABAW : Facial Expression Recognition in the wildcited by 3
  18. 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERCcited by 1
  19. 2022Hand-Assisted Expression Recognition Method from Synthetic Images at the Fourth ABAW Challengecited by 0
  20. 2022AU-Supervised Convolutional Vision Transformers for Synthetic Facial Expression Recognitioncited by 0
  21. 2022Multi-Task Transformer with uncertainty modelling for Face Based Affective Computingcited by 0