Py-Feat: Python Facial Expression Analysis Toolbox
Not on the map. Why?
Abstract (arXiv)
Studying facial expressions is a notoriously difficult endeavor. Recent advances in the field of affective computing have yielded impressive progress in automatically detecting facial expressions from pictures and videos. However, much of this work has yet to be widely disseminated in social science domains such as psychology. Current state of the art models require considerable domain expertise that is not traditionally incorporated into social science training programs. Furthermore, there is a notable absence of user-friendly and open-source software that provides a comprehensive set of tools and functions that support facial expression research. In this paper, we introduce Py-Feat, an open-source Python toolbox that provides support for detecting, preprocessing, analyzing, and visualizing facial expression data. Py-Feat makes it easy for domain experts to disseminate and benchmark computer vision models and also for end users to quickly process, analyze, and visualize face expression data. We hope this platform will facilitate increased use of facial expression data in human behavior research.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Builds on 18 of its 106 references that are in the map. First posted on arXiv 8 Apr 2021.
Builds on
18 of 106 references.
References · 18
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016OpenAI Gymcited by 1,736
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
- 2013Challenges in Representation Learning: A report on three machine learning contestscited by 302
- 2015WIDER FACE: A Face Detection Benchmarkcited by 298
- 2018MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devicescited by 182
- 2019RetinaFace: Single-stage Dense Face Localisation in the Wildcited by 165
- 2014Machine Learning for Neuroimaging with Scikit-Learncited by 70
- 2016From Facial Expression Recognition to Interpersonal Relation Predictioncited by 53
6 more
- 2017FaceBoxes: A CPU Real-time Face Detector with High Accuracycited by 45
- 2018A Compact Embedding for Facial Expression Similaritycited by 41
- 2019PFLD: A Practical Facial Landmark Detectorcited by 26
- 2019Deep Learning for Face Recognition: Pride or Prejudiced?cited by 25
- 2017EmotioNet Challenge: Recognition of facial expressions of emotion in the wildcited by 9
- 2017What your Facebook Profile Picture Reveals about your Personalitycited by 7
Built on by
Citing papers per year: 2022: 2; 2023: 7; 2024: 4; 2025: 7; 2026: 13.
33 papers.
Sort:
- 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
- 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkitcited by 16
- 2024Textualized and Feature-based Models for Compound Multimodal Emotion Recognition in the Wildcited by 9
- 2022Tensor-based Emotion Editing in the StyleGAN Latent Spacecited by 7
- 2023Learning Motion Refinement for Unsupervised Face Animationcited by 7
- 2024Transformer with Leveraged Masked Autoencoder for video-based Pain Assessmentcited by 7
- 2025Visual and Textual Prompts in VLLMs for Enhancing Emotion Recognitioncited by 7
- 2025OpenFace 3.0: A Lightweight Multitask System for Comprehensive Facial Behavior Analysiscited by 5
- 2023Using Positive Matching Contrastive Loss with Facial Action Units to mitigate bias in Facial Expression Recognitioncited by 4
- 2026Solution for 10th Competition on Ambivalence/Hesitancy (AH) Video Recognition Challenge using Divergence-Based Multimodal Fusioncited by 4
- 2023Optimizing Facial Expressions of an Android Robot Effectively: a Bayesian Optimization Approachcited by 3
- 2025Beyond FACS: Data-driven Facial Expression Dictionaries, with Application to Predicting Autismcited by 3
21 more
- 2025SynPAIN: A Synthetic Dataset of Pain and Non-Pain Facial Expressionscited by 3
- 2022Interpretable Explainability in Facial Emotion Recognition and Gamification for Data Collectioncited by 1
- 2023Integrating Holistic and Local Information to Estimate Emotional Reaction Intensitycited by 1
- 2023Behavior quantification as the missing link between fields: Tools for digital psychiatry and their role in the future of neurobiologycited by 1
- 2023Can we truly transfer an actor's genuine happiness to avatars? An investigation into virtual, real, posed and spontaneous facescited by 0
- 2024The Meme Is the Message: Generative Memesis and AI Visuals in the 2024 USA Presidential Electionscited by 0
- 2025CAST-Phys: Contactless Affective States Through Physiological signals Databasecited by 0
- 2025REVELIO -- Universal Multimodal Task Load Estimation for Cross-Domain Generalizationcited by 0
- 2025Bitbox: Behavioral Imaging Toolbox for Computational Analysis of Behavior from Videoscited by 0
- 2026The Nonverbal Gap: Toward Affective Computer Vision for Safer and More Equitable Online Datingcited by 0
- 2026Interpretable facial dynamics as behavioral and perceptual traces of deepfakescited by 0
- 20263D Temporal Analysis for Autism Spectrum Disorder Screening During Attention Taskscited by 0
- 2026Beyond Universality: The GCC-FER Dataset and Culture-Aware Adaptation for Dynamic Facial Expression Recognitioncited by 0
- 2026STEER: Steerable Dyadic Head Avatarscited by 0
- 2026FIDAC: An Easy-to-use Pipeline to Extract and Interpret Interpersonal Distance From Videocited by 0
- 2026Emotion Intensity Matters: Generating Realistic Expressions in Virtual Humans with CVAEscited by 0
- 2026Real-TurnTurk: A Multimodal Turkish Corpus for Turn-Taking Predictioncited by 0
- 2026TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairmentcited by 0
- 2026Multimodal Emotion Recognition in Conversations via Class-Wise Adaptive Modality Fusion and Affective Geometrycited by 0
- 2026SeetaPsych v1.0: An Open-source Computer Vision Toolkit for Behavior-based Psychological Measurementcited by 0
- 2026GLARE: Generating Listening Heads with Appropriate Reactionscited by 0
- 2026GLARE: Generating Listening Heads with Appropriate Reactions30 Sep 2026
- 2026SeetaPsych v1.0: An Open-source Computer Vision Toolkit for Behavior-based Psychological Measurement17 Sep 2026
- 2026Multimodal Emotion Recognition in Conversations via Class-Wise Adaptive Modality Fusion and Affective Geometry9 Sep 2026
- 2026TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment31 Aug 2026
- 2026Real-TurnTurk: A Multimodal Turkish Corpus for Turn-Taking Prediction22 Aug 2026
- 2026Emotion Intensity Matters: Generating Realistic Expressions in Virtual Humans with CVAEs22 Aug 2026
- 2026FIDAC: An Easy-to-use Pipeline to Extract and Interpret Interpersonal Distance From Video27 Jul 2026
- 2026STEER: Steerable Dyadic Head Avatars26 Jul 2026
- 2026Beyond Universality: The GCC-FER Dataset and Culture-Aware Adaptation for Dynamic Facial Expression Recognition5 Jun 2026
- 20263D Temporal Analysis for Autism Spectrum Disorder Screening During Attention Tasks3 Jun 2026
- 2026Interpretable facial dynamics as behavioral and perceptual traces of deepfakes23 Apr 2026
- 2026The Nonverbal Gap: Toward Affective Computer Vision for Safer and More Equitable Online Dating20 Mar 2026
21 more
- 2026Solution for 10th Competition on Ambivalence/Hesitancy (AH) Video Recognition Challenge using Divergence-Based Multimodal Fusion15 Mar 2026
- 2025Bitbox: Behavioral Imaging Toolbox for Computational Analysis of Behavior from Videos19 Dec 2025
- 2025REVELIO -- Universal Multimodal Task Load Estimation for Cross-Domain Generalization1 Sep 2025
- 2025SynPAIN: A Synthetic Dataset of Pain and Non-Pain Facial Expressions25 Jul 2025
- 2025CAST-Phys: Contactless Affective States Through Physiological signals Database8 Jul 2025
- 2025OpenFace 3.0: A Lightweight Multitask System for Comprehensive Facial Behavior Analysis3 Jun 2025
- 2025Beyond FACS: Data-driven Facial Expression Dictionaries, with Application to Predicting Autism30 May 2025
- 2025Visual and Textual Prompts in VLLMs for Enhancing Emotion Recognition24 Apr 2025
- 2024The Meme Is the Message: Generative Memesis and AI Visuals in the 2024 USA Presidential Elections1 Nov 2024
- 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkit26 Sep 2024
- 2024Transformer with Leveraged Masked Autoencoder for video-based Pain Assessment8 Sep 2024
- 2024Textualized and Feature-based Models for Compound Multimodal Emotion Recognition in the Wild17 Jul 2024
- 2023Can we truly transfer an actor's genuine happiness to avatars? An investigation into virtual, real, posed and spontaneous faces4 Dec 2023
- 2023Learning Motion Refinement for Unsupervised Face Animation21 Oct 2023
- 2023Behavior quantification as the missing link between fields: Tools for digital psychiatry and their role in the future of neurobiology24 May 2023
- 2023Integrating Holistic and Local Information to Estimate Emotional Reaction Intensity9 May 2023
- 2023High-Fidelity and Freely Controllable Talking Head Video Generation20 Apr 2023
- 2023Using Positive Matching Contrastive Loss with Facial Action Units to mitigate bias in Facial Expression Recognition8 Mar 2023
- 2023Optimizing Facial Expressions of an Android Robot Effectively: a Bayesian Optimization Approach13 Jan 2023
- 2022Interpretable Explainability in Facial Emotion Recognition and Gamification for Data Collection9 Nov 2022
- 2022Tensor-based Emotion Editing in the StyleGAN Latent Space12 May 2022
- 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
- 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkitcited by 16
- 2024Textualized and Feature-based Models for Compound Multimodal Emotion Recognition in the Wildcited by 9
- 2022Tensor-based Emotion Editing in the StyleGAN Latent Spacecited by 7
- 2023Learning Motion Refinement for Unsupervised Face Animationcited by 7
- 2024Transformer with Leveraged Masked Autoencoder for video-based Pain Assessmentcited by 7
- 2025Visual and Textual Prompts in VLLMs for Enhancing Emotion Recognitioncited by 7
- 2025OpenFace 3.0: A Lightweight Multitask System for Comprehensive Facial Behavior Analysiscited by 5
- 2023Using Positive Matching Contrastive Loss with Facial Action Units to mitigate bias in Facial Expression Recognitioncited by 4
- 2026Solution for 10th Competition on Ambivalence/Hesitancy (AH) Video Recognition Challenge using Divergence-Based Multimodal Fusioncited by 4
- 2023Optimizing Facial Expressions of an Android Robot Effectively: a Bayesian Optimization Approachcited by 3
- 2025Beyond FACS: Data-driven Facial Expression Dictionaries, with Application to Predicting Autismcited by 3
12 most cited of 33 All 33 (JSON)
- 2026GLARE: Generating Listening Heads with Appropriate Reactions30 Sep 2026
- 2026SeetaPsych v1.0: An Open-source Computer Vision Toolkit for Behavior-based Psychological Measurement17 Sep 2026
- 2026Multimodal Emotion Recognition in Conversations via Class-Wise Adaptive Modality Fusion and Affective Geometry9 Sep 2026
- 2026TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment31 Aug 2026
- 2026Real-TurnTurk: A Multimodal Turkish Corpus for Turn-Taking Prediction22 Aug 2026
- 2026Emotion Intensity Matters: Generating Realistic Expressions in Virtual Humans with CVAEs22 Aug 2026
- 2026FIDAC: An Easy-to-use Pipeline to Extract and Interpret Interpersonal Distance From Video27 Jul 2026
- 2026STEER: Steerable Dyadic Head Avatars26 Jul 2026
- 2026Beyond Universality: The GCC-FER Dataset and Culture-Aware Adaptation for Dynamic Facial Expression Recognition5 Jun 2026
- 20263D Temporal Analysis for Autism Spectrum Disorder Screening During Attention Tasks3 Jun 2026
- 2026Interpretable facial dynamics as behavioral and perceptual traces of deepfakes23 Apr 2026
- 2026The Nonverbal Gap: Toward Affective Computer Vision for Safer and More Equitable Online Dating20 Mar 2026
12 newest of 33 All 33 (JSON)