SeetaPsych v1.0: An Open-source Computer Vision Toolkit for Behavior-based Psychological Measurement
Not on the map. Why?
Abstract (arXiv)
Automated visual analysis opens new avenues for behavior--based psychological measurement. Nevertheless, existing technological modules are typically scattered across task specific systems with heterogeneous interfaces and disparate deployment requirements. In this work, we present SeetaPsych v1.0, an open source, unified and extensible computer vision toolkit designed to extract psychologically relevant signals from facial images and/or face based videos. The current release encompasses four major core modules aiming at behavior--based physiological perception: unified face based emotion analysis (simultaneous facial expression recognition, facial action unit detection, and valence--arousal estimation), camera based heart rate estimation, screen point--of--gaze estimation, and scene gaze following. A suite of auxiliary preprocessing modules for human centric visual analysis is also included, comprising face detection, facial landmark detection, and head detection. These functionalities are encapsulated within a modular Pipeline/Runner architecture that automatically resolves attribute dependencies, constructs computation graphs, and support intermediate result sharing among modules. SeetaPsych provides standardized Python APIs to facilitate reproducible, large scale analyses, alongside an interactive WebUI for rapid, code--free method evaluation. Overall, SeetaPsych offers an integrated and accessible visual measurement platform for research in psychology, behavioral science, human computer interaction, and related fields.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 42 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
17 of 42 references.
References · 17
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
- 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 104
- 2020Detecting Attended Visual Targets in Videocited by 77
- 2019Real-time Facial Surface Geometry from Monocular Video on Mobile GPUscited by 73
- 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 64
- 2018VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Videocited by 58
- 2018A Compact Embedding for Facial Expression Similaritycited by 41
- 2024Gaze-LLE: Gaze Target Estimation via Large-Scale Learned Encoderscited by 36
- 2021Py-Feat: Python Facial Expression Analysis Toolboxcited by 33
5 more
- 2021Adaptive Feature Fusion Network for Gaze Tracking in Mobile Tabletscited by 29
- 2023LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysiscited by 18
- 2024ViTGaze: Gaze Following with Interaction Features in Vision Transformerscited by 15
- 2020RAF-AU Database: In-the-Wild Facial Expressions with Subjective Emotion Judgement and Objective AU Annotationscited by 11
- 20223DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Viewscited by 11
Built on by
Not cited yet.