mlsanityData to 14 Oct 2026

The AffectToolbox: Affect Analysis for Everyone

arXiv 2402.15195 ↗First posted 23 Feb 2024cs.HC cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

In the field of affective computing, where research continually advances at a rapid pace, the demand for user-friendly tools has become increasingly apparent. In this paper, we present the AffectToolbox, a novel software system that aims to support researchers in developing affect-sensitive studies and prototypes. The proposed system addresses the challenges posed by existing frameworks, which often require profound programming knowledge and cater primarily to power-users or skilled developers. Aiming to facilitate ease of use, the AffectToolbox requires no programming knowledge and offers its functionality to reliably analyze the affective state of users through an accessible graphical user interface. The architecture encompasses a variety of models for emotion recognition on multiple affective channels and modalities, as well as an elaborate fusion system to merge multi-modal assessments into a unified result. The entire system is open-sourced and will be publicly available to ensure easy integration into more complex applications through a well-structured, Python-based code base - therefore marking a substantial contribution toward advancing affective computing research and fostering a more collaborative and inclusive environment within this interdisciplinary field.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 13 of its 39 references that are in the map. First posted on arXiv 23 Feb 2024.

Builds on

13 of 39 references.

References · 13

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  5. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  6. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  7. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
  8. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
  9. 2022Dawn of the transformer era in speech emotion recognition: closing the valence gapcited by 157
  10. 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
  11. 2020BlazePose: On-device Real-time Body Pose trackingcited by 113
  12. 2022Probing Speech Emotion Recognition Transformers for Linguistic Knowledgecited by 13
1 more
  1. 2021Platform for Situated Intelligencecited by 9

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 3.

5 papers.