mlsanityData to 7 Oct 2026

Bitbox: Behavioral Imaging Toolbox for Computational Analysis of Behavior from Videos

arXiv 2512.17655 ↗First posted 19 Dec 2025cs.CV q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Computational measurement of human behavior from video has recently become feasible due to major advances in AI. These advances now enable granular and precise quantification of facial expression, head movement, body action, and other behavioral modalities and are increasingly used in psychology, psychiatry, neuroscience, and mental health research. However, mainstream adoption remains slow. Most existing methods and software are developed for engineering audiences, require specialized software stacks, and fail to provide behavioral measurements at a level directly useful for hypothesis-driven research. As a result, there is a large barrier to entry for researchers who wish to use modern, AI-based tools in their work. We introduce Bitbox, an open-source toolkit designed to remove this barrier and make advanced computational analysis directly usable by behavioral scientists and clinical researchers. Bitbox is guided by principles of reproducibility, modularity, and interpretability. It provides a standardized interface for extracting high-level behavioral measurements from video, leveraging multiple face, head, and body processors. The core modules have been tested and validated on clinical samples and are designed so that new measures can be added with minimal effort. Bitbox is intended to serve both sides of the translational gap. It gives behavioral researchers access to robust, high-level behavioral metrics without requiring engineering expertise, and it provides computer scientists a practical mechanism for disseminating methods to domains where their impact is most needed. We expect that Bitbox will accelerate integration of computational behavioral measurement into behavioral, clinical, and mental health research. Bitbox has been designed from the beginning as a community-driven effort that will evolve through contributions from both method developers and domain scientists.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 89 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

15 of 89 references.

References · 15

  1. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  2. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  3. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
  4. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  5. 2018Markerless tracking of user-defined features with deep learningcited by 203
  6. 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 199
  7. 2018Face Alignment in Full Pose Range: A 3D Total Solutioncited by 147
  8. 2021Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detectioncited by 110
  9. 2025Human3R: Everyone Everywhere All at Oncecited by 35
  10. 2021Py-Feat: Python Facial Expression Analysis Toolboxcited by 33
  11. 2021How to Design a Three-Stage Architecture for Audio-Visual Active Speaker Detection in the Wildcited by 30
  12. 2023Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimationcited by 20
3 more
  1. 2023LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysiscited by 18
  2. 2025Beyond FACS: Data-driven Facial Expression Dictionaries, with Application to Predicting Autismcited by 3
  3. 2025AnxietyFaceTrack: A Smartphone-Based Non-Intrusive Approach for Detecting Social Anxiety Using Facial Featurescited by 1

Built on by

Not cited yet.