mlsanityData to 7 Oct 2026

DISCOVER: A Data-driven Interactive System for Comprehensive Observation, Visualization, and ExploRation of Human Behaviour

arXiv 2407.13408 ↗First posted 18 Jul 2024cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding human behavior is a fundamental goal of social sciences, yet its analysis presents significant challenges. Conventional methodologies employed for the study of behavior, characterized by labor-intensive data collection processes and intricate analyses, frequently hinder comprehensive exploration due to their time and resource demands. In response to these challenges, computational models have proven to be promising tools that help researchers analyze large amounts of data by automatically identifying important behavioral indicators, such as social signals. However, the widespread adoption of such state-of-the-art computational models is impeded by their inherent complexity and the substantial computational resources necessary to run them, thereby constraining accessibility for researchers without technical expertise and adequate equipment. To address these barriers, we introduce DISCOVER -- a modular and flexible, yet user-friendly software framework specifically developed to streamline computational-driven data exploration for human behavior analysis. Our primary objective is to democratize access to advanced computational methodologies, thereby enabling researchers across disciplines to engage in detailed behavioral analysis without the need for extensive technical proficiency. In this paper, we demonstrate the capabilities of DISCOVER using four exemplary data exploration workflows that build on each other: Interactive Semantic Content Exploration, Visual Inspection, Aided Annotation, and Multimodal Scene Search. By illustrating these workflows, we aim to emphasize the versatility and accessibility of DISCOVER as a comprehensive framework and propose a set of blueprints that can serve as a general starting point for exploratory data analysis.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 45 references that are in the map. First posted on arXiv 18 Jul 2024.

Builds on

16 of 45 references.

References · 16

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
  5. 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 262
  6. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 190
  7. 2022Dawn of the transformer era in speech emotion recognition: closing the valence gapcited by 155
  8. 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
  9. 2021End-to-end speaker segmentation for overlap-aware resegmentationcited by 76
  10. 2019Real-time Facial Surface Geometry from Monocular Video on Mobile GPUscited by 72
  11. 2023Transforming Sentiment Analysis in the Financial Domain with ChatGPTcited by 25
  12. 2023Comparing Abstractive Summaries Generated by ChatGPT to Real Summaries Through Blinded Reviewers and Text Classification Algorithmscited by 15
4 more
  1. 2021Platform for Situated Intelligencecited by 9
  2. 2019REsCUE: A framework for REal-time feedback on behavioral CUEs using multimodal anomaly detectioncited by 7
  3. 2024The AffectToolbox: Affect Analysis for Everyonecited by 5
  4. 2024WIBA: What Is Being Argued? A Comprehensive Approach to Argument Miningcited by 2

Built on by

Not cited yet.