mlsanityData to 14 Oct 2026

REVELIO -- Universal Multimodal Task Load Estimation for Cross-Domain Generalization

arXiv 2509.01642 ↗First posted 1 Sep 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Task load detection is essential for optimizing human performance across diverse applications, yet current models often lack generalizability beyond narrow experimental domains. While prior research has focused on individual tasks and limited modalities, there remains a gap in evaluating model robustness and transferability in real-world scenarios. This paper addresses these limitations by introducing a new multimodal dataset that extends established cognitive load detection benchmarks with a real-world gaming application, using the n-back test as a scientific foundation. Task load annotations are derived from objective performance, subjective NASA-TLX ratings, and task-level design, enabling a comprehensive evaluation framework. State-of-the-art end-to-end model, including xLSTM, ConvNeXt, and Transformer architectures are systematically trained and evaluated on multiple modalities and application domains to assess their predictive performance and cross-domain generalization. Results demonstrate that multimodal approaches consistently outperform unimodal baselines, with specific modalities and model architectures showing varying impact depending on the application subset. Importantly, models trained on one domain exhibit reduced performance when transferred to novel applications, underscoring remaining challenges for universal cognitive load estimation. These findings provide robust baselines and actionable insights for developing more generalizable cognitive load detection systems, advancing both research and practical implementation in human-computer interaction and adaptive systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 72 references that are in the map. First posted on arXiv 1 Sep 2025.

Builds on

15 of 72 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2017On Calibration of Modern Neural Networkscited by 4,960
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  5. 2022A ConvNet for the 2020scited by 3,579
  6. 2016Deep Networks with Stochastic Depthcited by 979
  7. 2022Transformers in Time Series: A Surveycited by 497
  8. 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 360
  9. 2024xLSTM: Extended Long Short-Term Memorycited by 327
  10. 2020img2pose: Face Alignment and Detection via 6DoF, Face Pose Estimationcited by 58
  11. 2021Py-Feat: Python Facial Expression Analysis Toolboxcited by 33
  12. 2021The Arousal video Game AnnotatIoN (AGAIN) Datasetcited by 18
3 more
  1. 2021MAUS: A Dataset for Mental Workload Assessmenton N-back Task Using Wearable Sensorcited by 7
  2. 2020Collection and Validation of Psychophysiological Data from Professional and Amateur Players: a Multimodal eSports Datasetcited by 6
  3. 2022MOCAS: A Multimodal Dataset for Objective Cognitive Workload Assessment on Simultaneous Taskscited by 3

Built on by

Not cited yet.