REVELIO -- Universal Multimodal Task Load Estimation for Cross-Domain Generalization
Oppelt, Maximilian P., Foltyn, Andreas, Lang-Richter, Nadine R., Eskofier, Bjoern M.
–arXiv.org Artificial Intelligence
Task load detection is essential for optimizing human performance across diverse applications, yet current models often lack generalizability beyond narrow experimental domains. While prior research has focused on individual tasks and limited modalities, there remains a gap in evaluating model robustness and transferability in real-world scenarios. This paper addresses these limitations by introducing a new multimodal dataset that extends established cognitive load detection benchmarks with a real-world gaming application, using the $n$-back test as a scientific foundation. Task load annotations are derived from objective performance, subjective NASA-TLX ratings, and task-level design, enabling a comprehensive evaluation framework. State-of-the-art end-to-end model, including xLSTM, ConvNeXt, and Transformer architectures are systematically trained and evaluated on multiple modalities and application domains to assess their predictive performance and cross-domain generalization. Results demonstrate that multimodal approaches consistently outperform unimodal baselines, with specific modalities and model architectures showing varying impact depending on the application subset. Importantly, models trained on one domain exhibit reduced performance when transferred to novel applications, underscoring remaining challenges for universal cognitive load estimation. These findings provide robust baselines and actionable insights for developing more generalizable cognitive load detection systems, advancing both research and practical implementation in human-computer interaction and adaptive systems.
arXiv.org Artificial Intelligence
Sep-3-2025
- Country:
- Asia
- China > Shaanxi Province
- Xi'an (0.04)
- Macao (0.04)
- Middle East > Jordan (0.04)
- China > Shaanxi Province
- Europe
- Denmark > Capital Region
- Copenhagen (0.04)
- Finland > Uusimaa
- Helsinki (0.04)
- Germany
- Bavaria
- Middle Franconia > Nuremberg (0.04)
- Upper Bavaria > Munich (0.04)
- North Rhine-Westphalia > Upper Bavaria
- Munich (0.04)
- Bavaria
- United Kingdom > England
- Cambridgeshire > Cambridge (0.04)
- Denmark > Capital Region
- North America
- Canada
- Alberta > Census Division No. 15
- Improvement District No. 9 > Banff (0.04)
- Quebec > Montreal (0.04)
- Alberta > Census Division No. 15
- United States
- Alaska > Anchorage Municipality
- Anchorage (0.04)
- California > San Diego County
- San Diego (0.04)
- Tennessee > Davidson County
- Nashville (0.04)
- Alaska > Anchorage Municipality
- Canada
- Oceania > Australia
- Australian Capital Territory > Canberra (0.04)
- Asia
- Genre:
- Research Report
- Experimental Study (1.00)
- New Finding (1.00)
- Research Report
- Industry:
- Education > Assessment & Standards (0.67)
- Health & Medicine
- Consumer Health (1.00)
- Health Care Technology (1.00)
- Therapeutic Area > Cardiology/Vascular Diseases (0.68)
- Information Technology (1.00)
- Leisure & Entertainment > Games
- Computer Games (1.00)
- Technology:
- Information Technology
- Artificial Intelligence
- Cognitive Science (1.00)
- Machine Learning
- Neural Networks > Deep Learning (1.00)
- Performance Analysis > Accuracy (0.93)
- Natural Language (1.00)
- Robots (1.00)
- Vision > Face Recognition (0.93)
- Human Computer Interaction > Interfaces (0.88)
- Artificial Intelligence
- Information Technology