# A Multimodal Approach to Estimating Vigilance Using EEG and Forehead EOG

arXiv: https://arxiv.org/abs/1611.08492 · HTML: https://mlsanity.com/paper/1611.08492/

## Key facts

- Cited by 33 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 25 Nov 2016.

## Built on by (most cited first, 30 of 33)

- [CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decoding](https://mlsanity.com/paper/2506.23075/) (2025)
- [EEGEyeNet: a Simultaneous Electroencephalography and Eye-tracking Dataset and Benchmark for Eye Movement Prediction](https://mlsanity.com/paper/2111.05100/) (2021)
- [AdaBrain-Bench: Benchmarking Brain Foundation Models for Brain-Computer Interface Applications](https://mlsanity.com/paper/2507.09882/) (2025)
- [Efficacy of Transformer Networks for Classification of Raw EEG Data](https://mlsanity.com/paper/2202.05170/) (2022)
- [Distilling EEG Representations via Capsules for Affective Computing](https://mlsanity.com/paper/2105.00104/) (2021)
- [OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models](https://mlsanity.com/paper/2606.00815/) (2026)
- [Domain Adaptation and Generalization on Functional Medical Images: A Systematic Survey](https://mlsanity.com/paper/2212.03176/) (2022)
- [SAMBA: Toward a Long-Context EEG Foundation Model via Spatial Embedding and Differential Mamba](https://mlsanity.com/paper/2511.18571/) (2025)
- [Mind-to-Face: Neural-Driven Photorealistic Avatar Synthesis via EEG Decoding](https://mlsanity.com/paper/2512.04313/) (2025)
- [Brain-OF: An Omnifunctional Foundation Model for fMRI, EEG and MEG](https://mlsanity.com/paper/2602.23410/) (2026)
- [Utilizing Cognitive Signals Generated during Human Reading to Enhance Keyphrase Extraction from Microblogs](https://mlsanity.com/paper/2606.26485/) (2026)
- [Spatio-Temporal Analysis of Transformer based Architecture for Attention Estimation from EEG](https://mlsanity.com/paper/2204.07162/) (2022)
- [Adaptive Modality Balanced Online Knowledge Distillation for Brain-Eye-Computer based Dim Object Detection](https://mlsanity.com/paper/2407.01894/) (2024)
- [UL-DD: A Multimodal Drowsiness Dataset Using Video, Biometric Signals, and Behavioral Data](https://mlsanity.com/paper/2507.13403/) (2025)
- [Modified TSception for Analyzing Driver Drowsiness and Mental Workload from EEG](https://mlsanity.com/paper/2512.21747/) (2025)
- [SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decoding](https://mlsanity.com/paper/2603.16739/) (2026)
- [MSBraM: A Multi-scale Self-supervised Brain Foundation Model for Hierarchical EEG Dynamics Learning](https://mlsanity.com/paper/2607.21402/) (2026)
- [Where Is My Mind (looking at)? Predicting Visual Attention from Brain Activity](https://mlsanity.com/paper/2201.03902/) (2022)
- [Studying Drowsiness Detection Performance while Driving through Scalable Machine Learning Models using Electroencephalography](https://mlsanity.com/paper/2209.04048/) (2022)
- [EEG-Fest: Few-shot based Attention Network for Driver's Vigilance Estimation with EEG Signals](https://mlsanity.com/paper/2211.03878/) (2022)
- [Systematic Review of Experimental Paradigms and Deep Neural Networks for Electroencephalography-Based Cognitive Workload Detection](https://mlsanity.com/paper/2309.07163/) (2023)
- [Towards Autonomous Riding: A Review of Perception, Planning, and Control in Intelligent Two-Wheelers](https://mlsanity.com/paper/2507.11852/) (2025)
- [Understanding Mental States in Active and Autonomous Driving with EEG](https://mlsanity.com/paper/2512.09190/) (2025)
- [Fusion of Multiscale Features Via Centralized Sparse-attention Network for EEG Decoding](https://mlsanity.com/paper/2512.18689/) (2025)
- [Backpropagation-Free Test-Time Adaptation for Lightweight EEG-Based Brain-Computer Interfaces](https://mlsanity.com/paper/2601.07556/) (2026)
- [Bidirectional Temporal Dynamics Modeling for EEG-based Driving Fatigue Recognition](https://mlsanity.com/paper/2602.14071/) (2026)
- [CoCoT-EEG: Contrastive-Pretrained Multiscale Convolutional Transformer for EEG Decoding](https://mlsanity.com/paper/2607.09543/) (2026)
- [S-CEReBrO: Breaking the Memory Barrier in Continuous EEG Monitoring](https://mlsanity.com/paper/2607.27913/) (2026)
- [STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decoding](https://mlsanity.com/paper/2608.02070/) (2026)
- [BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understanding](https://mlsanity.com/paper/2608.04156/) (2026)

## Abstract (arXiv)

Objective. Covert aspects of ongoing user mental states provide key context information for user-aware human computer interactions. In this paper, we focus on the problem of estimating the vigilance of users using EEG and EOG signals. Approach. To improve the feasibility and wearability of vigilance estimation devices for real-world applications, we adopt a novel electrode placement for forehead EOG and extract various eye movement features, which contain the principal information of traditional EOG. We explore the effects of EEG from different brain areas and combine EEG and forehead EOG to leverage their complementary characteristics for vigilance estimation. Considering that the vigilance of users is a dynamic changing process because the intrinsic mental states of users involve temporal evolution, we introduce continuous conditional neural field and continuous conditional random field models to capture dynamic temporal dependency. Main results. We propose a multimodal approach to estimating vigilance by combining EEG and forehead EOG and incorporating the temporal dependency of vigilance into model training. The experimental results demonstrate that modality fusion can improve the performance compared with a single modality, EOG and EEG contain complementary information for vigilance estimation, and the temporal dependency-based models can enhance the performance of vigilance estimation. From the experimental results, we observe that theta and alpha frequency activities are increased, while gamma frequency activities are decreased in drowsy states in contrast to awake states. Significance. The forehead setup allows for the simultaneous collection of EEG and EOG and achieves comparative performance using only four shared electrodes in comparison with the temporal and posterior sites.