# EEGEyeNet: a Simultaneous Electroencephalography and Eye-tracking Dataset and Benchmark for Eye Movement Prediction

arXiv: https://arxiv.org/abs/2111.05100 · HTML: https://mlsanity.com/paper/2111.05100/

## Key facts

- Cited by 21 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 60 references that are in the map.
- First posted on arXiv 6 Nov 2021.

## Builds on (most cited first, 11 of 11)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift](https://mlsanity.com/paper/1502.03167/) (2015)
- [Xception: Deep Learning with Depthwise Separable Convolutions](https://mlsanity.com/paper/1610.02357/) (2016)
- [Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning](https://mlsanity.com/paper/1602.07261/) (2016)
- [Datasheets for Datasets](https://mlsanity.com/paper/1803.09010/) (2018)
- [EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces](https://mlsanity.com/paper/1611.08024/) (2016)
- [InceptionTime: Finding AlexNet for Time Series Classification](https://mlsanity.com/paper/1909.04939/) (2019)
- [Eye Tracking for Everyone](https://mlsanity.com/paper/1606.05814/) (2016)
- [ZuCo 2.0: A Dataset of Physiological Recordings During Natural Reading and Annotation](https://mlsanity.com/paper/1912.00903/) (2019)
- [ICLabel: An automated electroencephalographic independent component classifier, dataset, and website](https://mlsanity.com/paper/1901.07915/) (2019)
- [A Multimodal Approach to Estimating Vigilance Using EEG and Forehead EOG](https://mlsanity.com/paper/1611.08492/) (2016)

## Built on by (most cited first, 21 of 21)

- [A Deep Learning Approach for the Segmentation of Electroencephalography Data in Eye Tracking Applications](https://mlsanity.com/paper/2206.08672/) (2022)
- [Time Majority Voting, a PC-based EEG Classifier for Non-expert Users](https://mlsanity.com/paper/2207.12662/) (2022)
- [Trends in Machine Learning and Electroencephalogram (EEG): A Review for Undergraduate Researchers](https://mlsanity.com/paper/2307.02819/) (2023)
- [ViT2EEG: Leveraging Hybrid Pretrained Vision Transformers for EEG Data](https://mlsanity.com/paper/2308.00454/) (2023)
- [IncepSE: Leveraging InceptionTime's performance with Squeeze and Excitation mechanism in ECG analysis](https://mlsanity.com/paper/2312.09445/) (2023)
- [Vector-Based Data Improves Left-Right Eye-Tracking Classifier Performance After a Covariate Distributional Shift](https://mlsanity.com/paper/2208.00465/) (2022)
- [One step closer to EEG based eye tracking](https://mlsanity.com/paper/2303.06039/) (2023)
- [Electrode Clustering and Bandpass Analysis of EEG Data for Gaze Estimation](https://mlsanity.com/paper/2302.12710/) (2023)
- [Fusing Pretrained ViTs with TCNet for Enhanced EEG Regression](https://mlsanity.com/paper/2404.15311/) (2024)
- [Too Fine or Too Coarse? The Goldilocks Composition of Data Complexity for Robust Left-Right Eye-Tracking Classifiers](https://mlsanity.com/paper/2209.03761/) (2022)
- [Two Heads are Better than One: A Bio-inspired Method for Improving Classification on EEG-ET Data](https://mlsanity.com/paper/2304.06471/) (2023)
- [Advancing EEG-Based Gaze Prediction Using Depthwise Separable Convolution and Enhanced Pre-Processing](https://mlsanity.com/paper/2408.03480/) (2024)
- [Consumer-grade EEG-based Eye Tracking](https://mlsanity.com/paper/2503.14322/) (2025)
- [EEG-EyeTrack: A Benchmark for Time Series and Functional Data Analysis with Open Challenges and Baselines](https://mlsanity.com/paper/2504.03760/) (2025)
- [An Interpretable and Attention-based Method for Gaze Estimation Using Electroencephalography](https://mlsanity.com/paper/2308.05768/) (2023)
- [MSTAR: Multi-Scale Backbone Architecture Search for Timeseries Classification](https://mlsanity.com/paper/2402.13822/) (2024)
- [EEGMobile: Enhancing Speed and Accuracy in EEG-Based Gaze Prediction with Advanced Mobile Architectures](https://mlsanity.com/paper/2408.03449/) (2024)
- [Effect of Kernel Size on CNN-Vision-Transformer-Based Gaze Prediction Using Electroencephalography Data](https://mlsanity.com/paper/2408.03478/) (2024)
- [QSVM-QNN: Quantum Support Vector Machine Based Quantum Neural Network Learning Algorithm for Brain-Computer Interfacing Systems](https://mlsanity.com/paper/2505.14192/) (2025)
- [Detecting Reading-Induced Confusion Using EEG and Eye Tracking](https://mlsanity.com/paper/2508.14442/) (2025)
- [Semi-supervised Deep Transfer for Regression without Domain Alignment](https://mlsanity.com/paper/2509.05092/) (2025)

## Abstract (arXiv)

We present a new dataset and benchmark with the goal of advancing research in the intersection of brain activities and eye movements. Our dataset, EEGEyeNet, consists of simultaneous Electroencephalography (EEG) and Eye-tracking (ET) recordings from 356 different subjects collected from three different experimental paradigms. Using this dataset, we also propose a benchmark to evaluate gaze prediction from EEG measurements. The benchmark consists of three tasks with an increasing level of difficulty: left-right, angle-amplitude and absolute position. We run extensive experiments on this benchmark in order to provide solid baselines, both based on classical machine learning models and on large neural networks. We release our complete code and data and provide a simple and easy-to-use interface to evaluate new methods.
