# MAESTRO: a Multimodal Auditory-attention Egocentric Speech-TRacking Open corpus

arXiv: https://arxiv.org/abs/2609.31898 · HTML: https://mlsanity.com/paper/2609.31898/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 5 of its 43 references that are in the map.
- First posted on arXiv 25 Sep 2026.

## Builds on (most cited first, 5 of 5)

- [GPT-4o System Card](https://mlsanity.com/paper/2410.21276/) (2024)
- [EEG-based Auditory Attention Decoding: Towards Neuro-Steered Hearing Devices](https://mlsanity.com/paper/2008.04569/) (2020)
- [NeuroHeed: Neuro-Steered Speaker Extraction using EEG Signals](https://mlsanity.com/paper/2307.14303/) (2023)
- [NeuroHeed+: Improving Neuro-steered Speaker Extraction with Joint Auditory Attention Detection](https://mlsanity.com/paper/2312.07513/) (2023)
- [Predicting speech intelligibility from EEG in a non-linear classification paradigm](https://mlsanity.com/paper/2105.06844/) (2021)

## Abstract (arXiv)

Humans rely on gaze, head movements, and visual cues to attend to speakers in noisy environments, yet auditory attention decoding (AAD) has been studied primarily using electroencephalography (EEG). We introduce the Multimodal Auditory-attention Egocentric Speech-TRacking Open (MAESTRO) corpus, the first AAD dataset to simultaneously record EEG, eye gaze, pupillometry, egocentric video, and head inertial measurement unit (IMU) data. MAESTRO includes four competing speakers and background noise across multiple signal-to-noise ratio (SNR) conditions, enabling attention decoding under realistic listening scenarios. Through a four-speaker attention decoding benchmark, we show that combining behavioral and physiological signals improves decoding performance over EEG-only approaches, enabling future advances in multimodal auditory attention decoding. These findings open the door to new applications, analyses, and methodological advances in multimodal AAD. The complete dataset is publicly available at https://huggingface.co/datasets/aspire-osu/maestro-eeg-dataset . The official code repository is available at https://github.com/ASPIRE-OSU/MAESTRO .