# Brain Treebank: Large-scale intracranial recordings from naturalistic language stimuli

arXiv: https://arxiv.org/abs/2411.08343 · HTML: https://mlsanity.com/paper/2411.08343/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Nov 2024.

## Built on by (most cited first, 16 of 16)

- [EEG Foundation Models: A Critical Review of Current Progress and Future Directions](https://mlsanity.com/paper/2507.11783/) (2025)
- [BaRISTA: Brain Scale Informed Spatiotemporal Representation of Human Intracranial Neural Activity](https://mlsanity.com/paper/2512.12135/) (2025)
- [DIVER-1: Scaling Intracranial EEG Foundation Models for Transferable Representations](https://mlsanity.com/paper/2512.19097/) (2025)
- [The Case for Cleaner Biosignals: High-fidelity Neural Compressor Enables Transfer from Cleaner iEEG to Noisier EEG](https://mlsanity.com/paper/2502.17462/) (2025)
- [Neuroprobe: Evaluating Intracranial Brain Responses to Naturalistic Stimuli](https://mlsanity.com/paper/2509.21671/) (2025)
- [Omni-iEEG: A Large-Scale, Comprehensive iEEG Dataset and Benchmark for Epilepsy Research](https://mlsanity.com/paper/2602.16072/) (2026)
- [BrainStratify: Coarse-to-Fine Disentanglement of Intracranial Neural Dynamics](https://mlsanity.com/paper/2505.20480/) (2025)
- [Learning Time-Scale Invariant Population-Level Neural Representations](https://mlsanity.com/paper/2511.13022/) (2025)
- [Brain-to-Language Decoding: Tasks, Signals, Methods, Evaluation, Practical Use and Beyond](https://mlsanity.com/paper/2609.27650/) (2026)
- [sEEG-based Encoding for Sentence Retrieval: A Contrastive Learning Approach to Brain-Language Alignment](https://mlsanity.com/paper/2504.14468/) (2025)
- [Self-Supervised Learning via Flow-Guided Neural Operator on Time-Series Data](https://mlsanity.com/paper/2602.12267/) (2026)
- [Heterogeneous Neural Predictivity from Language Models During Naturalistic Comprehension](https://mlsanity.com/paper/2606.26880/) (2026)
- [iBrain: A Unified Foundation Model Reading the Brain from Surface to Spikes](https://mlsanity.com/paper/2609.06960/) (2026)
- [Pretraining for Sample-Efficient Neural Interfaces](https://mlsanity.com/paper/2609.13507/) (2026)
- [iMINDBench: iEEG Multi-Institution Neural Decoding Benchmark](https://mlsanity.com/paper/2609.18104/) (2026)
- [PHASE: A Physiology-Guided Hierarchical Foundation Model for Intracranial EEG](https://mlsanity.com/paper/2609.36087/) (2026)

## Abstract (arXiv)

We present the Brain Treebank, a large-scale dataset of electrophysiological neural responses, recorded from intracranial probes while 10 subjects watched one or more Hollywood movies. Subjects watched on average 2.6 Hollywood movies, for an average viewing time of 4.3 hours, and a total of 43 hours. The audio track for each movie was transcribed with manual corrections. Word onsets were manually annotated on spectrograms of the audio track for each movie. Each transcript was automatically parsed and manually corrected into the universal dependencies (UD) formalism, assigning a part of speech to every word and a dependency parse to every sentence. In total, subjects heard over 38,000 sentences (223,000 words), while they had on average 168 electrodes implanted. This is the largest dataset of intracranial recordings featuring grounded naturalistic language, one of the largest English UD treebanks in general, and one of only a few UD treebanks aligned to multimodal features. We hope that this dataset serves as a bridge between linguistic concepts, perception, and their neural representations. To that end, we present an analysis of which electrodes are sensitive to language features while also mapping out a rough time course of language processing across these electrodes. The Brain Treebank is available at https://BrainTreebank.dev/