mlsanityData to 14 Oct 2026

Replaying the Movie in Your Mind Decoding Dynamic Visual Perception and Recall from EEG

arXiv 2610.13120 ↗First posted 9 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Decoding dynamic visual content from EEG has advanced rapidly for visual perception, yet it remains unclear which aspects of neural representations are preserved when people internally replay dynamic scenes. We introduce PAIR, an EEG benchmark collected from 20 participants using an interleaved, clip-wise paradigm that pairs naturalistic video viewing with immediate visual recall. This design enables a comparison between externally driven perception and internally generated recall for the same stimulus content within a fixed trial sequence. We benchmark multiple decoding models on hierarchical semantic classification at both fine-grained and coarse-grained levels, meta-feature decoding tasks covering motion, color, object number, face, and human presence, and a state-decoding task that discriminates perception from recall. Within-subject validation results show numerically similar performance for several model--task combinations, alongside higher perception accuracy in two coarse-grained comparisons after multiple-comparison correction. In contrast, perception and recall are highly separable at the state level under the present validation protocol. State accuracy remains high after alpha-band ablation, although this does not exclude ocular or other task-related contributions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

13 of 32 references.

References · 13

  1. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  2. 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorscited by 160
  3. 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusioncited by 81
  4. 2016Deep Learning Human Mind for Automated Visual Classificationcited by 77
  5. 2016Neural Encoding and Decoding with Deep Learning for Dynamic Natural Visioncited by 60
  6. 2017Spatial-Temporal Recurrent Neural Network for Emotion Recognitioncited by 38
  7. 2021Reconstructing Perceptive Images from Brain Activity by Shape-Semantic GANcited by 32
  8. 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Informationcited by 28
  9. 2024NeuroClips: Towards High-fidelity and Smooth fMRI-to-Video Reconstructioncited by 26
  10. 2019Temporal Graph Convolutional Networks for Automatic Seizure Detectioncited by 21
  11. 2025BrainFLORA: Uncovering Brain Concept Representation via Multimodal Neural Embeddingscited by 6
  12. 2025MindCross: Fast New Subject Adaptation with Limited Data for Cross-subject Video Reconstruction from Brain Signalscited by 5
1 more
  1. 2026MindCine: Multimodal EEG-to-Video Reconstruction with Large-Scale Pretrained Modelscited by 1

Built on by

Not cited yet.