mlsanityData to 7 Oct 2026

Expectation and Acoustic Neural Network Representations Enhance Music Identification from Brain Activity

arXiv 2603.03190 ↗First posted 3 Mar 2026cs.AI q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

During music listening, cortical activity encodes both acoustic and expectation-related information. Prior work has shown that ANN representations resemble cortical representations and can serve as supervisory signals for EEG recognition. Here we show that distinguishing acoustic and expectation-related ANN representations as teacher targets improves EEG-based music identification. Models pretrained to predict either representation outperform non-pretrained baselines, and combining them yields complementary gains that exceed strong seed ensembles formed by varying random initializations. These findings show that teacher representation type shapes downstream performance and that representation learning can be guided by neural encoding. This work points toward advances in predictive music cognition and neural decoding. Our expectation representation, computed directly from raw signals without manual labels, reflects predictive structure beyond onset or pitch, enabling investigation of multilayer predictive encoding across diverse stimuli. Its scalability to large, diverse datasets further suggests potential for developing general-purpose EEG models grounded in cortical encoding principles.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 76 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

26 of 76 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  5. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  6. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  7. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
  8. 2020Jukebox: A Generative Model for Musiccited by 535
  9. 2023Simple and Controllable Music Generationcited by 480
  10. 2023MusicLM: Generating Music From Textcited by 442
  11. 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
  12. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
14 more
  1. 2018Music Transformercited by 207
  2. 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 175
  3. 2022Decoding speech perception from non-invasive brain recordingscited by 129
  4. 2022Disentangled Representation Learningcited by 111
  5. 2022MuLan: A Joint Embedding of Music Audio and Natural Languagecited by 85
  6. 2025MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantizationcited by 66
  7. 2022Toward a realistic model of speech processing in the brain with self-supervised learningcited by 63
  8. 2023Natural Language Supervision for General-Purpose Audio Representationscited by 60
  9. 2023A Foundation Model for Music Informaticscited by 45
  10. 2023MARBLE: Music Audio Representation Benchmark for Universal Evaluationcited by 38
  11. 2022Self-supervised models of audio effectively explain human cortical responses to speechcited by 37
  12. 2022SupMAE: Supervised Masked Autoencoders Are Efficient Vision Learnerscited by 21
  13. 2023Deep Neural Networks and Brain Alignment: Brain Encoding and Decoding (Survey)cited by 20
  14. 2024Predicting Artificial Neural Network Representations to Learn Recognition Model for Music Identification from Brain Recordingscited by 3

Built on by

Not cited yet.