Decoding Linguistic Representations of Human Brain
Not on the map. Why?
Abstract (arXiv)
Language, as an information medium created by advanced organisms, has always been a concern of neuroscience regarding how it is represented in the brain. Decoding linguistic representations in the evoked brain has shown groundbreaking achievements, thanks to the rapid improvement of neuroimaging, medical technology, life sciences and artificial intelligence. In this work, we present a taxonomy of brain-to-language decoding of both textual and speech formats. This work integrates two types of research: neuroscience focusing on language understanding and deep learning-based brain decoding. Generating discernible language information from brain activity could not only help those with limited articulation, especially amyotrophic lateral sclerosis (ALS) patients but also open up a new way for the next generation's brain-computer interface (BCI). This article will help brain scientists and deep-learning researchers to gain a bird's eye view of fine-grained language perception, and thus facilitate their further investigation and research of neural process and language decoding.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 166 references that are in the map. First posted on arXiv 30 Jul 2024.
Builds on
42 of 166 references.
References · 42
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2017Neural Discrete Representation Learningcited by 4,650
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
30 more
- 2023OneLLM: One Framework to Align All Modalities with Languagecited by 185
- 2022Decoding speech perception from non-invasive brain recordingscited by 129
- 2023Scaling laws for language encoding models in fMRIcited by 68
- 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
- 2019ZuCo 2.0: A Dataset of Physiological Recordings During Natural Reading and Annotationcited by 65
- 2021Relating transformers to models and neural representations of the hippocampal formationcited by 62
- 2023VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Priorcited by 47
- 2021Disentangling Syntax and Semantics in the Brain with Deep Networkscited by 39
- 2019Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brainscited by 37
- 2019Linking artificial and human neural representations of languagecited by 37
- 2024Selecting Large Language Model to Fine-tune via Rectified Scaling Lawcited by 33
- 2024Are EEG-to-Text Models Working?cited by 32
- 2023UniCoRN: Unified Cognitive Signal ReconstructioN bridging cognitive signals and human languagecited by 22
- 2020Brain2Word: Decoding Brain Activity for Language Generationcited by 15
- 2024MAD: Multi-Alignment MEG-to-Text Decodingcited by 14
- 2019Relating Simple Sentence Representations in Deep Neural Networks and the Braincited by 10
- 2023Coupling Artificial Neurons in BERT and Biological Neurons in the Human Braincited by 9
- 2024Open-vocabulary Auditory Neural Decoding Using fMRI-prompted LLMcited by 9
- 2017Experiential, Distributional and Dependency-based Word Embeddings have Complementary Roles in Decoding Brain Activitycited by 8
- 2020Speech Synthesis using EEGcited by 8
- 2023Eeg2vec: Self-Supervised Electroencephalographic Representation Learningcited by 8
- 2019Brain2Char: A Deep Architecture for Decoding Text from Brain Recordingscited by 7
- 2021End-to-end translation of human neural activity to speech with a dual-dual generative adversarial networkcited by 6
- 2022Learning Subject-Invariant Representations from Speech-Evoked EEG Using Variational Autoencoderscited by 5
- 2024Towards an End-to-End Framework for Invasive Brain Signal Decoding with Large Language Modelscited by 4
- 2020Advancing Speech Synthesis using EEGcited by 3
- 2019Hierarchical Deep Feature Learning For Decoding Imagined Speech From EEGcited by 2
- 2024How Many Bytes Can You Take Out Of Brain-To-Text Decoding?cited by 2
- 2019State-of-the-art Speech Recognition using EEG and Towards Decoding of Speech Spectrum From EEGcited by 1
- 2024Improving Speech Decoding from ECoG with Self-Supervised Pretrainingcited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.