EEG-Based Brain-LLM Interface for Human Preference Aligned Generation
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are becoming an increasingly important component of human--computer interaction, enabling users to coordinate a wide range of intelligent agents through natural language. While language-based interfaces are powerful and flexible, they implicitly assume that users can reliably produce explicit linguistic input, an assumption that may not hold for users with speech or motor impairments, e.g., Amyotrophic Lateral Sclerosis (ALS). In this work, we investigate whether neural signals can be used as an alternative input to LLMs, particularly to support those socially marginalized or underserved users. We build a simple brain-LLM interface, which uses EEG signals to guide image generation models at test time. Specifically, we first train a classifier to estimate user satisfaction from EEG signals. Its predictions are then incorporated into a test-time scaling (TTS) framework that dynamically adapts model inference using neural feedback collected during user evaluation. The experiments show that EEG can predict user satisfaction, suggesting that neural activity carries information on real-time preference inference. These findings provide a first step toward integrating neural feedback into adaptive language-model inference, and hopefully open up new possibilities for future research on adaptive LLM interaction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 70 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
37 of 70 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2024GPT-4o System Cardcited by 4,467
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
25 more
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
- 2025Seedream 3.0 Technical Reportcited by 146
- 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 83
- 2024Visual-RolePlay: Universal Jailbreak Attack on MultiModal Large Language Models via Role-playing Image Charactercited by 61
- 2025Test-Time Preference Optimization: On-the-Fly Alignment via Iterative Textual Feedbackcited by 41
- 2024Neuro-3D: Towards 3D Visual Decoding from EEG Signalscited by 23
- 2021EEG-Transformer: Self-attention from Transformer Architecture for Decoding EEG of Imagined Speechcited by 14
- 2022Brain Topography Adaptive Network for Satisfaction Modeling in Interactive Information Access Systemcited by 3
- 2024Machine Learning to Detect Anxiety Disorders from Error-Related Negativity and EEG Signalscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025LLMs Help Alleviate the Cross-Subject Variability in Brain Signal and Language Alignment
- 2023Instruction-tuning Aligns LLMs to the Human Brain
- 2024Thought2Text: Text Generation from EEG Signal using Large Language Models (LLMs)
- 2026Cognitive Expert Language Models Better Align with the Corresponding Brain Systems
- 2025A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond
- 2024The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Units
- 2025Scaling and context steer LLMs along the same computational path as the human brain
- 2026Understanding Large Language Models