mlsanityData to 7 Oct 2026

EEG Emotion Copilot: Optimizing Lightweight LLMs for Emotional EEG Interpretation with Assisted Medical Record Generation

arXiv 2410.00166 ↗First posted 30 Sep 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

In the fields of affective computing (AC) and brain-machine interface (BMI), the analysis of physiological and behavioral signals to discern individual emotional states has emerged as a critical research frontier. While deep learning-based approaches have made notable strides in EEG emotion recognition, particularly in feature extraction and pattern recognition, significant challenges persist in achieving end-to-end emotion computation, including real-time processing, individual adaptation, and seamless user interaction. This paper presents the EEG Emotion Copilot, a system optimizing a lightweight large language model (LLM) with 0.5B parameters operating in a local setting, which first recognizes emotional states directly from EEG signals, subsequently generates personalized diagnostic and treatment suggestions, and finally supports the automation of assisted electronic medical records. Specifically, we demonstrate the critical techniques in the novel data structure of prompt, model pruning and fine-tuning training, and deployment strategies aiming at improving real-time performance and computational efficiency. Extensive experiments show that our optimized lightweight LLM-based copilot achieves an enhanced intuitive interface for participant interaction, superior accuracy of emotion recognition and assisted electronic medical records generation, in comparison to such models with similar scale parameters or large-scale parameters such as 1.5B, 1.8B, 3B and 7B. In summary, through these efforts, the proposed copilot is expected to advance the application of AC in the medical domain, offering innovative solution to mental health monitoring. The codes will be released at https://github.com/NZWANG/EEG_Emotion_Copilot.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 31 of its 77 references that are in the map. First posted on arXiv 30 Sep 2024.

Builds on

31 of 77 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2016Pointer Sentinel Mixture Modelscited by 2,992
  4. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  5. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  6. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  7. 2024Qwen2 Technical Reportcited by 2,076
  8. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  9. 2016Pruning Filters for Efficient ConvNetscited by 1,129
  10. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,090
  11. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  12. 2019Are Sixteen Heads Really Better than One?cited by 803
19 more
  1. 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 643
  2. 2018Rethinking the Value of Network Pruningcited by 595
  3. 2020What is the State of Neural Network Pruning?cited by 578
  4. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
  5. 2024TrustLLM: Trustworthiness in Large Language Modelscited by 280
  6. 2019MetaPruning: Meta Learning for Automatic Neural Network Channel Pruningcited by 226
  7. 2023DepGraph: Towards Any Structural Pruningcited by 202
  8. 2019Structured Pruning of Large Language Modelscited by 201
  9. 2023Structured Pruning for Deep Convolutional Neural Networks: A surveycited by 122
  10. 2023Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipelinecited by 86
  11. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 83
  12. 2023Large Language Models Enable Few-Shot Clusteringcited by 72
  13. 2022A Systematic Review on Affective Computing: Emotion Models, Databases, and Recent Advancescited by 59
  14. 2024Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Lengthcited by 46
  15. 2016Interpretable Deep Neural Networks for Single-Trial EEG Classificationcited by 24
  16. 2024A Tale of Single-channel Electroencephalogram: Devices, Datasets, Signal Processing, Applications, and Future Directionscited by 13
  17. 2023Large Transformers are Better EEG Learnerscited by 10
  18. 2024Improving Large Language Model (LLM) fidelity through context-aware grounding: A systematic approach to reliability and veracitycited by 8
  19. 2024You Only Acquire Sparse-channel (YOAS): A Unified Framework for Dense-channel EEG Generationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.