mlsanityData to 14 Oct 2026

EEGDiR: Electroencephalogram denoising network for temporal information storage and global modeling through Retentive Network

arXiv 2404.15289 ↗First posted 20 Mar 2024eess.SP cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Electroencephalogram (EEG) signals play a pivotal role in clinical medicine, brain research, and neurological disease studies. However, susceptibility to various physiological and environmental artifacts introduces noise in recorded EEG data, impeding accurate analysis of underlying brain activity. Denoising techniques are crucial to mitigate this challenge. Recent advancements in deep learningbased approaches exhibit substantial potential for enhancing the signal-to-noise ratio of EEG data compared to traditional methods. In the realm of large-scale language models (LLMs), the Retentive Network (Retnet) infrastructure, prevalent for some models, demonstrates robust feature extraction and global modeling capabilities. Recognizing the temporal similarities between EEG signals and natural language, we introduce the Retnet from natural language processing to EEG denoising. This integration presents a novel approach to EEG denoising, opening avenues for a profound understanding of brain activities and accurate diagnosis of neurological diseases. Nonetheless, direct application of Retnet to EEG denoising is unfeasible due to the one-dimensional nature of EEG signals, while natural language processing deals with two-dimensional data. To facilitate Retnet application to EEG denoising, we propose the signal embedding method, transforming one-dimensional EEG signals into two dimensions for use as network inputs. Experimental results validate the substantial improvement in denoising effectiveness achieved by the proposed method.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 14 of its 46 references that are in the map. First posted on arXiv 20 Mar 2024.

Builds on

14 of 46 references.

References · 14

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  5. 2016Layer Normalizationcited by 5,669
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  7. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  8. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  9. 2018Group Normalizationcited by 1,524
  10. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 613
  11. 2014Recurrent Neural Network Regularizationcited by 189
  12. 2022Understanding AdamW through Proximal Methods and Scale-Freenesscited by 46
2 more
  1. 2021EEGDnet: Fusing Non-Local and Local Self-Similarity for 1-D EEG Signal Denoising with 2-D Transformercited by 11
  2. 2020Deep learning denoising for EOG artifacts removal from EEG signalscited by 6

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.