# ART: Artifact Removal Transformer for Reconstructing Noise-Free Multichannel Electroencephalographic Signals

arXiv: https://arxiv.org/abs/2409.07326 · HTML: https://mlsanity.com/paper/2409.07326/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 27 of its 77 references that are in the map.
- First posted on arXiv 11 Sep 2024.

## Builds on (most cited first, 27 of 27)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Robust Speech Recognition via Large-Scale Weak Supervision](https://mlsanity.com/paper/2212.04356/) (2022)
- [UNet++: A Nested U-Net Architecture for Medical Image Segmentation](https://mlsanity.com/paper/1807.10165/) (2018)
- [Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned](https://mlsanity.com/paper/1905.09418/) (2019)
- [EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces](https://mlsanity.com/paper/1611.08024/) (2016)
- [Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network](https://mlsanity.com/paper/1808.03314/) (2018)
- [Improving the Robustness of Deep Neural Networks via Stability Training](https://mlsanity.com/paper/1604.04326/) (2016)
- [Deep learning-based electroencephalography analysis: a systematic review](https://mlsanity.com/paper/1901.05498/) (2019)
- [On the Generalization Benefit of Noise in Stochastic Gradient Descent](https://mlsanity.com/paper/2006.15081/) (2020)
- [Multi-Head Attention: Collaborate Instead of Concatenate](https://mlsanity.com/paper/2006.16362/) (2020)
- [Regularizing Deep Neural Networks by Noise: Its Interpretation and Optimization](https://mlsanity.com/paper/1710.05179/) (2017)
- [EEG-GAN: Generative adversarial networks for electroencephalograhic (EEG) brain signals](https://mlsanity.com/paper/1806.01875/) (2018)
- [ICLabel: An automated electroencephalographic independent component classifier, dataset, and website](https://mlsanity.com/paper/1901.07915/) (2019)
- [EEGdenoiseNet: A benchmark dataset for end-to-end deep learning solutions of EEG denoising](https://mlsanity.com/paper/2009.11662/) (2020)
- [Multi-channel EEG recordings during a sustained-attention driving task](https://mlsanity.com/paper/1809.06534/) (2018)
- [BETA: A Large Benchmark Database Toward SSVEP-BCI Application](https://mlsanity.com/paper/1911.13045/) (2019)
- [Feature Learning from Incomplete EEG with Denoising Autoencoder](https://mlsanity.com/paper/1410.0818/) (2014)
- [A novel convolutional neural network model to remove muscle artifacts from EEG](https://mlsanity.com/paper/2010.11709/) (2020)
- [EEGDnet: Fusing Non-Local and Local Self-Similarity for 1-D EEG Signal Denoising with 2-D Transformer](https://mlsanity.com/paper/2109.04235/) (2021)
- [Addressing Class Imbalance in Classification Problems of Noisy Signals by using Fourier Transform Surrogates](https://mlsanity.com/paper/1806.08675/) (2018)
- [IC-U-Net: A U-Net-based Denoising Autoencoder Using Mixtures of Independent Components for Automatic EEG Artifact Removal](https://mlsanity.com/paper/2111.10026/) (2021)
- [Deep Feature Learning for EEG Recordings](https://mlsanity.com/paper/1511.04306/) (2015)
- [Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling](https://mlsanity.com/paper/2106.10840/) (2021)
- [Ballistocardiogram artifact reduction in simultaneous EEG-fMRI using deep learning](https://mlsanity.com/paper/1910.06659/) (2019)

## Abstract (arXiv)

Artifact removal in electroencephalography (EEG) is a longstanding challenge that significantly impacts neuroscientific analysis and brain-computer interface (BCI) performance. Tackling this problem demands advanced algorithms, extensive noisy-clean training data, and thorough evaluation strategies. This study presents the Artifact Removal Transformer (ART), an innovative EEG denoising model employing transformer architecture to adeptly capture the transient millisecond-scale dynamics characteristic of EEG signals. Our approach offers a holistic, end-to-end denoising solution for diverse artifact types in multichannel EEG data. We enhanced the generation of noisy-clean EEG data pairs using an independent component analysis, thus fortifying the training scenarios critical for effective supervised learning. We performed comprehensive validations using a wide range of open datasets from various BCI applications, employing metrics like mean squared error and signal-to-noise ratio, as well as sophisticated techniques such as source localization and EEG component classification. Our evaluations confirm that ART surpasses other deep-learning-based artifact removal methods, setting a new benchmark in EEG signal processing. This advancement not only boosts the accuracy and reliability of artifact removal but also promises to catalyze further innovations in the field, facilitating the study of brain dynamics in naturalistic environments.