# Multi-Scale Attention Neural Network for Acoustic Echo Cancellation

arXiv: https://arxiv.org/abs/2106.00010 · HTML: https://mlsanity.com/paper/2106.00010/

## Key facts

- Cited by 2 papers in the map (data through 19 Oct 2026).
- First posted on arXiv 31 May 2021.

## Built on by (most cited first, 2 of 2)

- [NeuralEcho: A Self-Attentive Recurrent Neural Network For Unified Acoustic Echo Suppression And Speech Enhancement](https://mlsanity.com/paper/2205.10401/) (2022)
- [A Conformer-based Waveform-domain Neural Acoustic Echo Canceller Optimized for ASR Accuracy](https://mlsanity.com/paper/2205.03481/) (2022)

## Abstract (arXiv)

Acoustic Echo Cancellation (AEC) plays a key role in speech interaction by suppressing the echo received at microphone introduced by acoustic reverberations from loudspeakers. Since the performance of linear adaptive filter (AF) would degrade severely due to nonlinear distortions, background noises, and microphone clipping in real scenarios, deep learning has been employed for AEC for its good nonlinear modelling ability. In this paper, we constructed an end-to-end multi-scale attention neural network for AEC. Temporal convolution is first used to transform waveform into spectrogram. The spectrograms of the far-end reference and the near-end mixture are concatenated, and fed to a temporal convolution network (TCN) with stacked dilated convolution layers. Attention mechanism is performed among these representations from different layers to adaptively extract relevant features by referring to the previous hidden state in the encoder long short-term memory (LSTM) unit. The representations are weighted averaged and fed to the encoder LSTM for the near-end speech estimation. Experiments show the superiority of our method in terms of the echo return loss enhancement (ERLE) for single-talk periods and the perceptual evaluation of speech quality (PESQ) score for double-talk periods in background noise and nonlinear distortion scenarios.