Attention Based Neural Networks for Wireless Channel Estimation
Not on the map. Why?
Abstract (arXiv)
In this paper, we deploy the self-attention mechanism to achieve improved channel estimation for orthogonal frequency-division multiplexing waveforms in the downlink. Specifically, we propose a new hybrid encoder-decoder structure (called HA02) for the first time which exploits the attention mechanism to focus on the most important input information. In particular, we implement a transformer encoder block as the encoder to achieve the sparsity in the input features and a residual neural network as the decoder respectively, inspired by the success of the attention mechanism. Using 3GPP channel models, our simulations show superior estimation performance compared with other candidate neural network methods for channel estimation.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 13 of its 21 references that are in the map. First posted on arXiv 28 Apr 2022.
Builds on
13 of 21 references.
References · 13
- 2017Attention Is All You Needcited by 59,932
- 2016Layer Normalizationcited by 5,579
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2017Non-local Neural Networkscited by 2,290
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2018Deep Learning-Based Channel Estimationcited by 75
- 2020Pruning the Pilots: Deep Learning-Based Pilot Design and Channel Estimation for MIMO-OFDM Systemscited by 18
- 2020Channel Estimation for Full-Duplex RIS-assisted HAPS Backhauling with Graph Attention Networkscited by 11
- 2021An Attention-Aided Deep Learning Framework for Massive MIMO Channel Estimationcited by 10
- 2022Low Complexity Channel estimation with Neural Network Solutionscited by 9
- 2021Deep Learning Based OFDM Channel Estimation Using Frequency-Time Division and Attention Mechanismcited by 4
1 more
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 0; 2025: 5; 2026: 2.
11 papers.
- 2023Channelformer: Attention based Neural Solution for Wireless Channel Estimation and Effective Online Trainingcited by 14
- 2023Achieving Robust Generalization for Wireless Channel Estimation Neural Networks by Designed Training Datacited by 4
- 2025Robust Channel Estimation for Optical Wireless Communications Using Neural Networkcited by 2
- 2023Joint Channel Estimation and Feedback with Masked Token Transformers in Massive MIMO Systemscited by 1
- 2025Transformer-Driven Neural Beamforming with Imperfect CSI in Urban Macro Wireless Channelscited by 1
- 2025AdaFortiTran: An Adaptive Transformer Model for Robust OFDM Channel Estimationcited by 1
- 2025Achieving Robust Channel Estimation Neural Networks by Designed Training Datacited by 1
- 2025ReQuestNet: A Foundational Learning model for Channel Estimationcited by 1
- 2022Learn to Adapt to New Environment from Past Experience and Few Pilotcited by 0
- 2026Hybrid Mamba-Attention Neural Architecture for Channel Estimationcited by 0
- 2026Brownian Bridge Diffusion-Based Joint Channel Estimation and Data Detection for Jamming-Resilient Receiverscited by 0
- 2026Brownian Bridge Diffusion-Based Joint Channel Estimation and Data Detection for Jamming-Resilient Receivers27 Jun 2026
- 2026Hybrid Mamba-Attention Neural Architecture for Channel Estimation23 Jan 2026
- 2025ReQuestNet: A Foundational Learning model for Channel Estimation12 Aug 2025
- 2025Achieving Robust Channel Estimation Neural Networks by Designed Training Data16 Jul 2025
- 2025AdaFortiTran: An Adaptive Transformer Model for Robust OFDM Channel Estimation14 May 2025
- 2025Transformer-Driven Neural Beamforming with Imperfect CSI in Urban Macro Wireless Channels15 Apr 2025
- 2025Robust Channel Estimation for Optical Wireless Communications Using Neural Network2 Apr 2025
- 2023Joint Channel Estimation and Feedback with Masked Token Transformers in Massive MIMO Systems8 Jun 2023
- 2023Channelformer: Attention based Neural Solution for Wireless Channel Estimation and Effective Online Training8 Feb 2023
- 2023Achieving Robust Generalization for Wireless Channel Estimation Neural Networks by Designed Training Data5 Feb 2023
- 2022Learn to Adapt to New Environment from Past Experience and Few Pilot2 Sep 2022