Lightweight PCGAE-Net: Parallel CrossGate Attention and Bottleneck AutoEncoder for Efficient 5G Channel Prediction
Not on the map. Why?
Abstract (arXiv)
Accurate channel state information (CSI) prediction is essential for proactive beamforming and resource management in 5G massive MIMO systems, yet the deployment of high-accuracy transformer-based predictors on base-station hardware remains challenging because the most capable models carry upwards of 30,M parameters. This paper introduces Lightweight PCGAE-Net, which addresses the efficiency problem not by post-hoc compression but by correcting two architectural flaws in the current state of the art. The first is a sequential attention ordering bias: in CS3T-UNet, group-wise temporal attention (GTA) always operates on features that have already been transformed by cross-shaped spatial attention (CSA), distorting what temporal information GTA can capture. We remove this dependency by routing both attention modules to the same layer-normalized input and combining their independent outputs through a learned per-channel sigmoid CrossGate. The second flaw is an uncompressed bottleneck: applying full self-attention at the deepest encoder stage, where channel depth reaches 4C, is quadratically expensive and carries redundant features. A Bottleneck AutoEncoder (BAE) with 1×1 convolutions halves this depth and uses an auxiliary reconstruction loss to prevent information collapse. Wrapping these components inside a shallower encoder-decoder with frequency-domain dimensionality reduction (Nf!=!32, C!=!48) produces a model with just 8.54,M parameters -- 58% fewer than the CS3T-UNet baseline -- that outperforms it by up to 3.26,dB at 5,km/h and 6.0,dB at 9,km/h in single-step prediction on QuaDriGa dataset.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 13 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
4 of 13 references.
References · 4
- 2017Attention Is All You Needcited by 60,361
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
Built on by
Not cited yet.