mlsanityData to 14 Oct 2026

DRF Codes: Deep SNR-Robust Feedback Codes

arXiv 2112.11789 ↗First posted 22 Dec 2021cs.IT cs.LG eess.SPcited by 5

Not on the map. Why?

Abstract (arXiv)

We present a new deep-neural-network (DNN) based error correction code for fading channels with output feedback, called deep SNR-robust feedback (DRF) code. At the encoder, parity symbols are generated by a long short term memory (LSTM) network based on the message as well as the past forward channel outputs observed by the transmitter in a noisy fashion. The decoder uses a bi-directional LSTM architecture along with a signal to noise ratio (SNR)-aware attention NN to decode the message. The proposed code overcomes two major shortcomings of the previously proposed DNN-based codes over channels with passive output feedback: (i) the SNR-aware attention mechanism at the decoder enables reliable application of the same trained NN over a wide range of SNR values; (ii) curriculum training with batch-size scheduling is used to speed up and stabilize training while improving the SNR-robustness of the resulting code. We show that the DRF codes significantly outperform state-of-the-art in terms of both the SNR-robustness and the error rate in additive white Gaussian noise (AWGN) channel with feedback. In fading channels with perfect phase compensation at the receiver, DRF codes learn to efficiently exploit knowledge of the instantaneous fading amplitude (which is available to the encoder through feedback) to reduce the overhead and complexity associated with channel estimation at the decoder. Finally, we show the effectiveness of DRF codes in multicast channels with feedback, where linear feedback codes are known to be strictly suboptimal.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 11 of its 38 references that are in the map. First posted on arXiv 22 Dec 2021.

Builds on

11 of 38 references.

References · 11

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  4. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
  5. 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
  6. 2015LSTM: A Search Space Odysseycited by 316
  7. 2017Automated Curriculum Learning for Neural Networkscited by 257
  8. 2017Structured Attention Networkscited by 95
  9. 2017Massive Exploration of Neural Machine Translation Architecturescited by 55
  10. 2018Deepcode: Feedback Codes via Deep Learningcited by 42
  11. 2021Deep Extended Feedback Codescited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 0; 2024: 1; 2025: 0; 2026: 1.

5 papers.