mlsanityData to 7 Oct 2026

Nested Construction of Polar Codes via Transformers

arXiv 2401.17188 ↗First posted 30 Jan 2024cs.IT cs.AI math.ITcited by 2

Not on the map. Why?

Abstract (arXiv)

Tailoring polar code construction for decoding algorithms beyond successive cancellation has remained a topic of significant interest in the field. However, despite the inherent nested structure of polar codes, the use of sequence models in polar code construction is understudied. In this work, we propose using a sequence modeling framework to iteratively construct a polar code for any given length and rate under various channel conditions. Simulations show that polar codes designed via sequential modeling using transformers outperform both 5G-NR sequence and Density Evolution based approaches for both AWGN and Rayleigh fading channels.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 51 references that are in the map. First posted on arXiv 30 Jan 2024.

Builds on

26 of 51 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  4. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  5. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
  6. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 636
  7. 2022Online Decision Transformercited by 194
  8. 2019Jointly Learning to Align and Translate with Transformer Modelscited by 75
  9. 2017Deep Learning Methods for Improved Decoding of Linear Codescited by 66
  10. 2016Learning to Decode Linear Codes Using Deep Learningcited by 60
  11. 2022Error Correction Code Transformercited by 47
  12. 2018Communication Algorithms via Deep Learningcited by 42
14 more
  1. 2018Deepcode: Feedback Codes via Deep Learningcited by 41
  2. 2019ViterbiNet: A Deep Learning Based Viterbi Algorithm for Symbol Detectioncited by 25
  3. 2019Massive MIMO Channel Estimation with an Untrained Deep Neural Networkcited by 21
  4. 2021KO codes: Inventing Nonlinear Encoding and Decoding for Reliable Wireless Communication via Deep-learningcited by 16
  5. 2021ProductAE: Towards Training Larger Channel Codes based on Neural Product Codescited by 14
  6. 2019Deep Learning-based Polar Code Designcited by 9
  7. 2020Construction of Polar Codes with Reinforcement Learningcited by 7
  8. 2022CRISP: Curriculum based Sequential Neural Decoders for Polar Code Familycited by 5
  9. 2019Decoder-tailored Polar Code Design Using the Genetic Algorithmcited by 4
  10. 2022Interpreting Neural Min-Sum Decoderscited by 3
  11. 2022TinyTurbo: Efficient Turbo Decoders on Edgecited by 3
  12. 2023Data-Driven Neural Polar Codes for Unknown Channels With and Without Memorycited by 3
  13. 2019Reinforcement Learning for Nested Polar Code Constructioncited by 2
  14. 2023Deep Polar Codescited by 2

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.

  1. 2024LightCode: Light Analytical and Neural Codes for Channels with Feedbackcited by 4
  2. 2024DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep Learningcited by 1