KO codes: Inventing Nonlinear Encoding and Decoding for Reliable Wireless Communication via Deep-learning
Not on the map. Why?
Abstract (arXiv)
Landmark codes underpin reliable physical layer communication, e.g., Reed-Muller, BCH, Convolution, Turbo, LDPC and Polar codes: each is a linear code and represents a mathematical breakthrough. The impact on humanity is huge: each of these codes has been used in global wireless communication standards (satellite, WiFi, cellular). Reliability of communication over the classical additive white Gaussian noise (AWGN) channel enables benchmarking and ranking of the different codes. In this paper, we construct KO codes, a computationaly efficient family of deep-learning driven (encoder, decoder) pairs that outperform the state-of-the-art reliability performance on the standardized AWGN channel. KO codes beat state-of-the-art Reed-Muller and Polar codes, under the low-complexity successive cancellation decoding, in the challenging short-to-medium block length regime on the AWGN channel. We show that the gains of KO codes are primarily due to the nonlinear mapping of information bits directly to transmit real symbols (bypassing modulation) and yet possess an efficient, high performance decoder. The key technical innovation that renders this possible is design of a novel family of neural architectures inspired by the computation tree of the bf Kronecker bf Operation (KO) central to Reed-Muller and Polar codes. These architectures pave way for the discovery of a much richer class of hitherto unexplored nonlinear algebraic structures. The code is available at hrefhttps://github.com/deepcomm/KOcodeshttps://github.com/deepcomm/KOcodes
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 19 of its 65 references that are in the map. First posted on arXiv 29 Aug 2021.
Builds on
19 of 65 references.
References · 19
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2017An Introduction to Deep Learning for the Physical Layercited by 227
- 2017Deep Learning-Based Communication Over the Aircited by 72
- 2017Deep Learning Methods for Improved Decoding of Linear Codescited by 66
- 2016Learning to Decode Linear Codes Using Deep Learningcited by 60
- 2018Communication Algorithms via Deep Learningcited by 42
- 2019Hyper-Graph-Network Decoders for Block Codescited by 42
- 2019Turbo Autoencoder: Deep learning based channel codes for point-to-point communication channelscited by 42
- 2018Deep Learning for Decoding of Linear Codes - A Syndrome-Based Approachcited by 34
- 2016Learning to Communicate: Channel Auto-encoders, Domain Specific Regularizers, and Attentioncited by 13
- 2021Cyclically Equivariant Neural Decoders for Cyclic Codescited by 12
- 2019Reinforcement Learning for Channel Coding: Learned Bit-Flipping Decodingcited by 10
7 more
- 2020Pruning Neural Belief Propagation Decoderscited by 10
- 2018LEARN Codes: Inventing Low-latency Codes via Recurrent Neural Networkscited by 9
- 2019Learned Belief-Propagation Decoding with Simple Scaling and SNR Adaptationcited by 9
- 2019DeepTurbo: Deep Turbo Decodercited by 9
- 2019Deep Learning-based Polar Code Designcited by 9
- 2018Low-complexity Recurrent Neural Network-based Polar Decoder with Weight Quantization Mechanismcited by 8
- 2019Learning to Flip Successive Cancellation Decoding of Polar Codes with LSTM Networkscited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 5; 2024: 4; 2025: 0; 2026: 1.
16 papers.
Sort:
- 2021ProductAE: Towards Training Larger Channel Codes based on Neural Product Codescited by 14
- 2022Semantic Communications with Discrete-time Analog Transmission: A PAPR Perspectivecited by 6
- 2022Concatenated Classic and Neural (CCN) Codes: ConcatenatedAEcited by 5
- 2022CRISP: Curriculum based Sequential Neural Decoders for Polar Code Familycited by 5
- 2023Robust Non-Linear Feedback Coding via Power-Constrained Deep Learningcited by 4
- 2022TinyTurbo: Efficient Turbo Decoders on Edgecited by 3
- 2023Data-Driven Neural Polar Codes for Unknown Channels With and Without Memorycited by 3
- 2024Nested Construction of Polar Codes via Transformerscited by 2
- 2022Optimizing Serially Concatenated Neural Codes with Classical Decoderscited by 1
- 2023Machine Learning-Aided Efficient Decoding of Reed-Muller Subcodescited by 1
- 2023ProductAE: Toward Deep Learning Driven Error-Correction Codes of Large Dimensionscited by 1
- 2024Friendly Attacks to Improve Channel Coding Reliabilitycited by 1
4 more
- 2024DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep Learningcited by 1
- 2026Generalization Bounds for Transformer Channel Decoderscited by 1
- 2023Interpreting Training Aspects of Deep-Learned Error-Correcting Codescited by 0
- 2024Disturbance-based Discretization, Differentiable IDS Channel, and an IDS-Correcting Code for DNA-based Storagecited by 0
- 2026Generalization Bounds for Transformer Channel Decoders11 Jan 2026
- 2024Disturbance-based Discretization, Differentiable IDS Channel, and an IDS-Correcting Code for DNA-based Storage10 Jul 2024
- 2024DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep Learning14 Feb 2024
- 2024Nested Construction of Polar Codes via Transformers30 Jan 2024
- 2024Friendly Attacks to Improve Channel Coding Reliability25 Jan 2024
- 2023Data-Driven Neural Polar Codes for Unknown Channels With and Without Memory6 Sep 2023
- 2023Interpreting Training Aspects of Deep-Learned Error-Correcting Codes7 May 2023
- 2023Robust Non-Linear Feedback Coding via Power-Constrained Deep Learning25 Apr 2023
- 2023ProductAE: Toward Deep Learning Driven Error-Correction Codes of Large Dimensions29 Mar 2023
- 2023Machine Learning-Aided Efficient Decoding of Reed-Muller Subcodes16 Jan 2023
- 2022Optimizing Serially Concatenated Neural Codes with Classical Decoders20 Dec 2022
- 2022CRISP: Curriculum based Sequential Neural Decoders for Polar Code Family1 Oct 2022
4 more
- 2022TinyTurbo: Efficient Turbo Decoders on Edge30 Sep 2022
- 2022Concatenated Classic and Neural (CCN) Codes: ConcatenatedAE4 Sep 2022
- 2022Semantic Communications with Discrete-time Analog Transmission: A PAPR Perspective17 Aug 2022
- 2021ProductAE: Towards Training Larger Channel Codes based on Neural Product Codes9 Oct 2021
- 2021ProductAE: Towards Training Larger Channel Codes based on Neural Product Codescited by 14
- 2022Semantic Communications with Discrete-time Analog Transmission: A PAPR Perspectivecited by 6
- 2022Concatenated Classic and Neural (CCN) Codes: ConcatenatedAEcited by 5
- 2022CRISP: Curriculum based Sequential Neural Decoders for Polar Code Familycited by 5
- 2023Robust Non-Linear Feedback Coding via Power-Constrained Deep Learningcited by 4
- 2022TinyTurbo: Efficient Turbo Decoders on Edgecited by 3
- 2023Data-Driven Neural Polar Codes for Unknown Channels With and Without Memorycited by 3
- 2024Nested Construction of Polar Codes via Transformerscited by 2
- 2022Optimizing Serially Concatenated Neural Codes with Classical Decoderscited by 1
- 2023Machine Learning-Aided Efficient Decoding of Reed-Muller Subcodescited by 1
- 2023ProductAE: Toward Deep Learning Driven Error-Correction Codes of Large Dimensionscited by 1
- 2024Friendly Attacks to Improve Channel Coding Reliabilitycited by 1
12 most cited of 16 All 16 (JSON)
- 2026Generalization Bounds for Transformer Channel Decoders11 Jan 2026
- 2024Disturbance-based Discretization, Differentiable IDS Channel, and an IDS-Correcting Code for DNA-based Storage10 Jul 2024
- 2024DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep Learning14 Feb 2024
- 2024Nested Construction of Polar Codes via Transformers30 Jan 2024
- 2024Friendly Attacks to Improve Channel Coding Reliability25 Jan 2024
- 2023Data-Driven Neural Polar Codes for Unknown Channels With and Without Memory6 Sep 2023
- 2023Interpreting Training Aspects of Deep-Learned Error-Correcting Codes7 May 2023
- 2023Robust Non-Linear Feedback Coding via Power-Constrained Deep Learning25 Apr 2023
- 2023ProductAE: Toward Deep Learning Driven Error-Correction Codes of Large Dimensions29 Mar 2023
- 2023Machine Learning-Aided Efficient Decoding of Reed-Muller Subcodes16 Jan 2023
- 2022Optimizing Serially Concatenated Neural Codes with Classical Decoders20 Dec 2022
- 2022CRISP: Curriculum based Sequential Neural Decoders for Polar Code Family1 Oct 2022
12 newest of 16 All 16 (JSON)