Scalable Mamba-Based Message-Passing Neural Decoder for Error-Correcting Codes
On the map: State-space sequence models (S4, Mamba) → Core SSM architectures for language
Abstract (arXiv)
Forward error correction is essential for reliable communication over noisy channels. Attention-based model-free neural decoders have shown strong performance for short codes, but their scalability to longer codes is limited by the quadratic memory and computational cost of attention. In this paper, we introduce the Mamba message-passing decoder (MMPD), an attention-free syndrome-based neural decoder for binary linear codes. MMPD retains the Tanner-graph structure of a message-passing decoder by performing local pairwise aggregation along variable-check edges. To enable efficient long-range information propagation, these local updates are combined with bidirectional Mamba state-space blocks. By avoiding dense attention matrices, MMPD scales more favorably for long codes in both memory and computation. Experiments on the (1056, 880) LDPC code show that MMPD achieves a 0.45 dB gain over the state-of-the-art CrossMPT decoder at a specified target bit error rate, while reducing memory consumption by a factor of 1.5. This reduction factor increases substantially for longer codes, demonstrating the applicability of MMPD to scalable neural decoding of practical long codes.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Core SSM architectures for language, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 12 of its 17 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
12 of 17 references.
Closest ancestors · 2
Same direction, newest first
- 2025Hybrid Mamba-Transformer Decoder for Error-Correcting Codes23 May
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spaces1 Dec
Other references · 10
- 2022Error Correction Code Transformercited by 47
- 2015Natural Language Inference by Tree-Based Convolution and Heuristic Matchingcited by 43
- 2018Deep Learning for Decoding of Linear Codes - A Syndrome-Based Approachcited by 34
- 2022Denoising Diffusion Error Correction Codescited by 24
- 2024CrossMPT: Cross-attention Message-Passing Transformer for Error Correcting Codescited by 21
- 2022Graph Neural Networks for Channel Decodingcited by 10
- 2024Recent Advances in Deep Learning for Channel Coding: A Surveycited by 6
- 2024Accelerating Error Correction Code Transformerscited by 3
- 2025Cross-Attention Message-Passing Transformers for Code-Agnostic Decoding in 6G Networkscited by 1
- 2025Syndrome-Flow Consistency Model Achieves One-step Denoising Error Correction Codescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Scalable Neural Decoders for Practical Real-Time Quantum Error Correction
- 2021FAID Diversity via Neural Networks
- 2024The Mamba in the Llama: Distilling and Accelerating Hybrid Models
- 2026Sparse Mamba Decoder for Quantum Error Correction: Efficient Defect-Centric Processing of Surface Code Syndromes
- 2025Learning Linear Block Codes with Gradient Quantization
- 2026Variational Diffusion Channel Decoder
- 2024MambaJSCC: Adaptive Deep Joint Source-Channel Coding with Generalized State Space Model
- 2022Learning Quantization in LDPC Decoders