Structure of the Circular-Dyadic Convolution Error
Not on the map. Why?
Abstract (arXiv)
Dyadic and circular convolution can both be computed in O(Nlog N) time using the Hadamard transform and the FFT-computed discrete Fourier transform (DFT), respectively. The Hadamard transform is preferable for its real-valued sign flips, yet its substitution for the DFT introduces algebraic error. We present three complementary results that characterize this error. First, we identify exact error cancellation: two input and two output positions are universally error-free, and no reordering of the output can eliminate this error. Second, the error operator is nearly full rank, while its null space has only logarithmic dimension. Third, the expected error is governed by a single alignment scalar, with a closed-form expression obtained by averaging over random filters. In general, the substitution error asymptotically doubles the output energy, except for filters in the universal zero-error subspace, which incur no error. Collectively, these results show that the substitution error is structured, predictable, and governed by alignment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 27 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
7 of 27 references.
References · 7
- 2017Attention Is All You Needcited by 59,932
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 388
- 2021Fast Walsh-Hadamard Transform and Smooth-Thresholding Based Binary Layers in Deep Neural Networkscited by 14
- 2022Block Walsh-Hadamard Transform Based Binary Layers in Deep Neural Networkscited by 13
- 2023A Hybrid Quantum-Classical Approach based on the Hadamard Transform for the Convolutional Layercited by 12
- 2022Uniform Approximations for Randomized Hadamard Transforms with Applicationscited by 7
Built on by
Not cited yet.