Differentiable Logic Synthesis: Spectral Coefficient Selection via Sinkhorn-Constrained Composition
Not on the map. Why?
Abstract (arXiv)
Learning precise Boolean logic via gradient descent remains challenging: neural networks typically converge to "fuzzy" approximations that degrade under quantization. We introduce Hierarchical Spectral Composition, a differentiable architecture that selects spectral coefficients from a frozen Boolean Fourier basis and composes them via Sinkhorn-constrained routing with column-sign modulation. Our approach draws on recent insights from Manifold-Constrained Hyper-Connections (mHC), which demonstrated that projecting routing matrices onto the Birkhoff polytope preserves identity mappings and stabilizes large-scale training. We adapt this framework to logic synthesis, adding column-sign modulation to enable Boolean negation -- a capability absent in standard doubly stochastic routing. We validate our approach across four phases of increasing complexity: (1) For n=2 (16 Boolean operations over 4-dim basis), gradient descent achieves 100% accuracy with zero routing drift and zero-loss quantization to ternary masks. (2) For n=3 (10 three-variable operations), gradient descent achieves 76% accuracy, but exhaustive enumeration over 3^8 = 6561 configurations proves that optimal ternary masks exist for all operations (100% accuracy, 39% sparsity). (3) For n=4 (10 four-variable operations over 16-dim basis), spectral synthesis -- combining exact Walsh-Hadamard coefficients, ternary quantization, and MCMC refinement with parallel tempering -- achieves 100% accuracy on all operations. This progression establishes (a) that ternary polynomial threshold representations exist for all tested functions, and (b) that finding them requires methods beyond pure gradient descent as dimensionality grows. All operations enable single-cycle combinational logic inference at 10,959 MOps/s on GPU, demonstrating viability for hardware-efficient neuro-symbolic logic synthesis.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 49 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
21 of 49 references.
References · 21
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2016Trained Ternary Quantizationcited by 208
- 2020Logic Tensor Networkscited by 199
- 2022Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limitcited by 187
- 2018Learning Latent Permutations with Gumbel-Sinkhorn Networkscited by 175
- 2019Neural Logic Machinescited by 145
- 2021Sinkformers: Transformers with Doubly Stochastic Attentioncited by 138
- 2020Logical Neural Networkscited by 119
9 more
- 2024Hyper-Connectionscited by 84
- 2020Learning Parities with Neural Networkscited by 78
- 2018Neural Arithmetic Logic Unitscited by 70
- 2022Deep Differentiable Logic Gate Networkscited by 67
- 2024Stochastic Concept Bottleneck Modelscited by 51
- 2024Convolutional Differentiable Logic Gate Networkscited by 37
- 2023A Scalable Walsh-Hadamard Regularizer to Overcome the Low-degree Spectral Bias of Neural Networkscited by 10
- 2025Hardness of Learning Fixed Parities with Neural Networkscited by 7
- 2025WARP-LUTs -- Walsh-Assisted Relaxation for Probabilistic Look Up Tablescited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Fitting Multilinear Polynomials for Logic Gate Networks
- 2026Polynomial Surrogate Training for Differentiable Ternary Logic Gate Networks
- 2026Differentiable Logical Programming for Quantum Circuit Discovery and Optimization
- 2026Learning with Boolean threshold functions
- 2025Minimalist Softmax Attention Provably Learns Constrained Boolean Functions
- 2025Provable Failure of Language Models in Learning Majority Boolean Logic via Gradient Descent
- 2025Practical Boolean Backpropagation
- 2026On the Depth Scalability of Logic Gate Networks