mlsanityData to 7 Oct 2026

Convolutional Differentiable Logic Gate Networks

arXiv 2411.04732 ↗First posted 7 Nov 2024cs.LG cs.CVcited by 37

Not on the map. Why?

Abstract (arXiv)

With the increasing inference cost of machine learning models, there is a growing interest in models with fast and efficient inference. Recently, an approach for learning logic gate networks directly via a differentiable relaxation was proposed. Logic gate networks are faster than conventional neural network approaches because their inference only requires logic gate operators such as NAND, OR, and XOR, which are the underlying building blocks of current hardware and can be efficiently executed. We build on this idea, extending it by deep logic gate tree convolutions, logical OR pooling, and residual initializations. This allows scaling logic gate networks up by over one order of magnitude and utilizing the paradigm of convolution. On CIFAR-10, we achieve an accuracy of 86.29% using only 61 million logic gates, which improves over the SOTA while being 29x smaller.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Builds on 28 of its 46 references that are in the map. First posted on arXiv 7 Nov 2024.

Builds on

28 of 46 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 829
  5. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
  6. 2016DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradientscited by 557
  7. 2021Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networkscited by 521
  8. 2018PACT: Parameterized Clipping Activation for Quantized Neural Networkscited by 456
  9. 2019Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networkscited by 234
  10. 2020Binary Neural Networks: A Surveycited by 184
  11. 2019Forward and Backward Information Retention for Accurate Binary Neural Networkscited by 169
  12. 2022More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsitycited by 142
16 more
  1. 2016FINN: A Framework for Fast, Scalable Binarized Neural Network Inferencecited by 141
  2. 2020Analyzing Differentiable Fuzzy Logic Operatorscited by 100
  3. 2022The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Trainingcited by 85
  4. 2016Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computingcited by 68
  5. 2022Deep Differentiable Logic Gate Networkscited by 67
  6. 2021Compute and Energy Consumption Trends in Deep Learning Inferencecited by 61
  7. 2022AdaBin: Improving Binary Neural Networks with Adaptive Binary Setscited by 38
  8. 2020FracBNN: Accurate and FPGA-Efficient Binary Neural Networks with Fractional Activationscited by 30
  9. 2019LUTNet: Rethinking Inference in FPGA Soft Logiccited by 27
  10. 2024Differentiable Weightless Neural Networkscited by 27
  11. 2019LUTNet: Learning FPGA Configurations for Highly Efficient Neural Network Inferencecited by 23
  12. 2019Balanced Binary Neural Networks with Gated Residualcited by 14
  13. 2022Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performancecited by 7
  14. 2022A Scalable, Interpretable, Verifiable & Differentiable Logic Gate Convolutional Neural Network Architecture From Truth Tablescited by 4
  15. 2021RBNN: Memory-Efficient Reconfigurable Deep Binary Neural Network with IP Protection for Internet of Thingscited by 3
  16. 2023RedBit: An End-to-End Flexible Framework for Evaluating the Accuracy of Quantized CNNscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 17; 2026: 20.

37 papers.

Sort:

By area:

  1. 2025A Comprehensive Survey on Self-Interpretable Neural Networkscited by 18
  2. 2025Differentiable Logic Cellular Automata: From Game of Life to Pattern Generationcited by 9
  3. 2025Light Differentiable Logic Gate Networkscited by 9
  4. 2025WARP-LUTs -- Walsh-Assisted Relaxation for Probabilistic Look Up Tablescited by 6
  5. 2025LILogic Net: Compact Logic Gate Networks with Learnable Connectivity for Efficient Hardware Deploymentcited by 6
  6. 2025A Method for Optimizing Connections in Differentiable Logic Gate Networkscited by 5
  7. 2025Logic Gate Neural Networks are Good for Verificationcited by 4
  8. 2025Scalable Interconnect Learning in Boolean Networkscited by 4
  9. 2025LL-ViT: Edge Deployable Vision Transformers with Look Up Table Neuronscited by 3
  10. 2025Learning Interpretable Differentiable Logic Networks for Tabular Regressioncited by 2
  11. 2026WARP Logic Neural Networkscited by 2
  12. 2026Polynomial Surrogate Training for Differentiable Ternary Logic Gate Networkscited by 2
25 more
  1. 2026Explicit Fuzzy Logic in the Feed-Forward Layer: Self-Forgetting Quantifiers Discover Legible Grammatical-Licensing Detectorscited by 2
  2. 2025From MNIST to ImageNet: Understanding the Scalability Boundaries of Differentiable Logic Gate Networkscited by 1
  3. 2025Differentiable Weightless Controllers: Learning Logic Circuits for Continuous Controlcited by 1
  4. 2026Inter-patient ECG Arrhythmia Classification with LGNs and LUTNscited by 1
  5. 2026Differentiable Logic Synthesis: Spectral Coefficient Selection via Sinkhorn-Constrained Compositioncited by 1
  6. 2026Learning Compact Boolean Networkscited by 1
  7. 2026BitLogic: Training Framework for Gradient-Based FPGA-Native Neural Networkscited by 1
  8. 2026LogicIR: Logic Gate Networks for Image Restorationcited by 1
  9. 2026FPGN: Redefining Ultra-Fast Programmable Gate-based Neural Acceleration with Differentiable LUTscited by 1
  10. 2025GLANCE: Graph Logic Attention Network with Cluster Enhancement for Heterophilous Graph Representation Learningcited by 0
  11. 2025Learning Interpretable Differentiable Logic Networks for Time-Series Classificationcited by 0
  12. 2025Logic of Hypotheses: from Zero to Full Knowledge in Neurosymbolic Integrationcited by 0
  13. 2025A Framework Based on Graph Cellular Automata for Similarity Evaluation in Urban Spatial Networkscited by 0
  14. 2025Hardware Software Optimizations for Fast Model Recovery on Reconfigurable Architecturescited by 0
  15. 2026Chimera: Neuro-Symbolic Attention Primitives for Trustworthy Dataplane Intelligencecited by 0
  16. 2026TT-Sparse: Learning Sparse Rule Models with Differentiable Truth Tablescited by 0
  17. 2026From Arithmetic to Logic: The Resilience of Logic and Lookup-Based Neural Networks Under Parameter Bit-Flipscited by 0
  18. 2026THEIA: Learning Complete Kleene Three-Valued Logic in a Pure-Neural Modular Architecturecited by 0
  19. 2026Silicon Aware Neural Networkscited by 0
  20. 2026Efficient Logic Gate Networks for Video Copy Detectioncited by 0
  21. 2026Fitting Multilinear Polynomials for Logic Gate Networkscited by 0
  22. 2026On the Stability and Realizability of Recurrent Polynomial Surrogate Ternary Logic Gate Networkscited by 0
  23. 2026Differentiable Logic Gate Networks for Low-Latency EEG Classification on Edge Devicescited by 0
  24. 2026Task-Aware Discretization of Differentiable Logic Gate Networkscited by 0
  25. 2026Overcoming Kernel Redundancy for Scaling Logic Gate Networkscited by 0