mlsanityData to 14 Oct 2026

BD-Net: Has Depth-Wise Convolution Ever Been Applied in Binary Neural Networks?

arXiv 2511.17633 ↗First posted 19 Nov 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in model compression have highlighted the potential of low-bit precision techniques, with Binary Neural Networks (BNNs) attracting attention for their extreme efficiency. However, extreme quantization in BNNs limits representational capacity and destabilizes training, posing significant challenges for lightweight architectures with depth-wise convolutions. To address this, we propose a 1.58-bit convolution to enhance expressiveness and a pre-BN residual connection to stabilize optimization by improving the Hessian condition number. These innovations enable, to the best of our knowledge, the first successful binarization of depth-wise convolutions in BNNs. Our method achieves 33M OPs on ImageNet with MobileNet V1, establishing a new state-of-the-art in BNNs by outperforming prior methods with comparable OPs. Moreover, it consistently outperforms existing methods across various datasets, including CIFAR-10, CIFAR-100, STL-10, Tiny ImageNet, and Oxford Flowers 102, with accuracy improvements of up to 9.3 percentage points.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 36 references that are in the map. First posted on arXiv 19 Nov 2025.

Builds on

31 of 36 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  5. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  6. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  7. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  8. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  9. 2019Searching for MobileNetV3cited by 1,994
  10. 2020Knowledge Distillation: A Surveycited by 1,603
  11. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
  12. 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 849
19 more
  1. 2020Image Segmentation Using Deep Learning: A Surveycited by 660
  2. 2016DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradientscited by 569
  3. 2019Object Detection in 20 Years: A Surveycited by 531
  4. 2018HAQ: Hardware-Aware Automated Quantization with Mixed Precisioncited by 443
  5. 2019GhostNet: More Features from Cheap Operationscited by 410
  6. 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 263
  7. 2018Bi-Real Net: Enhancing the Performance of 1-bit CNNs With Improved Representational Capability and Advanced Training Algorithmcited by 235
  8. 2020ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functionscited by 184
  9. 2017Towards Accurate Binary Convolutional Neural Networkcited by 149
  10. 2022Overcoming Oscillations in Quantization-Aware Trainingcited by 119
  11. 2022AdaBin: Improving Binary Neural Networks with Adaptive Binary Setscited by 38
  12. 2022NIPQ: Noise proxy-based Integrated Pseudo-Quantizationcited by 35
  13. 2019Fighting Quantization Bias With Biascited by 30
  14. 2018A Quantization-Friendly Separable Convolution for MobileNetscited by 22
  15. 2020Binarizing MobileNet via Evolution-based Searchingcited by 21
  16. 2019Globally Convergent Newton Methods for Ill-conditioned Generalized Self-concordant Lossescited by 17
  17. 2022INSTA-BNN: Binary Neural Network with INSTAnce-aware Thresholdcited by 9
  18. 2020Exploring Neural Networks Quantization via Layer-Wise Quantization Analysiscited by 5
  19. 2024A&B BNN: Add&Bit-Operation-Only Hardware-Friendly Binary Neural Networkcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Input Layer Binarization with Bit-Plane Encoding
  2. 2021A comprehensive review of Binary Neural Network
  3. 2022Join the High Accuracy Club on ImageNet with A Binary Neural Network Ticket
  4. 2021Sub-bit Neural Networks: Learning to Compress and Accelerate Binary Neural Networks
  5. 2022Basic Binary Convolution Unit for Binarized Image Restoration Network
  6. 2021BCNN: Binary Complex Neural Network
  7. 2023Binary domain generalization for sparsifying binary neural networks
  8. 2022RepBNN: towards a precise Binary Neural Network with Enhanced Feature Map via Repeating