Integer-Only Neural Network Quantization Scheme Based on Shift-Batch-Normalization
Not on the map. Why?
Abstract (arXiv)
Neural networks are very popular in many areas, but great computing complexity makes it hard to run neural networks on devices with limited resources. To address this problem, quantization methods are used to reduce model size and computation cost, making it possible to use neural networks on embedded platforms or mobile devices. In this paper, an integer-only-quantization scheme is introduced. This scheme uses one layer that combines shift-based batch normalization and uniform quantization to implement 4-bit integer-only inference. Without big integer multiplication(which is used in previous integer-only-quantization methods), this scheme can achieve good power and latency efficiency, and is especially suitable to be deployed on co-designed hardware platforms. Tests have proved that this scheme works very well for easy tasks. And for tough tasks, performance loss can be tolerated for its inference efficiency. Our work is available on github: https://github.com/hguq/IntegerNet.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 18 references that are in the map. First posted on arXiv 28 May 2021.
Builds on
16 of 18 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
- 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 829
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2015BinaryConnect: Training Deep Neural Networks with binary weights during propagationscited by 571
- 2016Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activationscited by 413
- 2021I-BERT: Integer-only BERT Quantizationcited by 250
4 more
- 2019Understanding Straight-Through Estimator in Training Activation Quantized Neural Netscited by 225
- 2016Trained Ternary Quantizationcited by 203
- 2020HAWQV3: Dyadic Neural Network Quantizationcited by 59
- 2018Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Embedded Inferencecited by 33
Built on by
Citing papers per year: 2025: 1.
1 paper.