HPTQ: Hardware-Friendly Post Training Quantization
Not on the map. Why?
Abstract (arXiv)
Neural network quantization enables the deployment of models on edge devices. An essential requirement for their hardware efficiency is that the quantizers are hardware-friendly: uniform, symmetric, and with power-of-two thresholds. To the best of our knowledge, current post-training quantization methods do not support all of these constraints simultaneously. In this work, we introduce a hardware-friendly post training quantization (HPTQ) framework, which addresses this problem by synergistically combining several known quantization methods. We perform a large-scale study on four tasks: classification, object detection, semantic segmentation and pose estimation over a wide variety of network architectures. Our extensive experiments show that competitive results can be obtained under hardware-friendly constraints.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 42 of its 52 references that are in the map. First posted on arXiv 19 Sep 2021.
Builds on
42 of 52 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
30 more
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2019Searching for MobileNetV3cited by 1,984
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
- 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 829
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2019Learned Step Size Quantizationcited by 604
- 2020Up or Down? Adaptive Rounding for Post-Training Quantizationcited by 600
- 2018Quantizing deep convolutional networks for efficient inference: A whitepapercited by 507
- 2018PACT: Parameterized Clipping Activation for Quantized Neural Networkscited by 456
- 2021A White Paper on Neural Network Quantizationcited by 453
- 2019Data-Free Quantization Through Weight Equalization and Bias Correctioncited by 328
- 2020ZeroQ: A Novel Zero Shot Quantization Frameworkcited by 265
- 2019Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networkscited by 234
- 2020Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluationcited by 183
- 2020LSQ+: Improving low-bit quantization through learnable offsets and better initializationcited by 180
- 2019Improving Neural Network Quantization without Retraining using Outlier Channel Splittingcited by 150
- 2019Loss Aware Post-training Quantizationcited by 94
- 2020Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programmingcited by 89
- 2019Trained Quantization Thresholds for Accurate and Efficient Fixed-Point Inference of Deep Neural Networkscited by 87
- 2018Look into Person: Joint Body Parsing & Pose Estimation Network and A New Benchmarkcited by 79
- 2020Post-Training Piecewise Linear Quantization for Deep Neural Networkscited by 77
- 2018Value-aware Quantization for Training and Inference of Neural Networkscited by 49
- 2019Same, Same But Different - Recovering Neural Network Quantization Error Through Weight Factorizationcited by 45
- 2020HMQ: Hardware Friendly Mixed Precision Quantization Block for CNNscited by 43
- 2019Fighting Quantization Bias With Biascited by 30
- 2018Quantization for Rapid Deployment of Deep Neural Networkscited by 20
- 2019Simple and Lightweight Human Pose Estimationcited by 10
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 2; 2025: 2; 2026: 2.
9 papers.
- 2022Make RepVGG Greater Again: A Quantization-aware Approachcited by 21
- 2022Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementationcited by 6
- 2025PicoSAM2: Low-Latency Segmentation In-Sensor for Edge Vision Applicationscited by 6
- 2023EPTQ: Enhanced Post-Training Quantization via Hessian-guided Network-wise Optimizationcited by 5
- 2024Data Generation for Hardware-Friendly Post-Training Quantizationcited by 2
- 2024Achieving Pareto Optimality using Efficient Parameter Reduction for DNNs in Resource-Constrained Edge Environmentcited by 1
- 2025EfficientQuant: An Efficient Post-Training Quantization for CNN-Transformer Hybrid Models on Edge Devicescited by 1
- 2026PicoSAM3: Real-Time In-Sensor Region-of-Interest Segmentationcited by 1
- 2026IMC-CLINIC: Coupled Loss-Informed Newton Iterations for Clipping in Analog In-Memory Computingcited by 0
- 2026IMC-CLINIC: Coupled Loss-Informed Newton Iterations for Clipping in Analog In-Memory Computing28 Sep 2026
- 2026PicoSAM3: Real-Time In-Sensor Region-of-Interest Segmentation12 Mar 2026
- 2025PicoSAM2: Low-Latency Segmentation In-Sensor for Edge Vision Applications23 Jun 2025
- 2025EfficientQuant: An Efficient Post-Training Quantization for CNN-Transformer Hybrid Models on Edge Devices5 Jun 2025
- 2024Data Generation for Hardware-Friendly Post-Training Quantization29 Oct 2024
- 2024Achieving Pareto Optimality using Efficient Parameter Reduction for DNNs in Resource-Constrained Edge Environment14 Mar 2024
- 2023EPTQ: Enhanced Post-Training Quantization via Hessian-guided Network-wise Optimization20 Sep 2023
- 2022Make RepVGG Greater Again: A Quantization-aware Approach3 Dec 2022
- 2022Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation26 Aug 2022