Infrared Domain Adaptation with Zero-Shot Quantization
Not on the map. Why?
Abstract (arXiv)
Quantization is one of the most popular techniques for reducing computation time and shrinking model size. However, ensuring the accuracy of quantized models typically involves calibration using training data, which may be inaccessible due to privacy concerns. In such cases, zero-shot quantization, a technique that relies on pretrained models and statistical information without the need for specific training data, becomes valuable. Exploring zero-shot quantization in the infrared domain is important due to the prevalence of infrared imaging in sensitive fields like medical and security applications. In this work, we demonstrate how to apply zero-shot quantization to an object detection model retrained with thermal imagery. We use batch normalization statistics of the model to distill data for calibration. RGB image-trained models and thermal image-trained models are compared in the context of zero-shot quantization. Our investigation focuses on the contributions of mean and standard deviation statistics to zero-shot quantization performance. Additionally, we compare zero-shot quantization with post-training quantization on a thermal dataset. We demonstrated that zero-shot quantization successfully generates data that represents the training dataset for the quantization of object detection models. Our results indicate that our zero-shot quantization framework is effective in the absence of training data and is well-suited for the infrared domain.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 43 references that are in the map. First posted on arXiv 25 Aug 2024.
Builds on
29 of 43 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2016Pruning Filters for Efficient ConvNetscited by 1,143
- 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 849
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
- 2019Data-Free Quantization Through Weight Equalization and Bias Correctioncited by 336
- 2021Post-Training Quantization for Vision Transformercited by 278
- 2020ZeroQ: A Novel Zero Shot Quantization Frameworkcited by 269
- 2015Quantized Convolutional Neural Networks for Mobile Devicescited by 215
17 more
- 2019Low-bit Quantization of Neural Networks for Efficient Inferencecited by 193
- 2018Learning to Quantize Deep Networks by Optimizing Quantization Intervals with Task Losscited by 160
- 2019Improving Neural Network Quantization without Retraining using Outlier Channel Splittingcited by 151
- 2015Fixed Point Quantization of Deep Convolutional Networkscited by 143
- 2019Zero-Shot Knowledge Distillation in Deep Networkscited by 121
- 2020Degree-Quant: Quantization-Aware Training for Graph Neural Networkscited by 96
- 2020Generative Low-bitwidth Data Free Quantizationcited by 88
- 2021Diversifying Sample Generation for Accurate Data-Free Quantizationcited by 63
- 2021Zero-shot Adversarial Quantizationcited by 44
- 2021IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Shot Network Quantizationcited by 43
- 2021Qimera: Data-free Quantization with Synthetic Boundary Supporting Samplescited by 40
- 2019Borrow from Anywhere: Pseudo Multi-modal Object Detection in Thermal Imagerycited by 38
- 2016Ternary Neural Networks for Resource-Efficient AI Applicationscited by 33
- 2018Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Embedded Inferencecited by 33
- 2021PQK: Model Compression via Pruning, Quantization, and Knowledge Distillationcited by 21
- 2021AutoReCon: Neural Architecture Search-based Reconstruction for Data-free Compressioncited by 17
- 2023Hard Sample Matters a Lot in Zero-Shot Quantizationcited by 15
Built on by
Citing papers per year: 2024: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Sharpness-Aware Data Generation for Zero-shot Quantization
- 2021Generative Zero-shot Network Quantization
- 2021A Generalized Zero-Shot Quantization of Deep Convolutional Neural Networks via Learned Weights Statistics
- 2022Genie: Show Me the Data for Quantization
- 2026Zero-Shot Quantization for Object Detectors using Off-the-Shelf Generative Models
- 2022It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher
- 2023Zero-Shot Sharpness-Aware Quantization for Pre-trained Language Models
- 2025Task-Specific Zero-shot Quantization-Aware Training for Object Detection