mlsanityData to 14 Oct 2026

Efficient AI Model Deployment Using Quantization Analysis Tool

arXiv 2609.11954 ↗First posted 31 Jul 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

As deep learning models are increasingly deployed on resource constrained devices, the demand for efficient model optimization techniques continues to grow. Effective deployment of AI models on edge and low power platforms requires optimization methods that reduce model size and computational cost while maintaining high accuracy. This paper presents Quantization Analysis Tool, a practical system designed to streamline quantization workflows and support performance efficient model deployment. Built on the ONNX framework for broad interoperability, the tool provides detailed layer-wise sensitivity analysis, visualization of weight and activation distributions, and insights to guide precision selection. By identifying layers that are resilient or sensitive to reduced precision, the tool enables developers to make informed trade-offs between model size, latency, and accuracy. Experimental evaluations across multiple neural network architectures demonstrate that the tool effectively improves the quantized accuracy, leading to improved efficiency in real-world deployment scenarios. The tool also provides developers valuable insights into the effects on quantization on the model and its accuracy. This work highlights the tools capabilities, practical applications, and its role in enabling efficient AI model deployment through robust quantization analysis

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 10 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

5 of 10 references.

References · 5

  1. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  2. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
  3. 2018Quantizing deep convolutional networks for efficient inference: A whitepapercited by 521
  4. 2019AdaBits: Neural Network Quantization with Adaptive Bit-Widthscited by 64
  5. 2021Towards Mixed-Precision Quantization of Neural Networks via Constrained Optimizationcited by 61

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021Pre-Quantized Deep Learning Models Codified in ONNX to Enable Hardware/Software Co-Design
  2. 2025A Selective Quantization Tuner for ONNX Models
  3. 2023Performance Characterization of using Quantization for DNN Inference on Edge Devices: Extended Version
  4. 2022Characterizing and Understanding the Behavior of Quantized Models for Reliable Deployment
  5. 2021MQBench: Towards Reproducible and Deployable Model Quantization Benchmark
  6. 2025Low-bit Model Quantization for Deep Neural Networks: A Survey
  7. 2024Art and Science of Quantizing Large-Scale Models: A Comprehensive Overview
  8. 2021BatchQuant: Quantized-for-all Architecture Search with Robust Quantizer