A Mixed Quantization Network for Computationally Efficient Mobile Inverse Tone Mapping
Not on the map. Why?
Abstract (arXiv)
Recovering a high dynamic range (HDR) image from a single low dynamic range (LDR) image, namely inverse tone mapping (ITM), is challenging due to the lack of information in over- and under-exposed regions. Current methods focus exclusively on training high-performing but computationally inefficient ITM models, which in turn hinder deployment of the ITM models in resource-constrained environments with limited computing power such as edge and mobile device applications. To this end, we propose combining efficient operations of deep neural networks with a novel mixed quantization scheme to construct a well-performing but computationally efficient mixed quantization network (MQN) which can perform single image ITM on mobile platforms. In the ablation studies, we explore the effect of using different attention mechanisms, quantization schemes, and loss functions on the performance of MQN in ITM tasks. In the comparative analyses, ITM models trained using MQN perform on par with the state-of-the-art methods on benchmark datasets. MQN models provide up to 10 times improvement on latency and 25 times improvement on memory consumption.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 79 references that are in the map. First posted on arXiv 12 Mar 2022.
Builds on
36 of 79 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2017Mixed Precision Trainingcited by 1,135
24 more
- 2017HDR image reconstruction from a single exposure using deep CNNscited by 167
- 2020Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipelinecited by 131
- 2019Attention-guided Network for Ghost-free High Dynamic Range Imagingcited by 116
- 2017Deep High Dynamic Range Imaging with Large Foreground Motionscited by 98
- 2018ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Contentcited by 89
- 2020HDR-GAN: HDR Image Reconstruction from Multi-Exposed LDR Images with Large Motionscited by 80
- 2019Gate-Shift Networks for Video Action Recognitioncited by 76
- 2020Single Image HDR Reconstruction Using a CNN with Masked Features and Perceptual Losscited by 71
- 2021HDRUNet: Single Image HDR Reconstruction with Denoising and Dequantizationcited by 58
- 2021ADNet: Attention-guided Deformable Convolutional Network for High Dynamic Range Imagingcited by 51
- 2021NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Resultscited by 36
- 2017Learning High Dynamic Range from Outdoor Panoramascited by 34
- 2018Image Correction via Deep Reciprocating HDR Transformationcited by 30
- 2019PREMA: A Predictive Multi-task Scheduling Algorithm For Preemptible Neural Processing Unitscited by 30
- 2018Deep Chain HDRI: Reconstructing a High Dynamic Range Image from a Single Low Dynamic Range Imagecited by 25
- 2019FHDR: HDR Image Reconstruction from a Single LDR Image using Feedback Networkcited by 22
- 2015Locally Non-rigid Registration for Mobile HDR Photographycited by 18
- 2018Convolutional Sparse Coding for High Dynamic Range Imagingcited by 17
- 2020End-to-End Differentiable Learning to HDR Image Synthesis for Multi-exposure Imagescited by 14
- 2021A Two-stage Deep Network for High Dynamic Range Image Reconstructioncited by 10
- 2018Learning an Inverse Tone Mapping Network with a Generative Adversarial Regularizercited by 6
- 2020S3NAS: Fast NPU-aware Neural Architecture Search Methodologycited by 5
- 2021MetaHDR: Model-Agnostic Meta-Learning for HDR Image Reconstructioncited by 4
- 2017Streaming Architecture for Large-Scale Quantized Neural Networks on an FPGA-Based Dataflow Platformcited by 1
Built on by
Not cited yet.