Real-Time Scene-Adaptive Tone Mapping for High-Dynamic Range Object Detection
Not on the map. Why?
Abstract (arXiv)
High-dynamic-range (HDR) images, with their rich tone and detail reproduction, hold significant potential to enhance computer vision systems, particularly in autonomous driving. However, most neural networks for embedded systems are trained on low-dynamic-range (LDR) inputs and suffer substantial performance degradation when handling high-bit-depth HDR images due to the challenges posed by extreme dynamic ranges. In this paper, we propose a novel tone mapping method that not only bridges the gap between HDR RAW inputs and the LDR sRGB requirements of detection networks but also achieves end-to-end optimization with downstream tasks. Instead of relying on the traditional image signal processing (ISP) pipeline, we introduce neural photometric calibration to regularize dynamic ranges and a scaling-invariant local tone mapping model to preserve image details. In addition, our architecture also supports performance transfer finetuning, enabling efficient adaptation from the LDR sRGB images to the HDR RAW images with minimal cost. The proposed method outperforms traditional tone mapping algorithms and advanced AI-ISP methods in challenging automotive HDR scenes. Moreover, our pipeline achieves real-time processing of 4K high-bit-depth HDR inputs on NVIDIA Jetson platforms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 56 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
28 of 56 references.
References · 28
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 495
- 2021Learning to Enhance Low-Light Image via Zero-Reference Deep Curve Estimationcited by 192
- 2015Fixed Point Quantization of Deep Convolutional Networkscited by 143
16 more
- 2019Handheld Multi-Frame Super-Resolutioncited by 85
- 2021Image-Adaptive YOLO for Object Detection in Adverse Weather Conditionscited by 85
- 2019Deep Optics for Single-shot High-dynamic-range Imagingcited by 62
- 2021Deep Learning for HDR Imaging: State-of-the-Art and Future Trendscited by 45
- 2017Dirty Pixels: Towards End-to-End Image Processing and Perceptioncited by 42
- 2021ReconfigISP: Reconfigurable Camera Image Processing Pipelinecited by 30
- 2024RAW-Adapter: Adapting Pre-trained Visual Model to Camera RAW Imagescited by 19
- 2022Efficient Visual Computing with Camera RAW Snapshotscited by 18
- 2024AdaptiveISP: Learning an Adaptive Image Signal Processor for Object Detectioncited by 18
- 2017Perceptually Optimized Image Renderingcited by 15
- 2023Raw or Cooked? Object Detection on RAW Imagescited by 14
- 2023Beyond the Pixel: a Photometrically Calibrated HDR Dataset for Luminance and Color Predictioncited by 14
- 2017Online Photometric Calibration for Auto Exposure Video for Realtime Visual Odometry and SLAMcited by 9
- 2021An Analysis and Implementation of the HDR+ Burst Denoising Methodcited by 8
- 2023HDR Imaging with Spatially Varying Signal-to-Noise Ratioscited by 8
- 2022A Perceptually Optimized and Self-Calibrated Tone Mapping Operatorcited by 3
Built on by
Not cited yet.