# RawHDR: High Dynamic Range Image Reconstruction from a Single Raw Image

arXiv: https://arxiv.org/abs/2309.02020 · HTML: https://mlsanity.com/paper/2309.02020/

## Key facts

- Cited by 32 papers in the map (data through 14 Oct 2026).
- Builds on 28 of its 60 references that are in the map.
- First posted on arXiv 5 Sep 2023.

## Builds on (most cited first, 28 of 28)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Layer Normalization](https://mlsanity.com/paper/1607.06450/) (2016)
- [Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification](https://mlsanity.com/paper/1502.01852/) (2015)
- [FlowNet: Learning Optical Flow with Convolutional Networks](https://mlsanity.com/paper/1504.06852/) (2015)
- [Uformer: A General U-Shaped Transformer for Image Restoration](https://mlsanity.com/paper/2106.03106/) (2021)
- [Learning to See in the Dark](https://mlsanity.com/paper/1805.01934/) (2018)
- [High Speed and High Dynamic Range Video with an Event Camera](https://mlsanity.com/paper/1906.07165/) (2019)
- [HDR image reconstruction from a single exposure using deep CNNs](https://mlsanity.com/paper/1710.07480/) (2017)
- [Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipeline](https://mlsanity.com/paper/2004.01179/) (2020)
- [Attention-guided Network for Ghost-free High Dynamic Range Imaging](https://mlsanity.com/paper/1904.10293/) (2019)
- [Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networks](https://mlsanity.com/paper/1811.08230/) (2018)
- [Invertible Image Signal Processing](https://mlsanity.com/paper/2103.15061/) (2021)
- [ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Content](https://mlsanity.com/paper/1803.02266/) (2018)
- [Single Image HDR Reconstruction Using a CNN with Masked Features and Perceptual Loss](https://mlsanity.com/paper/2005.07335/) (2020)
- [Physics-based Noise Modeling for Extreme Low-light Photography](https://mlsanity.com/paper/2108.02158/) (2021)
- [Deep Optics for Single-shot High-dynamic-range Imaging](https://mlsanity.com/paper/1908.00620/) (2019)
- [HDRUNet: Single Image HDR Reconstruction with Denoising and Dequantization](https://mlsanity.com/paper/2105.13084/) (2021)
- [Instance Segmentation in the Dark](https://mlsanity.com/paper/2304.14298/) (2023)
- [Deep Learning for HDR Imaging: State-of-the-Art and Future Trends](https://mlsanity.com/paper/2110.10394/) (2021)
- [Deep SR-ITM: Joint Learning of Super-Resolution and Inverse Tone-Mapping for 4K UHD HDR Applications](https://mlsanity.com/paper/1904.11176/) (2019)
- [NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Results](https://mlsanity.com/paper/2106.01439/) (2021)
- [Joint Denoising and Demosaicking with Green Channel Prior for Real-world Burst Images](https://mlsanity.com/paper/2101.09870/) (2021)
- [Estimating Fine-Grained Noise Model via Contrastive Learning](https://mlsanity.com/paper/2204.01716/) (2022)

## Built on by (most cited first, 30 of 32)

- [Binarized Low-light Raw Video Enhancement](https://mlsanity.com/paper/2403.19944/) (2024)
- [EventHDR: from Event to High-Speed HDR Videos and Beyond](https://mlsanity.com/paper/2409.17029/) (2024)
- [Towards Real-World HDR Video Reconstruction: A Large-Scale Benchmark Dataset and A Two-Stage Alignment Network](https://mlsanity.com/paper/2405.00244/) (2024)
- [Multi-Object Tracking in the Dark](https://mlsanity.com/paper/2405.06600/) (2024)
- [NTIRE 2025 Challenge on Efficient Burst HDR and Restoration: Datasets, Methods, and Results](https://mlsanity.com/paper/2505.12089/) (2025)
- [Recaptured Raw Screen Image and Video Demoir'eing via Channel and Spatial Modulations](https://mlsanity.com/paper/2310.20332/) (2023)
- [Leveraging Thermal Modality to Enhance Reconstruction in Low-Light Conditions](https://mlsanity.com/paper/2403.14053/) (2024)
- [Learning to See Low-Light Images via Feature Domain Adaptation](https://mlsanity.com/paper/2312.06723/) (2023)
- [Semantic Aware Diffusion Inverse Tone Mapping](https://mlsanity.com/paper/2405.15468/) (2024)
- [X2HDR: HDR Image Generation in a Perceptually Uniform Space](https://mlsanity.com/paper/2602.04814/) (2026)
- [RAW Image Reconstruction from RGB on Smartphones. NTIRE 2025 Challenge Report](https://mlsanity.com/paper/2506.01947/) (2025)
- [HistoHDR-Net: Histogram Equalization for Single LDR to HDR Image Translation](https://mlsanity.com/paper/2402.06692/) (2024)
- [A Learnable Color Correction Matrix for RAW Reconstruction](https://mlsanity.com/paper/2409.02497/) (2024)
- [RAWMamba: Unified sRGB-to-RAW De-rendering With State Space Model](https://mlsanity.com/paper/2411.11717/) (2024)
- [DSDNet: Raw Domain Demoir'eing via Dual Color-Space Synergy](https://mlsanity.com/paper/2504.15756/) (2025)
- [Improving Bracket Image Restoration and Enhancement with Flow-guided Alignment and Enhanced Feature Aggregation](https://mlsanity.com/paper/2404.10358/) (2024)
- [SimROD: A Simple Baseline for Raw Object Detection with Global and Local Enhancements](https://mlsanity.com/paper/2503.07101/) (2025)
- [Boosting HDR Image Reconstruction via Semantic Knowledge Transfer](https://mlsanity.com/paper/2503.15361/) (2025)
- [Enabling High-Quality In-the-Wild Imaging from Severely Aberrated Metalens Bursts](https://mlsanity.com/paper/2510.10083/) (2025)
- [Uni-ISP: Toward Unifying the Learning of ISPs from Multiple Mobile Cameras](https://mlsanity.com/paper/2406.01003/) (2024)
- [Technique Report of CVPR 2024 PBDL Challenges](https://mlsanity.com/paper/2406.10744/) (2024)
- [A Cycle Ride to HDR: Semantics Aware Self-Supervised Framework for Unpaired LDR-to-HDR Image Reconstruction](https://mlsanity.com/paper/2410.15068/) (2024)
- [PhysHDR: When Lighting Meets Materials and Scene Geometry in HDR Reconstruction](https://mlsanity.com/paper/2509.16869/) (2025)
- [Seeing through Light and Darkness: Sensor-Physics Grounded Deblurring HDR NeRF from Single-Exposure Images and Events](https://mlsanity.com/paper/2601.15475/) (2026)
- [InstantHDR: Single-forward Gaussian Splatting Initialization for HDR 3D Reconstruction](https://mlsanity.com/paper/2603.11298/) (2026)
- [Lucky High Dynamic Range Smartphone Imaging](https://mlsanity.com/paper/2604.19976/) (2026)
- [Single-Shot HDR Recovery via a Video Diffusion Prior](https://mlsanity.com/paper/2605.11628/) (2026)
- [Depth-guided Multi-view Exposure Bracketing for HDR Robot Vision](https://mlsanity.com/paper/2608.16014/) (2026)
- [Binarized High-Efficiency RAW Video Restoration and Beyond](https://mlsanity.com/paper/2608.16756/) (2026)
- [Recurrent Dynamic Range Extension](https://mlsanity.com/paper/2609.13135/) (2026)

## Abstract (arXiv)

High dynamic range (HDR) images capture much more intensity levels than standard ones. Current methods predominantly generate HDR images from 8-bit low dynamic range (LDR) sRGB images that have been degraded by the camera processing pipeline. However, it becomes a formidable task to retrieve extremely high dynamic range scenes from such limited bit-depth data. Unlike existing methods, the core idea of this work is to incorporate more informative Raw sensor data to generate HDR images, aiming to recover scene information in hard regions (the darkest and brightest areas of an HDR scene). To this end, we propose a model tailor-made for Raw images, harnessing the unique features of Raw data to facilitate the Raw-to-HDR mapping. Specifically, we learn exposure masks to separate the hard and easy regions of a high dynamic scene. Then, we introduce two important guidances, dual intensity guidance, which guides less informative channels with more informative ones, and global spatial guidance, which extrapolates scene specifics over an extended spatial domain. To verify our Raw-to-HDR approach, we collect a large Raw/HDR paired dataset for both training and testing. Our empirical evaluations validate the superiority of the proposed Raw-to-HDR reconstruction model, as well as our newly captured dataset in the experiments.
