# Self-Supervised High Dynamic Range Imaging with Multi-Exposure Images in Dynamic Scenes

arXiv: https://arxiv.org/abs/2310.01840 · HTML: https://mlsanity.com/paper/2310.01840/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- Builds on 23 of its 46 references that are in the map.
- First posted on arXiv 3 Oct 2023.

## Builds on (most cited first, 23 of 23)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [Denoising Diffusion Implicit Models](https://mlsanity.com/paper/2010.02502/) (2020)
- [SwinIR: Image Restoration Using Swin Transformer](https://mlsanity.com/paper/2108.10257/) (2021)
- [PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume](https://mlsanity.com/paper/1709.02371/) (2017)
- [NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images](https://mlsanity.com/paper/2111.13679/) (2021)
- [FlowFormer: A Transformer Architecture for Optical Flow](https://mlsanity.com/paper/2203.16194/) (2022)
- [Generative Diffusion Prior for Unified Image Restoration and Enhancement](https://mlsanity.com/paper/2304.01247/) (2023)
- [HDR-NeRF: High Dynamic Range Neural Radiance Fields](https://mlsanity.com/paper/2111.14451/) (2021)
- [Deep High Dynamic Range Imaging with Large Foreground Motions](https://mlsanity.com/paper/1711.08937/) (2017)
- [HDR-GAN: HDR Image Reconstruction from Multi-Exposed LDR Images with Large Motions](https://mlsanity.com/paper/2007.01628/) (2020)
- [Ghost-free High Dynamic Range Imaging with Context-aware Transformer](https://mlsanity.com/paper/2208.05114/) (2022)
- [HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Dataset](https://mlsanity.com/paper/2103.14943/) (2021)
- [Deep Learning for HDR Imaging: State-of-the-Art and Future Trends](https://mlsanity.com/paper/2110.10394/) (2021)
- [HDR-Plenoxels: Self-Calibrating High Dynamic Range Radiance Fields](https://mlsanity.com/paper/2208.06787/) (2022)
- [Alignment-free HDR Deghosting with Semantics Consistent Transformer](https://mlsanity.com/paper/2305.18135/) (2023)
- [A Unified HDR Imaging Method with Pixel and Patch Level](https://mlsanity.com/paper/2304.06943/) (2023)
- [SMAE: Few-shot Learning for HDR Deghosting with Saturation-Aware Masked Autoencoders](https://mlsanity.com/paper/2304.06914/) (2023)
- [Self-supervised HDR Imaging from Motion and Exposure Cues](https://mlsanity.com/paper/2203.12311/) (2022)

## Built on by (most cited first, 9 of 9)

- [Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Field](https://mlsanity.com/paper/2406.07329/) (2024)
- [MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decoupling](https://mlsanity.com/paper/2508.17404/) (2025)
- [HistoHDR-Net: Histogram Equalization for Single LDR to HDR Image Translation](https://mlsanity.com/paper/2402.06692/) (2024)
- [AdaptiveAE: An Adaptive Exposure Strategy for HDR Capturing in Dynamic Scenes](https://mlsanity.com/paper/2508.13503/) (2025)
- [A Cycle Ride to HDR: Semantics Aware Self-Supervised Framework for Unpaired LDR-to-HDR Image Reconstruction](https://mlsanity.com/paper/2410.15068/) (2024)
- [PhysHDR: When Lighting Meets Materials and Scene Geometry in HDR Reconstruction](https://mlsanity.com/paper/2509.16869/) (2025)
- [InstantHDR: Single-forward Gaussian Splatting Initialization for HDR 3D Reconstruction](https://mlsanity.com/paper/2603.11298/) (2026)
- [Dynamic Exposure Burst Image Restoration](https://mlsanity.com/paper/2603.21784/) (2026)
- [Neural Block-wise Auto-exposure for Single-Shot High Dynamic Range Imaging](https://mlsanity.com/paper/2610.18733/) (2026)

## Abstract (arXiv)

Merging multi-exposure images is a common approach for obtaining high dynamic range (HDR) images, with the primary challenge being the avoidance of ghosting artifacts in dynamic scenes. Recent methods have proposed using deep neural networks for deghosting. However, the methods typically rely on sufficient data with HDR ground-truths, which are difficult and costly to collect. In this work, to eliminate the need for labeled data, we propose SelfHDR, a self-supervised HDR reconstruction method that only requires dynamic multi-exposure images during training. Specifically, SelfHDR learns a reconstruction network under the supervision of two complementary components, which can be constructed from multi-exposure images and focus on HDR color as well as structure, respectively. The color component is estimated from aligned multi-exposure images, while the structure one is generated through a structure-focused network that is supervised by the color component and an input reference (eg, medium-exposure) image. During testing, the learned reconstruction network is directly deployed to predict an HDR image. Experiments on real-world images demonstrate our SelfHDR achieves superior results against the state-of-the-art self-supervised methods, and comparable performance to supervised ones. Codes are available at https://github.com/cszhilu1998/SelfHDR