# A Unified HDR Imaging Method with Pixel and Patch Level

arXiv: https://arxiv.org/abs/2304.06943 · HTML: https://mlsanity.com/paper/2304.06943/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 35 references that are in the map.
- First posted on arXiv 14 Apr 2023.

## Builds on (most cited first, 11 of 11)

- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [SwinIR: Image Restoration Using Swin Transformer](https://mlsanity.com/paper/2108.10257/) (2021)
- [How Do Vision Transformers Work?](https://mlsanity.com/paper/2202.06709/) (2022)
- [Vision Transformer with Deformable Attention](https://mlsanity.com/paper/2201.00520/) (2022)
- [Attention-guided Network for Ghost-free High Dynamic Range Imaging](https://mlsanity.com/paper/1904.10293/) (2019)
- [Deep High Dynamic Range Imaging with Large Foreground Motions](https://mlsanity.com/paper/1711.08937/) (2017)
- [HDR-GAN: HDR Image Reconstruction from Multi-Exposed LDR Images with Large Motions](https://mlsanity.com/paper/2007.01628/) (2020)
- [Ghost-free High Dynamic Range Imaging with Context-aware Transformer](https://mlsanity.com/paper/2208.05114/) (2022)
- [ADNet: Attention-guided Deformable Convolutional Network for High Dynamic Range Imaging](https://mlsanity.com/paper/2105.10697/) (2021)
- [Attention-Guided Progressive Neural Texture Fusion for High Dynamic Range Image Restoration](https://mlsanity.com/paper/2107.06211/) (2021)
- [Progressive and Selective Fusion Network for High Dynamic Range Imaging](https://mlsanity.com/paper/2108.08585/) (2021)

## Built on by (most cited first, 17 of 17)

- [HDRFlow: Real-Time HDR Video Reconstruction with Large Motions](https://mlsanity.com/paper/2403.03447/) (2024)
- [Generating Content for HDR Deghosting from Frequency View](https://mlsanity.com/paper/2404.00849/) (2024)
- [Towards Real-World HDR Video Reconstruction: A Large-Scale Benchmark Dataset and A Two-Stage Alignment Network](https://mlsanity.com/paper/2405.00244/) (2024)
- [Self-Supervised High Dynamic Range Imaging with Multi-Exposure Images in Dynamic Scenes](https://mlsanity.com/paper/2310.01840/) (2023)
- [CRNet: A Detail-Preserving Network for Unified Image Restoration and Enhancement Task](https://mlsanity.com/paper/2404.14132/) (2024)
- [Single-Image HDR Reconstruction Assisted Ghost Suppression and Detail Preservation Network for Multi-Exposure HDR Imaging](https://mlsanity.com/paper/2403.04228/) (2024)
- [PASTA: Towards Flexible and Efficient HDR Imaging Via Progressively Aggregated Spatio-Temporal Alignment](https://mlsanity.com/paper/2403.10376/) (2024)
- [Capturing Stable HDR Videos Using a Dual-Camera System](https://mlsanity.com/paper/2507.06593/) (2025)
- [Boosting HDR Image Reconstruction via Semantic Knowledge Transfer](https://mlsanity.com/paper/2503.15361/) (2025)
- [S2R-HDR: A Large-Scale Rendered Dataset for HDR Fusion](https://mlsanity.com/paper/2504.07667/) (2025)
- [High Dynamic Range Novel View Synthesis with Single Exposure](https://mlsanity.com/paper/2505.01212/) (2025)
- [GMODiff: One-Step Gain Map Refinement with Diffusion Priors for HDR Reconstruction](https://mlsanity.com/paper/2512.16357/) (2025)
- [A Cycle Ride to HDR: Semantics Aware Self-Supervised Framework for Unpaired LDR-to-HDR Image Reconstruction](https://mlsanity.com/paper/2410.15068/) (2024)
- [iHDR: Iterative HDR Imaging with Arbitrary Number of Exposures](https://mlsanity.com/paper/2505.22971/) (2025)
- [LoCAtion: Long-time Collaborative Attention Framework for High Dynamic Range Video Reconstruction](https://mlsanity.com/paper/2603.14377/) (2026)
- [Dynamic Exposure Burst Image Restoration](https://mlsanity.com/paper/2603.21784/) (2026)
- [Depth-guided Multi-view Exposure Bracketing for HDR Robot Vision](https://mlsanity.com/paper/2608.16014/) (2026)

## Abstract (arXiv)

Mapping Low Dynamic Range (LDR) images with different exposures to High Dynamic Range (HDR) remains nontrivial and challenging on dynamic scenes due to ghosting caused by object motion or camera jitting. With the success of Deep Neural Networks (DNNs), several DNNs-based methods have been proposed to alleviate ghosting, they cannot generate approving results when motion and saturation occur. To generate visually pleasing HDR images in various cases, we propose a hybrid HDR deghosting network, called HyHDRNet, to learn the complicated relationship between reference and non-reference images. The proposed HyHDRNet consists of a content alignment subnetwork and a Transformer-based fusion subnetwork. Specifically, to effectively avoid ghosting from the source, the content alignment subnetwork uses patch aggregation and ghost attention to integrate similar content from other non-reference images with patch level and suppress undesired components with pixel level. To achieve mutual guidance between patch-level and pixel-level, we leverage a gating module to sufficiently swap useful information both in ghosted and saturated regions. Furthermore, to obtain a high-quality HDR image, the Transformer-based fusion subnetwork uses a Residual Deformable Transformer Block (RDTB) to adaptively merge information for different exposed regions. We examined the proposed method on four widely used public HDR image deghosting datasets. Experiments demonstrate that HyHDRNet outperforms state-of-the-art methods both quantitatively and qualitatively, achieving appealing HDR visualization with unified textures and colors.
