Wavelet-Domain Masked Image Modeling for Color-Consistent HDR Video Reconstruction
Not on the map. Why?
Abstract (arXiv)
High Dynamic Range (HDR) video reconstruction aims to recover fine brightness, color, and details from Low Dynamic Range (LDR) videos. However, existing methods often suffer from color inaccuracies and temporal inconsistencies. To address these challenges, we propose WMNet, a novel HDR video reconstruction network that leverages Wavelet domain Masked Image Modeling (W-MIM). WMNet adopts a two-phase training strategy: In Phase I, W-MIM performs self-reconstruction pre-training by selectively masking color and detail information in the wavelet domain, enabling the network to develop robust color restoration capabilities. A curriculum learning scheme further refines the reconstruction process. Phase II fine-tunes the model using the pre-trained weights to improve the final reconstruction quality. To improve temporal consistency, we introduce the Temporal Mixture of Experts (T-MoE) module and the Dynamic Memory Module (DMM). T-MoE adaptively fuses adjacent frames to reduce flickering artifacts, while DMM captures long-range dependencies, ensuring smooth motion and preservation of fine details. Additionally, since existing HDR video datasets lack scene-based segmentation, we reorganize HDRTV4K into HDRTV4K-Scene, establishing a new benchmark for HDR video reconstruction. Extensive experiments demonstrate that WMNet achieves state-of-the-art performance across multiple evaluation metrics, significantly improving color fidelity, temporal coherence, and perceptual quality. The code is available at: https://github.com/eezkni/WMNet
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 44 references that are in the map. First posted on arXiv 7 Feb 2026.
Builds on
32 of 44 references.
References · 32
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
- 2019Video Object Segmentation using Space-Time Memory Networkscited by 436
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 340
- 2022VRT: A Video Restoration Transformercited by 219
- 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
- 2020Learning Image-adaptive 3D Lookup Tables for High Performance Photo Enhancement in Real-timecited by 163
20 more
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
- 2019Deep Video Inpaintingcited by 107
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2020Conditional Sequential Modulation for Efficient Global Image Retouchingcited by 71
- 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 58
- 2022Pin the Memory: Learning to Generalize Semantic Segmentationcited by 48
- 2021HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Datasetcited by 45
- 2023Masked Image Modeling with Local Multi-Scale Reconstructioncited by 43
- 2019Deep SR-ITM: Joint Learning of Super-Resolution and Inverse Tone-Mapping for 4K UHD HDR Applicationscited by 39
- 2022Learning Quality-aware Dynamic Memory for Video Object Segmentationcited by 35
- 2019JSI-GAN: GAN-Based Joint Super-Resolution and Inverse Tone-Mapping with Pixel-Wise Task-Specific Filters for UHD HDR Videocited by 31
- 2021A New Journey from SDRTV to HDRTVcited by 30
- 2024HDRFlow: Real-Time HDR Video Reconstruction with Large Motionscited by 30
- 2023LAN-HDR: Luminance-based Alignment Network for High Dynamic Range Video Reconstructioncited by 18
- 2022Multi-Scale Memory-Based Video Deblurringcited by 16
- 2024Towards Real-World HDR Video Reconstruction: A Large-Scale Benchmark Dataset and A Two-Stage Alignment Networkcited by 14
- 2022Sparsely-gated Mixture-of-Expert Layers for CNN Interpretabilitycited by 13
- 2023Learning a Practical SDR-to-HDRTV Up-conversion using New Dataset and Degradation Modelscited by 11
- 2024Temporal Residual Guided Diffusion Framework for Event-Driven Video Reconstructioncited by 10
- 2023Towards Efficient SDRTV-to-HDRTV by Learning from Image Formationcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Diffusion-Promoted HDR Video Reconstruction
- 2026Single-Shot HDR Recovery via a Video Diffusion Prior
- 2026DiffHDR: Re-Exposing LDR Videos with Video Diffusion Models
- 2026X2HDR: HDR Image Generation in a Perceptually Uniform Space
- 2024Generating Content for HDR Deghosting from Frequency View
- 2025GMODiff: One-Step Gain Map Refinement with Diffusion Priors for HDR Reconstruction
- 2023Towards High-quality HDR Deghosting with Conditional Diffusion Models
- 2026ExpoCM: Exposure-Aware One-Step Generative Single-Image HDR Reconstruction