HDR Video Generation via Latent Alignment with Logarithmic Encoding
Not on the map. Why?
Abstract (arXiv)
High dynamic range (HDR) imagery offers a rich and faithful representation of scene radiance, but remains challenging for generative models due to its mismatch with the bounded, perceptually compressed data on which these models are trained. A natural solution is to learn new representations for HDR, which introduces additional complexity and data requirements. In this work, we show that HDR generation can be achieved in a much simpler way by leveraging the strong visual priors already captured by pretrained generative models. We observe that a logarithmic encoding widely used in cinematic pipelines maps HDR imagery into a distribution that is naturally aligned with the latent space of these models, enabling direct adaptation via lightweight fine-tuning without retraining an encoder. To recover details that are not directly observable in the input, we further introduce a training strategy based on camera-mimicking degradations that encourages the model to infer missing high dynamic range content from its learned priors. Combining these insights, we demonstrate high-quality HDR video generation using a pretrained video model with minimal adaptation, achieving strong results across diverse scenes and challenging lighting conditions. Our results indicate that HDR, despite representing a fundamentally different image formation regime, can be handled effectively without redesigning generative models, provided that the representation is chosen to align with their learned priors.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 33 of its 64 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
33 of 64 references.
References · 33
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2017HDR image reconstruction from a single exposure using deep CNNscited by 167
21 more
- 2020Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipelinecited by 132
- 2018ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Contentcited by 89
- 2021HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Datasetcited by 45
- 2023HDR-VDP-3: A multi-metric for predicting image differences, quality and contrast distortions in high dynamic range and regular contentcited by 41
- 2024ColorVideoVDP: A visual difference predictor for image, video and display distortionscited by 34
- 2023Towards High-quality HDR Deghosting with Conditional Diffusion Modelscited by 33
- 2024HDRFlow: Real-Time HDR Video Reconstruction with Large Motionscited by 31
- 2021A New Journey from SDRTV to HDRTVcited by 30
- 2024LEDiff: Latent Exposure Diffusion for HDR Generationcited by 22
- 2022GlowGAN: Unsupervised Learning of HDR Images from LDR Images in the Wildcited by 21
- 2024Bracket Diffusion: HDR Image Generation by Consistent LDR Denoisingcited by 15
- 2025LuxDiT: Lighting Estimation with Video Diffusion Transformercited by 15
- 2024Towards Real-World HDR Video Reconstruction: A Large-Scale Benchmark Dataset and A Two-Stage Alignment Networkcited by 14
- 2023Learning a Practical SDR-to-HDRTV Up-conversion using New Dataset and Degradation Modelscited by 11
- 2020Consolidated Dataset and Metrics for High-Dynamic-Range Image Qualitycited by 10
- 2026X2HDR: HDR Image Generation in a Perceptually Uniform Spacecited by 7
- 2024Diffusion-Promoted HDR Video Reconstructioncited by 6
- 2021Deep HDR Hallucination for Inverse Tone Mappingcited by 5
- 2026AVControl: Efficient Framework for Training Audio-Visual Controlscited by 5
- 2023Towards Efficient SDRTV-to-HDRTV by Learning from Image Formationcited by 4
- 2026DiffHDR: Re-Exposing LDR Videos with Video Diffusion Modelscited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Single-Shot HDR Recovery via a Video Diffusion Priorcited by 0
- 2026Generating HDR Video from SDR Videocited by 0
- 2026Generating HDR Video from SDR Video14 May 2026
- 2026Single-Shot HDR Recovery via a Video Diffusion Prior12 May 2026