mlsanityData to 14 Oct 2026

Deep Video Harmonization with Color Mapping Consistency

arXiv 2205.00687 ↗First posted 2 May 2022cs.CV cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Video harmonization aims to adjust the foreground of a composite video to make it compatible with the background. So far, video harmonization has only received limited attention and there is no public dataset for video harmonization. In this work, we construct a new video harmonization dataset HYouTube by adjusting the foreground of real videos to create synthetic composite videos. Moreover, we consider the temporal consistency in video harmonization task. Unlike previous works which establish the spatial correspondence, we design a novel framework based on the assumption of color mapping consistency, which leverages the color mapping of neighboring frames to refine the current frame. Extensive experiments on our HYouTube dataset prove the effectiveness of our proposed framework. Our dataset and code are available at https://github.com/bcmi/Video-Harmonization-Dataset-HYouTube.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 2 May 2022.

Builds on

15 of 32 references.

References · 15

  1. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  2. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  3. 2017Video Enhancement with Task-Oriented Flowcited by 619
  4. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
  5. 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 135
  6. 2017Deep Image Harmonizationcited by 120
  7. 2019Improving the Harmony of the Composite Image by Spatial-Separated Attention Modulecited by 73
  8. 2021Region-aware Adaptive Instance Normalization for Image Harmonizationcited by 71
  9. 2020Efficient Semantic Video Segmentation with Per-frame Inferencecited by 63
  10. 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
  11. 2020Foreground-aware Semantic Representations for Image Harmonizationcited by 53
  12. 2015Learning a Discriminative Model for the Perception of Realism in Composite Imagescited by 52
3 more
  1. 2020BargainNet: Background-Guided Domain Translation for Image Harmonizationcited by 52
  2. 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
  3. 2018Temporally Coherent Video Harmonization Using Adversarial Networkscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 3; 2026: 3.

9 papers.

  1. 2023Dense Pixel-to-Pixel Harmonization via Continuous Image Representationcited by 19
  2. 2024DeCo: Decoupled Human-Centered Diffusion Video Editing with Motion Consistencycited by 13
  3. 2026DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion Enhancercited by 10
  4. 2025Video Color Grading via Look-Up Table Generationcited by 9
  5. 2025GenCompositor: Generative Video Compositing with Diffusion Transformercited by 9
  6. 2024Training-Free Semantic Video Composition via Pre-trained Diffusion Modelcited by 4
  7. 2025EndoControlMag: Robust Endoscopic Vascular Motion Magnification with Periodic Reference Resetting and Hierarchical Tissue-aware Dual-Mask Controlcited by 0
  8. 2026HarmoVid: Relightful Video Portrait Harmonizationcited by 0
  9. 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Controlcited by 0