Deep Exemplar-based Video Colorization
Not on the map. Why?
Abstract (arXiv)
This paper presents the first end-to-end network for exemplar-based video colorization. The main challenge is to achieve temporal consistency while remaining faithful to the reference style. To address this issue, we introduce a recurrent framework that unifies the semantic correspondence and color propagation steps. Both steps allow a provided reference image to guide the colorization of every frame, thus reducing accumulated propagation errors. Video frames are colorized in sequence based on the colorization history, and its coherency is further enforced by the temporal consistency loss. All of these components, learned end-to-end, help produce realistic videos with good temporal stability. Experiments show our result is superior to the state-of-the-art methods both quantitatively and qualitatively.
Key facts. Cited by 75 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 16; 2023: 19; 2024: 11; 2025: 7; 2026: 4.
75 papers.
Sort:
By area:
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2021Colorization Transformercited by 89
- 2021Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondencescited by 66
- 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulationcited by 59
- 2021Towards Vivid and Diverse Image Colorization with Generative Color Priorcited by 55
- 2021Unbalanced Feature Transport for Exemplar-based Image Translationcited by 41
- 2023Test-Time Training on Video Streamscited by 37
- 2024Control Color: Multimodal Diffusion-based Interactive Image Colorizationcited by 33
- 2022Bringing Old Films Back to Lifecited by 31
- 2022NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural Representationscited by 31
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
38 more
- 2023Blind Video Deflickering by Neural Filtering with a Flawed Atlascited by 27
- 2021Temporally Consistent Video Colorization with Deep Feature Propagation and Self-regularization Learningcited by 22
- 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstructioncited by 21
- 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
- 2021The Animation Transformer: Visual Correspondence via Segment Matchingcited by 20
- 2022Few-Shot Head Swapping in the Wildcited by 20
- 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Modelscited by 19
- 2022BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorizationcited by 13
- 2021VCGAN: Video Colorization with Hybrid Generative Adversarial Networkcited by 12
- 2021Deep Edge-Aware Interactive Colorization against Color-Bleeding Effectscited by 12
- 2021Semantic-Sparse Colorization Network for Deep Exemplar-based Colorizationcited by 12
- 2023Video Colorization with Pre-trained Text-to-Image Diffusion Modelscited by 11
- 2025Follow-Your-Color: Multi-Instance Sketch Colorizationcited by 10
- 2021Color2Embed: Fast Exemplar-Based Image Colorization using Color Embeddingscited by 9
- 2023AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Modelscited by 9
- 2022SCSNet: An Efficient Paradigm for Learning Simultaneously Image Colorization and Super-Resolutioncited by 8
- 2022Pik-Fix: Restoring and Colorizing Old Photoscited by 8
- 2024ColorMNet: A Memory-based Deep Spatial-Temporal Feature Propagation Network for Video Colorizationcited by 8
- 2022UniColor: A Unified Framework for Multi-Modal Colorization with Transformercited by 7
- 2024Automatic Controllable Colorization via Imaginationcited by 7
- 2021Neural Photometry-guided Visual Attribute Transfercited by 6
- 2022Photo-to-Shape Material Transfer for Diverse Structurescited by 5
- 2023ChromaDistill: Colorizing Monochrome Radiance Fields with Knowledge Distillationcited by 5
- 2025InstaFace: Identity-Preserving Facial Editing with Single Image Inferencecited by 5
- 2023Exemplar-based Video Colorization with Long-term Spatiotemporal Dependencycited by 4
- 2023Modernizing Old Photos Using Multiple References via Photorealistic Style Transfercited by 4
- 2025VDOT: Efficient Unified Video Creation via Optimal Transport Distillationcited by 4
- 2022Time-of-Day Neural Style Transfer for Architectural Photographscited by 3
- 2023Learning Data-Driven Vector-Quantized Degradation Model for Animation Video Super-Resolutioncited by 3
- 2023SVCNet: Scribble-based Video Colorization Network with Temporal Aggregationcited by 3
- 2023SPColor: Semantic Prior Guided Exemplar-based Image Colorizationcited by 3
- 2023StyleRetoucher: Generalized Portrait Image Retouching with GAN Priorscited by 3
- 2024IReNe: Instant Recoloring of Neural Radiance Fieldscited by 3
- 2021Attention-based Stylisation for Exemplar Image Colourisationcited by 2
- 2022Task Agnostic Restoration of Natural Video Dynamicscited by 2
- 2023SARA: Controllable Makeup Transfer with Spatial Alignment and Region-Adaptive Normalizationcited by 2
- 2021Guided Colorization Using Mono-Color Image Pairscited by 1
- 2022Unsupervised Structure-Consistent Image-to-Image Translationcited by 1
50 most cited of 75 All 75 (JSON)
- 2026Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References27 Aug 2026
- 2026CAGS: Color-Adaptive Volumetric Video Streaming with Dynamic 3D Gaussian Splatting10 May 2026
- 2026VIRGi: View-dependent Instant Recoloring of 3D Gaussians Splats3 Mar 2026
- 2026Face Normal Estimation from Rags to Riches5 Jan 2026
- 2025VDOT: Efficient Unified Video Creation via Optimal Transport Distillation7 Dec 2025
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks2 Dec 2025
- 2025Prompt-based Consistent Video Colorization27 Nov 2025
- 2025Structure-preserving Feature Alignment for Old Photo Colorization18 Aug 2025
- 2025Follow-Your-Color: Multi-Instance Sketch Colorization21 Mar 2025
- 2025InstaFace: Identity-Preserving Facial Editing with Single Image Inference27 Feb 2025
- 2025Consistent Video Colorization via Palette Guidance31 Jan 2025
- 2024Enabling Region-Specific Control via Lassos in Point-Based Colorization18 Dec 2024
38 more
- 2024L-C4: Language-Based Video Colorization for Creative and Consistent Color7 Oct 2024
- 2024Computer-aided Colorization State-of-the-science: A Survey3 Oct 2024
- 2024Adapting MIMO video restoration networks to low latency constraints22 Aug 2024
- 2024IReNe: Instant Recoloring of Neural Radiance Fields30 May 2024
- 2024Palette-based Color Transfer between Images14 May 2024
- 2024LatentColorization: Latent Diffusion-Based Speaker Video Colorization9 May 2024
- 2024ColorMNet: A Memory-based Deep Spatial-Temporal Feature Propagation Network for Video Colorization9 Apr 2024
- 2024Automatic Controllable Colorization via Imagination8 Apr 2024
- 2024Translation-based Video-to-Video Synthesis3 Apr 2024
- 2024Control Color: Multimodal Diffusion-based Interactive Image Colorization16 Feb 2024
- 2023StyleRetoucher: Generalized Portrait Image Retouching with GAN Priors22 Dec 2023
- 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models30 Nov 2023
- 2023SARA: Controllable Makeup Transfer with Spatial Alignment and Region-Adaptive Normalization28 Nov 2023
- 2023DI-Net : Decomposed Implicit Garment Transfer Network for Digital Clothed 3D Human28 Nov 2023
- 2023ChromaDistill: Colorizing Monochrome Radiance Fields with Knowledge Distillation14 Sep 2023
- 2023Histogram-guided Video Colorization Structure with Spatial-Temporal Connection9 Aug 2023
- 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation2 Aug 2023
- 2023Test-Time Training on Video Streams11 Jul 2023
- 2023Improving Video Colorization by Test-Time Tuning25 Jun 2023
- 2023Stable Remaster: Bridging the Gap Between Old Content and New Displays11 Jun 2023
- 2023Video Colorization with Pre-trained Text-to-Image Diffusion Models2 Jun 2023
- 2023Temporal Consistent Automatic Video Colorization via Semantic Correspondence13 May 2023
- 2023SPColor: Semantic Prior Guided Exemplar-based Image Colorization13 Apr 2023
- 2023Modernizing Old Photos Using Multiple References via Photorealistic Style Transfer10 Apr 2023
- 2023Exemplar-based Video Colorization with Long-term Spatiotemporal Dependency27 Mar 2023
- 2023SVCNet: Scribble-based Video Colorization Network with Temporal Aggregation21 Mar 2023
- 2023AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Models20 Mar 2023
- 2023Learning Data-Driven Vector-Quantized Degradation Model for Animation Video Super-Resolution17 Mar 2023
- 2023Blind Video Deflickering by Neural Filtering with a Flawed Atlas14 Mar 2023
- 2022BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization5 Dec 2022
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov 2022
- 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstruction18 Nov 2022
- 2022UniColor: A Unified Framework for Multi-Modal Colorization with Transformer22 Sep 2022
- 2022Time-of-Day Neural Style Transfer for Architectural Photographs13 Sep 2022
- 2022Unsupervised Structure-Consistent Image-to-Image Translation24 Aug 2022
- 2022ParaColorizer: Realistic Image Colorization using Parallel Generative Networks17 Aug 2022
- 2022iColoriT: Towards Propagating Local Hint to the Right Region in Interactive Colorization by Leveraging Vision Transformer14 Jul 2022
- 2022Task Agnostic Restoration of Natural Video Dynamics8 Jun 2022
50 newest of 75 All 75 (JSON)
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Modelscited by 19
- 2023Video Colorization with Pre-trained Text-to-Image Diffusion Modelscited by 11
- 2023AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Modelscited by 9
- 2023Stable Remaster: Bridging the Gap Between Old Content and New Displayscited by 0
- 2024LatentColorization: Latent Diffusion-Based Speaker Video Colorizationcited by 0
- 2026Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal Referencescited by 0
- 2026Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References27 Aug 2026
- 2024LatentColorization: Latent Diffusion-Based Speaker Video Colorization9 May 2024
- 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models30 Nov 2023
- 2023Stable Remaster: Bridging the Gap Between Old Content and New Displays11 Jun 2023
- 2023Video Colorization with Pre-trained Text-to-Image Diffusion Models2 Jun 2023
- 2023AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Models20 Mar 2023
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov 2022
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2021Colorization Transformercited by 89
- 2021Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondencescited by 66
- 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulationcited by 59
- 2021Towards Vivid and Diverse Image Colorization with Generative Color Priorcited by 55
- 2021Unbalanced Feature Transport for Exemplar-based Image Translationcited by 41
- 2023Test-Time Training on Video Streamscited by 37
- 2024Control Color: Multimodal Diffusion-based Interactive Image Colorizationcited by 33
- 2022Bringing Old Films Back to Lifecited by 31
- 2022NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural Representationscited by 31
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
- 2023Blind Video Deflickering by Neural Filtering with a Flawed Atlascited by 27
12 most cited of 68 All 68 (JSON)
- 2026CAGS: Color-Adaptive Volumetric Video Streaming with Dynamic 3D Gaussian Splatting10 May 2026
- 2026VIRGi: View-dependent Instant Recoloring of 3D Gaussians Splats3 Mar 2026
- 2026Face Normal Estimation from Rags to Riches5 Jan 2026
- 2025VDOT: Efficient Unified Video Creation via Optimal Transport Distillation7 Dec 2025
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks2 Dec 2025
- 2025Prompt-based Consistent Video Colorization27 Nov 2025
- 2025Structure-preserving Feature Alignment for Old Photo Colorization18 Aug 2025
- 2025Follow-Your-Color: Multi-Instance Sketch Colorization21 Mar 2025
- 2025InstaFace: Identity-Preserving Facial Editing with Single Image Inference27 Feb 2025
- 2025Consistent Video Colorization via Palette Guidance31 Jan 2025
- 2024Enabling Region-Specific Control via Lassos in Point-Based Colorization18 Dec 2024
- 2024L-C4: Language-Based Video Colorization for Creative and Consistent Color7 Oct 2024
12 newest of 68 All 68 (JSON)