inkn'hue: Enhancing Manga Colorization from Multiple Priors with Alignment Multi-Encoder VAE
Not on the map. Why?
Abstract (arXiv)
Manga, a form of Japanese comics and distinct visual storytelling, has captivated readers worldwide. Traditionally presented in black and white, manga's appeal lies in its ability to convey complex narratives and emotions through intricate line art and shading. Yet, the desire to experience manga in vibrant colors has sparked the pursuit of manga colorization, a task of paramount significance for artists. However, existing methods, originally designed for line art and sketches, face challenges when applied to manga. These methods often fall short in achieving the desired results, leading to the need for specialized manga-specific solutions. Existing approaches frequently rely on a single training step or extensive manual artist intervention, which can yield less satisfactory outcomes. To address these challenges, we propose a specialized framework for manga colorization. Leveraging established models for shading and vibrant coloring, our approach aligns both using a multi-encoder VAE. This structured workflow ensures clear and colorful results, with the option to incorporate reference images and manual hints.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 3 Nov 2023.
Builds on
25 of 42 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2014Conditional Generative Adversarial Netscited by 2,162
13 more
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 565
- 2015An Introduction to Convolutional Neural Networkscited by 514
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
- 2015Denoising Criterion for Variational Auto-Encoding Frameworkcited by 43
- 2019Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Losscited by 35
- 2018User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networkscited by 32
- 2017Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GANcited by 28
- 2023Improved Diffusion-based Image Colorization via Piggybacked Modelscited by 15
- 2017cGAN-based Manga Colorization Using a Single Training Imagecited by 6
- 2021Painting Style-Aware Manga Colorization Based on Generative Adversarial Networkscited by 3
- 2023Line Art Colorization of Fakemon using Generative Adversarial Neural Networkscited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.