mlsanityData to 7 Oct 2026

MangaNinja: Line Art Colorization with Precise Reference Following

arXiv 2501.08332 ↗First posted 14 Jan 2025cs.CVcited by 17

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Derived from diffusion models, MangaNinjia specializes in the task of reference-guided line art colorization. We incorporate two thoughtful designs to ensure precise character detail transcription, including a patch shuffling module to facilitate correspondence learning between the reference color image and the target line art, and a point-driven control scheme to enable fine-grained color matching. Experiments on a self-collected benchmark demonstrate the superiority of our model over current solutions in terms of precise colorization. We further showcase the potential of the proposed interactive point control in handling challenging cases, cross-character colorization, multi-reference harmonization, beyond the reach of existing algorithms.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 57 of its 86 references that are in the map. First posted on arXiv 14 Jan 2025.

Builds on

57 of 86 references.

Closest ancestors · 18

Same direction, newest first

  1. 2024LVCD: Reference-based Lineart Video Colorization with Diffusion Models19 Sep
  2. 2023Diffusing Colors: Image Colorization with Text Guided Diffusion7 Dec
  3. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  4. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models5 Jul
  5. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing26 Jun
  6. 2023Emergent Correspondence from Image Diffusion6 Jun
  7. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models29 May
  8. 2023Unsupervised Semantic Correspondence Using Stable Diffusion24 May
  9. 2023Guided Image Synthesis via Initial Image Editing in Diffusion Model5 May
  10. 2023AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Models20 Mar
  11. 2023Cones: Concept Neurons in Diffusion Models for Customized Generation9 Mar
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
6 more
  1. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  2. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  4. 2022MagicMix: Semantic Mixing with Diffusion Models28 Oct
  5. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 39

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2022Generative Adversarial Networkscited by 5,603
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  7. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  8. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  9. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  10. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  11. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  12. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
27 more
  1. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  2. 2019Learning Correspondence from the Cycle-Consistency of Timecited by 269
  3. 2020Space-Time Correspondence as a Contrastive Random Walkcited by 239
  4. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  5. 2017A Survey of Structure from Motioncited by 157
  6. 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
  7. 2020Learning Feature Descriptors using Camera Pose Supervisioncited by 104
  8. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
  9. 2022Towards Grand Unification of Object Trackingcited by 93
  10. 2016Scribbler: Controlling Deep Image Synthesis with Sketch and Colorcited by 77
  11. 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
  12. 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
  13. 2021GAN-Supervised Dense Visual Alignmentcited by 61
  14. 2023RealFill: Reference-Driven Generation for Authentic Image Completioncited by 58
  15. 2019Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Losscited by 35
  16. 2024Control Color: Multimodal Diffusion-based Interactive Image Colorizationcited by 33
  17. 2022Learning Semantic Correspondence with Sparse Annotationscited by 31
  18. 2023DreamInpainter: Text-Guided Subject-Driven Image Inpainting with Diffusion Modelscited by 30
  19. 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
  20. 2022TransforMatcher: Match-to-Match Attention for Semantic Correspondencecited by 29
  21. 2022Eliminating Gradient Conflict in Reference-based Line-Art Colorizationcited by 25
  22. 2024AniDoc: Animation Creation Made Easiercited by 22
  23. 2021The Animation Transformer: Visual Correspondence via Segment Matchingcited by 20
  24. 2023CLiC: Concept Learning in Contextcited by 20
  25. 2024Sakuga-42M Dataset: Scaling Up Cartoon Researchcited by 17
  26. 2024Learning Inclusion Matching for Animation Paint Bucket Colorizationcited by 14
  27. 2024Edicho: Consistent Image Editing in the Wildcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 10.

17 papers.

Sort:

By area:

  1. 2025TUNA: Taming Unified Visual Representations for Native Unified Multimodal Modelscited by 34
  2. 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perceptioncited by 14
  3. 2025Follow-Your-Color: Multi-Instance Sketch Colorizationcited by 10
  4. 2026VecGlypher: Unified Vector Glyph Generation with Language Modelscited by 3
  5. 2026Gloria: Consistent Character Video Generation via Content Anchorscited by 3
  6. 2025DACoN: DINO for Anime Paint Bucket Colorization with Any Number of Reference Imagescited by 2
  7. 2026Workflow-Aware Structured Layer Decomposition for Illustration Productioncited by 1
  8. 2026InstanceAnimator: Multi-Instance Sketch Video Colorizationcited by 1
  9. 2026OmniColor: A Unified Framework for Multi-modal Lineart Colorizationcited by 1
  10. 2025MagicAnime: A Hierarchically Annotated, Multimodal and Multitasking Dataset with Benchmarks for Cartoon Animation Generationcited by 0
  11. 2025MangaDiT: Reference-Guided Line Art Colorization with Hierarchical Attention in Diffusion Transformerscited by 0
  12. 2025Region-Wise Correspondence Prediction between Manga Line Art Imagescited by 0
5 more
  1. 2026Uni-Animator: Towards Unified Visual Colorizationcited by 0
  2. 2026Towards High-resolution and Disentangled Reference-based Sketch Colorizationcited by 0
  3. 2026SketchKeyAnime: Reference-anchored Sparse Key-Sketch Animation Synthesiscited by 0
  4. 2026PeCA: Palette Context Assisted Inference for Test-Time Paint-Bucket Colourisation on Animation Videoscited by 0
  5. 2026No Pixel Left Behind: Filling Gaps in Anime Colorizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Cobra: Efficient Line Art COlorization with BRoAder References
  2. 2025AnimeColor: Reference-based Animation Colorization with Diffusion Transformers
  3. 2024ColorizeDiffusion: Adjustable Sketch Colorization with Reference Image and Text
  4. 2025Image Referenced Sketch Colorization Based on Animation Creation Workflow
  5. 2024ColorFlow: Retrieval-Augmented Image Sequence Colorization
  6. 2023Stable Diffusion Reference Only: Image Prompt and Blueprint Jointly Guided Multi-Condition Diffusion Model for Secondary Painting
  7. 2025SSIMBaD: Sigma Scaling with SSIM-Guided Balanced Diffusion for AnimeFace Colorization
  8. 2021Generative Probabilistic Image Colorization