SketchColour: Channel Concat Guided DiT-based Sketch-to-Colour Pipeline for 2D Animation
Not on the map. Why?
Abstract (arXiv)
The production of high-quality 2D animation is highly labor-intensive process, as animators are currently required to draw and color a large number of frames by hand. We present SketchColour, the first sketch-to-colour pipeline for 2D animation built on a diffusion transformer (DiT) backbone. By replacing the conventional U-Net denoiser with a DiT-style architecture and injecting sketch information via lightweight channel-concatenation adapters accompanied with LoRA finetuning, our method natively integrates conditioning without the parameter and memory bloat of a duplicated ControlNet, greatly reducing parameter count and GPU memory usage. Evaluated on the SAKUGA dataset, SketchColour outperforms previous state-of-the-art video colourization methods across all metrics, despite using only half the training data of competing models. Our approach produces temporally coherent animations with minimal artifacts such as colour bleeding or object deformation. Our code is available at: https://bconstantine.github.io/SketchColour .
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 20 of its 24 references that are in the map. First posted on arXiv 2 Jul 2025.
Builds on
20 of 24 references.
References · 20
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,103
- 2022Scalable Diffusion Models with Transformerscited by 5,973
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,484
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,610
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,550
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,218
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,625
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 473
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 466
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 386
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
8 more
- 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 60
- 2019Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Losscited by 35
- 2024LVCD: Reference-based Lineart Video Colorization with Diffusion Modelscited by 27
- 2022Eliminating Gradient Conflict in Reference-based Line-Art Colorizationcited by 25
- 2024AniDoc: Animation Creation Made Easiercited by 22
- 2024Sakuga-42M Dataset: Scaling Up Cartoon Researchcited by 17
- 2025Follow-Your-Color: Multi-Instance Sketch Colorizationcited by 10
- 2025Cobra: Efficient Line Art COlorization with BRoAder Referencescited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Uni-Animator: Towards Unified Visual Colorization
- 2025AnimeColor: Reference-based Animation Colorization with Diffusion Transformers
- 2025Image Referenced Sketch Colorization Based on Animation Creation Workflow
- 2026SketchKeyAnime: Reference-anchored Sparse Key-Sketch Animation Synthesis
- 2024Sketch-Guided Stylized Landscape Cinemagraph Synthesis
- 2025SketchAnimator: Animate Sketch via Motion Customization of Text-to-Video Diffusion Models
- 2024FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations
- 2026Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization