mlsanityData to 14 Oct 2026

OmniColor: A Unified Framework for Multi-modal Lineart Colorization

arXiv 2603.27531 ↗First posted 29 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Lineart colorization is a critical stage in professional content creation, yet achieving precise and flexible results under diverse user constraints remains a significant challenge. To address this, we propose OmniColor, a unified framework for multi-modal lineart colorization that supports arbitrary combinations of control signals. Specifically, we systematically categorize guidance signals into two types: spatially-aligned conditions and semantic-reference conditions. For spatially-aligned inputs, we employ a dual-path encoding strategy paired with a Dense Feature Alignment loss to ensure rigorous boundary preservation and precise color restoration. For semantic-reference inputs, we utilize a VLM-only encoding scheme integrated with a Temporal Redundancy Elimination mechanism to filter repetitive information and enhance inference efficiency. To resolve potential input conflicts, we introduce an Adaptive Spatial-Semantic Gating module that dynamically balances multi-modal constraints. Experimental results demonstrate that OmniColor achieves superior controllability, visual quality, and temporal stability, providing a robust and practical solution for lineart colorization. The source code and dataset will be open at https://github.com/zhangxulu1996/OmniColor.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 50 of its 72 references that are in the map. First posted on arXiv 29 Mar 2026.

Builds on

50 of 72 references.

References · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2022Flow Matching for Generative Modelingcited by 5,702
  7. 2025Qwen2.5-VL Technical Reportcited by 5,587
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2017Squeeze-and-Excitation Networkscited by 4,789
  10. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
38 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  2. 2025DINOv3cited by 1,414
  3. 2025Qwen-Image Technical Reportcited by 1,044
  4. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  5. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  6. 2025SAM 3: Segment Anything with Conceptscited by 906
  7. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  8. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  9. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  10. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  11. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  12. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  13. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  14. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  15. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  16. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  17. 2025Transfer between Modalities with MetaQueriescited by 236
  18. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  19. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
  20. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 132
  21. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  22. 2022Learning to generate line drawings that convey geometry and semanticscited by 83
  23. 2016Scribbler: Controlling Deep Image Synthesis with Sketch and Colorcited by 78
  24. 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 53
  25. 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 38
  26. 2019Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Losscited by 35
  27. 2024Control Color: Multimodal Diffusion-based Interactive Image Colorizationcited by 33
  28. 2024LVCD: Reference-based Lineart Video Colorization with Diffusion Modelscited by 27
  29. 2022Eliminating Gradient Conflict in Reference-based Line-Art Colorizationcited by 25
  30. 2024AniDoc: Animation Creation Made Easiercited by 22
  31. 2021The Animation Transformer: Visual Correspondence via Segment Matchingcited by 20
  32. 2025Multimodal Representation Alignment for Image Generation: Text-Image Interleaved Control Is Easier Than You Thinkcited by 18
  33. 2025MangaNinja: Line Art Colorization with Precise Reference Followingcited by 17
  34. 2025SketchVideo: Sketch-based Video Generation and Editingcited by 16
  35. 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editingcited by 15
  36. 2024Learning Inclusion Matching for Animation Paint Bucket Colorizationcited by 14
  37. 2024ColorizeDiffusion: Adjustable Sketch Colorization with Reference Image and Textcited by 8
  38. 2025AnimeColor: Reference-based Animation Colorization with Diffusion Transformerscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Training-Free Text-Guided Color Editing with Multi-Modal Diffusion Transformer
  2. 2025Language-based Image Colorization: A Benchmark and Beyond
  3. 2026Recolour What Matters: Region-Aware Colour Editing via Token-Level Diffusion
  4. 2026Histogram Assisted Quality Aware Generative Model for Resolution Invariant NIR Image Colorization
  5. 2024Multimodal Semantic-Aware Automatic Colorization with Diffusion Prior
  6. 2026Multimodal Image Colorization: Quantifying the Impact of Text-Conditioned Guidance on Grayscale-to-Color Translation
  7. 2023ChromaDistill: Colorizing Monochrome Radiance Fields with Knowledge Distillation
  8. 2023L-CAD: Language-based Colorization with Any-level Descriptions using Diffusion Priors