Learning to Color from Language
Not on the map. Why?
Abstract (arXiv)
Automatic colorization is the process of adding color to greyscale images. We condition this process on language, allowing end users to manipulate a colorized image by feeding in different captions. We present two different architectures for language-conditioned colorization, both of which produce more accurate and plausible colorizations than a language-agnostic version. Through this language-based framework, we can dramatically alter colorizations by manipulating descriptive color words in captions.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 3; 2024: 7; 2025: 1.
16 papers.
Sort:
By area:
- 2024Control Color: Multimodal Diffusion-based Interactive Image Colorizationcited by 33
- 2023Diffusing Colors: Image Colorization with Text Guided Diffusioncited by 25
- 2021Semantic-Sparse Colorization Network for Deep Exemplar-based Colorizationcited by 12
- 2022UniColor: A Unified Framework for Multi-Modal Colorization with Transformercited by 7
- 2024Automatic Controllable Colorization via Imaginationcited by 7
- 2021Focusing on Persons: Colorizing Old Images Learning from Modern Historical Moviescited by 6
- 2024ColorFlow: Retrieval-Augmented Image Sequence Colorizationcited by 6
- 2023L-CAD: Language-based Colorization with Any-level Descriptions using Diffusion Priorscited by 5
- 2021Generating Compositional Color Representations from Textcited by 3
- 2024L-C4: Language-Based Video Colorization for Creative and Consistent Colorcited by 1
- 2021ViT-Inception-GAN for Image Colourisingcited by 0
- 2023MMC: Multi-Modal Colorization of Images using Textual Descriptionscited by 0
4 more
- 2024Audio-Infused Automatic Image Colorization by Exploiting Audio Scene Semanticscited by 0
- 2024Computer-aided Colorization State-of-the-science: A Surveycited by 0
- 2024Enabling Region-Specific Control via Lassos in Point-Based Colorizationcited by 0
- 2025Prompt-based Consistent Video Colorizationcited by 0
- 2025Prompt-based Consistent Video Colorization27 Nov 2025
- 2024Enabling Region-Specific Control via Lassos in Point-Based Colorization18 Dec 2024
- 2024ColorFlow: Retrieval-Augmented Image Sequence Colorization16 Dec 2024
- 2024L-C4: Language-Based Video Colorization for Creative and Consistent Color7 Oct 2024
- 2024Computer-aided Colorization State-of-the-science: A Survey3 Oct 2024
- 2024Automatic Controllable Colorization via Imagination8 Apr 2024
- 2024Control Color: Multimodal Diffusion-based Interactive Image Colorization16 Feb 2024
- 2024Audio-Infused Automatic Image Colorization by Exploiting Audio Scene Semantics24 Jan 2024
- 2023Diffusing Colors: Image Colorization with Text Guided Diffusion7 Dec 2023
- 2023L-CAD: Language-based Colorization with Any-level Descriptions using Diffusion Priors24 May 2023
- 2023MMC: Multi-Modal Colorization of Images using Textual Descriptions24 Apr 2023
- 2022UniColor: A Unified Framework for Multi-Modal Colorization with Transformer22 Sep 2022
4 more
- 2021Semantic-Sparse Colorization Network for Deep Exemplar-based Colorization2 Dec 2021
- 2021Generating Compositional Color Representations from Text22 Sep 2021
- 2021Focusing on Persons: Colorizing Old Images Learning from Modern Historical Movies14 Aug 2021
- 2021ViT-Inception-GAN for Image Colourising11 Jun 2021
- 2024Control Color: Multimodal Diffusion-based Interactive Image Colorizationcited by 33
- 2021Semantic-Sparse Colorization Network for Deep Exemplar-based Colorizationcited by 12
- 2022UniColor: A Unified Framework for Multi-Modal Colorization with Transformercited by 7
- 2024Automatic Controllable Colorization via Imaginationcited by 7
- 2021Focusing on Persons: Colorizing Old Images Learning from Modern Historical Moviescited by 6
- 2021Generating Compositional Color Representations from Textcited by 3
- 2024L-C4: Language-Based Video Colorization for Creative and Consistent Colorcited by 1
- 2021ViT-Inception-GAN for Image Colourisingcited by 0
- 2023MMC: Multi-Modal Colorization of Images using Textual Descriptionscited by 0
- 2024Audio-Infused Automatic Image Colorization by Exploiting Audio Scene Semanticscited by 0
- 2024Computer-aided Colorization State-of-the-science: A Surveycited by 0
- 2024Enabling Region-Specific Control via Lassos in Point-Based Colorizationcited by 0
12 most cited of 13 All 13 (JSON)
- 2025Prompt-based Consistent Video Colorization27 Nov 2025
- 2024Enabling Region-Specific Control via Lassos in Point-Based Colorization18 Dec 2024
- 2024L-C4: Language-Based Video Colorization for Creative and Consistent Color7 Oct 2024
- 2024Computer-aided Colorization State-of-the-science: A Survey3 Oct 2024
- 2024Automatic Controllable Colorization via Imagination8 Apr 2024
- 2024Control Color: Multimodal Diffusion-based Interactive Image Colorization16 Feb 2024
- 2024Audio-Infused Automatic Image Colorization by Exploiting Audio Scene Semantics24 Jan 2024
- 2023MMC: Multi-Modal Colorization of Images using Textual Descriptions24 Apr 2023
- 2022UniColor: A Unified Framework for Multi-Modal Colorization with Transformer22 Sep 2022
- 2021Semantic-Sparse Colorization Network for Deep Exemplar-based Colorization2 Dec 2021
- 2021Generating Compositional Color Representations from Text22 Sep 2021
- 2021Focusing on Persons: Colorizing Old Images Learning from Modern Historical Movies14 Aug 2021
12 newest of 13 All 13 (JSON)