# Effect of Text Color on Word Embeddings

arXiv: https://arxiv.org/abs/2004.08526 · HTML: https://mlsanity.com/paper/2004.08526/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Apr 2020.

## Built on by (most cited first, 4 of 4)

- [Impressions2Font: Generating Fonts by Specifying Impressions](https://mlsanity.com/paper/2103.10036/) (2021)
- [Shared Latent Space of Font Shapes and Their Noisy Impressions](https://mlsanity.com/paper/2103.12347/) (2021)
- [Analyzing Font Style Usage and Contextual Factors in Real Images](https://mlsanity.com/paper/2306.12050/) (2023)
- [What Text Design Characterizes Book Genres?](https://mlsanity.com/paper/2402.16356/) (2024)

## Abstract (arXiv)

In natural scenes and documents, we can find the correlation between a text and its color. For instance, the word, "hot", is often printed in red, while "cold" is often in blue. This correlation can be thought of as a feature that represents the semantic difference between the words. Based on this observation, we propose the idea of using text color for word embeddings. While text-only word embeddings (e.g. word2vec) have been extremely successful, they often represent antonyms as similar since they are often interchangeable in sentences. In this paper, we try two tasks to verify the usefulness of text color in understanding the meanings of words, especially in identifying synonyms and antonyms. First, we quantify the color distribution of words from the book cover images and analyze the correlation between the color and meaning of the word. Second, we try to retrain word embeddings with the color distribution of words as a constraint. By observing the changes in the word embeddings of synonyms and antonyms before and after re-training, we aim to understand the kind of words that have positive or negative effects in their word embeddings when incorporating text color information.