# Local Style Awareness of Font Images

arXiv: https://arxiv.org/abs/2310.06337 · HTML: https://mlsanity.com/paper/2310.06337/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 18 of its 30 references that are in the map.
- First posted on arXiv 10 Oct 2023.

## Builds on (most cited first, 18 of 18)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization](https://mlsanity.com/paper/1610.02391/) (2016)
- [Quantifying Attention Flow in Transformers](https://mlsanity.com/paper/2005.00928/) (2020)
- [Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognition](https://mlsanity.com/paper/1903.06150/) (2019)
- [Learning Attentive Pairwise Interaction for Fine-Grained Classification](https://mlsanity.com/paper/2002.10191/) (2020)
- [Separating Style and Content for Generalized Style Transfer](https://mlsanity.com/paper/1711.06454/) (2017)
- [Artistic Glyph Image Synthesis via One-Stage Few-Shot Learning](https://mlsanity.com/paper/1910.04987/) (2019)
- [STEFANN: Scene Text Editor using Font Adaptive Neural Network](https://mlsanity.com/paper/1903.01192/) (2019)
- [Few-Shot Font Generation by Learning Fine-Grained Local Styles](https://mlsanity.com/paper/2205.09965/) (2022)
- [Look Closer to Supervise Better: One-Shot Font Generation via Component-Based Discriminator](https://mlsanity.com/paper/2205.00146/) (2022)
- [DeepFont: Identify Your Font from An Image](https://mlsanity.com/paper/1507.03196/) (2015)
- [ZiGAN: Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approach](https://mlsanity.com/paper/2108.03596/) (2021)
- [XMP-Font: Self-Supervised Cross-Modality Pre-training for Few-Shot Font Generation](https://mlsanity.com/paper/2204.05084/) (2022)
- [A Deep Factorization of Style and Structure in Fonts](https://mlsanity.com/paper/1910.00748/) (2019)
- [A Unified Framework for Generalizable Style Transfer: Style and Content Separation](https://mlsanity.com/paper/1806.05173/) (2018)
- [Shared Latent Space of Font Shapes and Their Noisy Impressions](https://mlsanity.com/paper/2103.12347/) (2021)
- [Which Parts Determine the Impression of the Font?](https://mlsanity.com/paper/2103.14216/) (2021)
- [Character-independent font identification](https://mlsanity.com/paper/2001.08893/) (2020)

## Abstract (arXiv)

When we compare fonts, we often pay attention to styles of local parts, such as serifs and curvatures. This paper proposes an attention mechanism to find important local parts. The local parts with larger attention are then considered important. The proposed mechanism can be trained in a quasi-self-supervised manner that requires no manual annotation other than knowing that a set of character images is from the same font, such as Helvetica. After confirming that the trained attention mechanism can find style-relevant local parts, we utilize the resulting attention for local style-aware font generation. Specifically, we design a new reconstruction loss function to put more weight on the local parts with larger attention for generating character images with more accurate style realization. This loss function has the merit of applicability to various font generation models. Our experimental results show that the proposed loss function improves the quality of generated character images by several few-shot font generation models.
