Ambigram Generation by A Diffusion Model
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Ambigrams are graphical letter designs that can be read not only from the original direction but also from a rotated direction (especially with 180 degrees). Designing ambigrams is difficult even for human experts because keeping their dual readability from both directions is often difficult. This paper proposes an ambigram generation model. As its generation module, we use a diffusion model, which has recently been used to generate high-quality photographic images. By specifying a pair of letter classes, such as 'A' and 'B', the proposed model generates various ambigram images which can be read as 'A' from the original direction and 'B' from a direction rotated 180 degrees. Quantitative and qualitative analyses of experimental results show that the proposed model can generate high-quality and diverse ambigrams. In addition, we define ambigramability, an objective measure of how easy it is to generate ambigrams for each letter pair. For example, the pair of 'A' and 'V' shows a high ambigramability (that is, it is easy to generate their ambigrams), and the pair of 'D' and 'K' shows a lower ambigramability. The ambigramability gives various hints of the ambigram generation not only for computers but also for human experts. The code can be found at (https://github.com/univ-esuty/ambifusion).
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 27 of its 30 references that are in the map. First posted on arXiv 21 Jun 2023.
Builds on
27 of 30 references.
Closest ancestors · 2
Same direction, newest first
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
Other references · 25
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
13 more
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2021ViTGAN: Training GANs with Vision Transformerscited by 110
- 2017Multi-Content GAN for Few-Shot Font Style Transfercited by 100
- 2021DG-Font: Deformable Generative Networks for Unsupervised Font Generationcited by 70
- 2019Large-scale Tag-based Font Retrieval with Generative Feature Learningcited by 22
- 2019GlyphGAN: Style-Consistent Font Generation Based on Generative Adversarial Networkscited by 16
Built on by
Citing papers per year: 2023: 2; 2024: 2.
4 papers.
- 2023Diffusion Illusions: Hiding Images in Plain Sightcited by 26
- 2024Font Style Interpolation with Diffusion Modelscited by 3
- 2023AmbiGen: Generating Ambigrams from Pre-trained Diffusion Modelcited by 2
- 2024Cross-Domain Image Conversion by CycleDMcited by 0
- 2024Cross-Domain Image Conversion by CycleDM5 Mar 2024
- 2024Font Style Interpolation with Diffusion Models22 Feb 2024
- 2023Diffusion Illusions: Hiding Images in Plain Sight6 Dec 2023
- 2023AmbiGen: Generating Ambigrams from Pre-trained Diffusion Model5 Dec 2023
Similar, not cited
Close in wording, no citation either way
- 2020Diffusion models for Handwriting Generation
- 2024One-Shot Diffusion Mimicker for Handwritten Text Generation
- 2024FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generation
- 2024Generating Coherent Sequences of Visual Illustrations for Real-World Manual Tasks
- 2024Kinetic Typography Diffusion Model
- 2023Textile Pattern Generation Using Diffusion Models
- 2023DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion
- 2023Composite Diffusion | whole >= Sigma parts