mlsanityData to 7 Oct 2026

Ambigram Generation by A Diffusion Model

arXiv 2306.12049 ↗First posted 21 Jun 2023cs.CVcited by 4

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Ambigrams are graphical letter designs that can be read not only from the original direction but also from a rotated direction (especially with 180 degrees). Designing ambigrams is difficult even for human experts because keeping their dual readability from both directions is often difficult. This paper proposes an ambigram generation model. As its generation module, we use a diffusion model, which has recently been used to generate high-quality photographic images. By specifying a pair of letter classes, such as 'A' and 'B', the proposed model generates various ambigram images which can be read as 'A' from the original direction and 'B' from a direction rotated 180 degrees. Quantitative and qualitative analyses of experimental results show that the proposed model can generate high-quality and diverse ambigrams. In addition, we define ambigramability, an objective measure of how easy it is to generate ambigrams for each letter pair. For example, the pair of 'A' and 'V' shows a high ambigramability (that is, it is easy to generate their ambigrams), and the pair of 'D' and 'K' shows a lower ambigramability. The ambigramability gives various hints of the ambigram generation not only for computers but also for human experts. The code can be found at (https://github.com/univ-esuty/ambifusion).

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 27 of its 30 references that are in the map. First posted on arXiv 21 Jun 2023.

Builds on

27 of 30 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
13 more
  1. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  2. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  3. 2014Conditional Generative Adversarial Netscited by 2,152
  4. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  5. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  6. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  7. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  8. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  9. 2021ViTGAN: Training GANs with Vision Transformerscited by 110
  10. 2017Multi-Content GAN for Few-Shot Font Style Transfercited by 100
  11. 2021DG-Font: Deformable Generative Networks for Unsupervised Font Generationcited by 70
  12. 2019Large-scale Tag-based Font Retrieval with Generative Feature Learningcited by 22
  13. 2019GlyphGAN: Style-Consistent Font Generation Based on Generative Adversarial Networkscited by 16

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2020Diffusion models for Handwriting Generation
  2. 2024One-Shot Diffusion Mimicker for Handwritten Text Generation
  3. 2024FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generation
  4. 2024Generating Coherent Sequences of Visual Illustrations for Real-World Manual Tasks
  5. 2024Kinetic Typography Diffusion Model
  6. 2023Textile Pattern Generation Using Diffusion Models
  7. 2023DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion
  8. 2023Composite Diffusion | whole >= Sigma parts