AmbiGen: Generating Ambigrams from Pre-trained Diffusion Model
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Ambigrams are calligraphic designs that have different meanings depending on the viewing orientation. Creating ambigrams is a challenging task even for skilled artists, as it requires maintaining the meaning under two different viewpoints at the same time. In this work, we propose to generate ambigrams by distilling a large-scale vision and language diffusion model, namely DeepFloyd IF, to optimize the letters' outline for legibility in the two viewing orientations. Empirically, we demonstrate that our approach outperforms existing ambigram generation methods. On the 500 most common words in English, our method achieves more than an 11.6% increase in word accuracy and at least a 41.9% reduction in edit distance.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 26 of its 40 references that are in the map. First posted on arXiv 5 Dec 2023.
Builds on
26 of 40 references.
Closest ancestors · 4
Same direction, newest first
- 2023Ambigram Generation by A Diffusion Model21 Jun
- 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Models21 Nov
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
Other references · 22
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
- 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
10 more
- 2017Multi-Content GAN for Few-Shot Font Style Transfercited by 100
- 2019A Learned Representation for Scalable Vector Graphicscited by 91
- 2023Word-As-Image for Semantic Typographycited by 63
- 2019Artistic Glyph Image Synthesis via One-Stage Few-Shot Learningcited by 53
- 2023DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Qualitycited by 27
- 2019Large-scale Tag-based Font Retrieval with Generative Feature Learningcited by 22
- 2021A Multi-Implicit Neural Representation for Fontscited by 21
- 2022Aesthetic Text Logo Synthesis via Content-aware Layout Inferringcited by 19
- 2023DualVector: Unsupervised Vector Font Synthesis with Dual-Part Representationcited by 16
- 2021Learning Implicit Glyph Shape Representationcited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 0; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion
- 2024Generating Coherent Sequences of Visual Illustrations for Real-World Manual Tasks
- 2025Text to Sketch Generation with Multi-Styles
- 2025Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesis
- 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Paths
- 2026Structure-Semantic Co-optimized Latent Diffusion Model for Fast Visual Anagram Synthesis
- 2024DiffMorph: Text-less Image Morphing with Diffusion Models
- 2025Layout Stroke Imitation: A Layout Guided Handwriting Stroke Generation for Style Imitation with Diffusion Model