mlsanityData to 7 Oct 2026

TextPainter: Multimodal Text Image Generation with Visual-harmony and Text-comprehension for Poster Design

arXiv 2308.04733 ↗First posted 9 Aug 2023cs.CVcited by 18

Not on the map. Why?

Abstract (arXiv)

Text design is one of the most critical procedures in poster design, as it relies heavily on the creativity and expertise of humans to design text images considering the visual harmony and text-semantic. This study introduces TextPainter, a novel multimodal approach that leverages contextual visual information and corresponding text semantics to generate text images. Specifically, TextPainter takes the global-local background image as a hint of style and guides the text image generation with visual harmony. Furthermore, we leverage the language model and introduce a text comprehension module to achieve both sentence-level and word-level style variations. Besides, we construct the PosterT80K dataset, consisting of about 80K posters annotated with sentence-level bounding boxes and text contents. We hope this dataset will pave the way for further research on multimodal text image generation. Extensive quantitative and qualitative experiments demonstrate that TextPainter can generate visually-and-semantically-harmonious text images for posters.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 26 of its 39 references that are in the map. First posted on arXiv 9 Aug 2023.

Builds on

26 of 39 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  7. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  8. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  9. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  10. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  11. 2015A Neural Algorithm of Artistic Stylecited by 480
  12. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
14 more
  1. 2022Chinese CLIP: Contrastive Vision-Language Pretraining in Chinesecited by 108
  2. 2017Multi-Content GAN for Few-Shot Font Style Transfercited by 100
  3. 2019Editing Text in the Wildcited by 81
  4. 2021DG-Font: Deformable Generative Networks for Unsupervised Font Generationcited by 70
  5. 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
  6. 2020SwapText: Image Based Texts Transfer in Scenescited by 49
  7. 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 48
  8. 2022Few-Shot Font Generation by Learning Fine-Grained Local Stylescited by 34
  9. 2022Geometry Aligned Variational Transformer for Image-conditioned Layout Generationcited by 33
  10. 2017Auto-Encoder Guided GAN for Chinese Calligraphy Synthesiscited by 29
  11. 2022XMP-Font: Self-Supervised Cross-Modality Pre-training for Few-Shot Font Generationcited by 18
  12. 2022CapOnImage: Context-driven Dense-Captioning on Imagecited by 11
  13. 2022Self-Supervised Text Erasing with Controllable Image Synthesiscited by 9
  14. 2022APRNet: Attention-based Pixel-wise Rendering Network for Photo-Realistic Text Image Generationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 6; 2025: 6; 2026: 5.

18 papers.

Sort:

By area:

  1. 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 41
  2. 2024Graphic Design with Large Multimodal Modelcited by 38
  3. 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
  4. 2023Towards Diverse and Consistent Typography Generationcited by 11
  5. 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 11
  6. 2024Edit-Your-Motion: Space-Time Diffusion Decoupling Learning for Video Motion Editingcited by 10
  7. 2024Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generationcited by 9
  8. 2025Rethinking Layered Graphic Design Generation with a Top-Down Approachcited by 9
  9. 2024Typographic Text Generation with Off-the-Shelf Diffusion Modelcited by 5
  10. 2026InnoAds-Composer: Efficient Condition Composition for E-Commerce Poster Generationcited by 5
  11. 2024VitaGlyph: Vitalizing Artistic Typography with Flexible Dual-branch Diffusion Modelscited by 4
  12. 2025LOCATEdit: Graph Laplacian Optimized Cross Attention for Localized Text-Guided Image Editingcited by 2
6 more
  1. 2025COP-GEN-Beta: Unified Generative Modelling of COPernicus Imagery Thumbnailscited by 2
  2. 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulationcited by 2
  3. 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflowcited by 1
  4. 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvementcited by 0
  5. 2026CPT: Controllable and Editable Design Variations with Language Modelscited by 0
  6. 2026Reading Between the Pixels: An Inscriptive Jailbreak Attack on Text-to-Image Modelscited by 0