Controllable Artistic Text Style Transfer via Shape-Matching GAN
Not on the map. Why?
Abstract (arXiv)
Artistic text style transfer is the task of migrating the style from a source image to the target text to create artistic typography. Recent style transfer methods have considered texture control to enhance usability. However, controlling the stylistic degree in terms of shape deformation remains an important open challenge. In this paper, we present the first text style transfer network that allows for real-time control of the crucial stylistic degree of the glyph through an adjustable parameter. Our key contribution is a novel bidirectional shape matching framework to establish an effective glyph-style mapping at various deformation levels without paired ground truth. Based on this idea, we propose a scale-controllable module to empower a single network to continuously characterize the multi-scale shape features of the style image and transfer these features to the target text. The proposed method demonstrates its superiority over previous state-of-the-arts in generating diverse, controllable and high-quality stylized text.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 14; 2023: 6; 2024: 7; 2025: 4; 2026: 1.
45 papers.
Sort:
By area:
- 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Modelcited by 199
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
- 2021Rebooting ACGAN: Auxiliary Classifier GANs with Stable Trainingcited by 57
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 36
- 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Trainingcited by 29
- 2022SLOGAN: Handwriting Style Synthesis for Arbitrary-Length and Out-of-Vocabulary Textcited by 26
- 2021De-rendering Stylized Textscited by 24
- 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmarkcited by 24
- 2024Bi-LORA: A Vision-Language Approach for Synthetic Image Detectioncited by 20
- 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
33 more
- 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
- 2021STRIVE: Scene Text Replacement In Videoscited by 13
- 2021Texture Reformer: Towards Fast and Universal Interactive Texture Transfercited by 12
- 2023Towards Diverse and Consistent Typography Generationcited by 11
- 2022SGBANet: Semantic GAN and Balanced Attention Network for Arbitrarily Oriented Scene Text Recognitioncited by 10
- 2022Industrial Style Transfer with Large-scale Geometric Warping and Content Preservationcited by 9
- 2024FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generationcited by 9
- 2024Kinetic Typography Diffusion Modelcited by 9
- 2024Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generationcited by 9
- 2022GenText: Unsupervised Artistic Text Generation via Decoupled Font and Texture Manipulationcited by 6
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Frameworkcited by 6
- 2023On Manipulating Scene Text in the Wild with Diffusion Modelscited by 6
- 2022OmniPrint: A Configurable Printed Character Synthesizercited by 5
- 2023VQ-Font: Few-Shot Font Generation with Structure-Aware Enhancement and Quantizationcited by 5
- 2022Sparse Mixture Once-for-all Adversarial Training for Efficient In-Situ Trade-Off Between Accuracy and Robustness of DNNscited by 4
- 2021Coarse-to-Fine Searching for Efficient Generative Adversarial Networkscited by 3
- 2021Black-Box Diagnosis and Calibration on GAN Intra-Mode Collapse: A Pilot Studycited by 3
- 2022APRNet: Attention-based Pixel-wise Rendering Network for Photo-Realistic Text Image Generationcited by 3
- 2024Dynamic Texture Transfer using PatchMatch and Transformerscited by 3
- 2021Towards A Multi-agent System for Online Hate Speech Detectioncited by 2
- 2021CAMS: Color-Aware Multi-Style Transfercited by 2
- 2021MixSyn: Learning Composition and Style for Multi-Source Image Synthesiscited by 2
- 2022Interactive Portrait Harmonizationcited by 2
- 2021Font Completion and Manipulation by Cycling Between Multi-Modality Representationscited by 1
- 2022A Fast and Efficient Conditional Learning for Tunable Trade-Off between Accuracy and Robustnesscited by 1
- 2022Disentangled Generation Network for Enlarged License Plate Recognition and A Unified Datasetcited by 1
- 2023Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regionscited by 1
- 2025CraftGraffiti: Exploring Human Identity with Custom Graffiti Art via Facial-Preserving Diffusion Modelscited by 1
- 2026FontCrafter: High-Fidelity Element-Driven Artistic Font Creation with Visual In-Context Generationcited by 1
- 2021ShufaNet: Classification method for calligraphers who have reached the professional levelcited by 0
- 2023Multi-task Collaborative Pre-training and Individual-adaptive-tokens Fine-tuning: A Unified Framework for Brain Representation Learningcited by 0
- 2025DiscoSum: Discourse-aware News Summarizationcited by 0
- 2025WordCraft: Interactive Artistic Typography with Attention Awareness and Noise Blendingcited by 0
- 2026FontCrafter: High-Fidelity Element-Driven Artistic Font Creation with Visual In-Context Generation23 Mar 2026
- 2025CraftGraffiti: Exploring Human Identity with Custom Graffiti Art via Facial-Preserving Diffusion Models28 Aug 2025
- 2025WordCraft: Interactive Artistic Typography with Attention Awareness and Noise Blending13 Jul 2025
- 2025WordCon: Word-level Typography Control in Scene Text Rendering26 Jun 2025
- 2025DiscoSum: Discourse-aware News Summarization7 Jun 2025
- 2024FonTS: Text Rendering with Typography and Style Controls28 Nov 2024
- 2024Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generation20 Jul 2024
- 2024Kinetic Typography Diffusion Model15 Jul 2024
- 2024FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generation12 Jun 2024
- 2024Bi-LORA: A Vision-Language Approach for Synthetic Image Detection2 Apr 2024
- 2024Geometry Transfer for Stylizing Radiance Fields1 Feb 2024
- 2024Dynamic Texture Transfer using PatchMatch and Transformers1 Feb 2024
33 more
- 2023On Manipulating Scene Text in the Wild with Diffusion Models1 Nov 2023
- 2023Towards Diverse and Consistent Typography Generation5 Sep 2023
- 2023VQ-Font: Few-Shot Font Generation with Structure-Aware Enhancement and Quantization27 Aug 2023
- 2023Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions25 Aug 2023
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Framework5 Aug 2023
- 2023Multi-task Collaborative Pre-training and Individual-adaptive-tokens Fine-tuning: A Unified Framework for Brain Representation Learning20 Jun 2023
- 2022Sparse Mixture Once-for-all Adversarial Training for Efficient In-Situ Trade-Off Between Accuracy and Robustness of DNNs27 Dec 2022
- 2022Exploring Stroke-Level Modifications for Scene Text Editing5 Dec 2022
- 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Model15 Nov 2022
- 2022SGBANet: Semantic GAN and Balanced Attention Network for Arbitrarily Oriented Scene Text Recognition21 Jul 2022
- 2022GenText: Unsupervised Artistic Text Generation via Decoupled Font and Texture Manipulation20 Jul 2022
- 2022Disentangled Generation Network for Enlarged License Plate Recognition and A Unified Dataset2 Jun 2022
- 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Training6 Apr 2022
- 2022A Fast and Efficient Conditional Learning for Tunable Trade-Off between Accuracy and Robustness28 Mar 2022
- 2022Industrial Style Transfer with Large-scale Geometric Warping and Content Preservation24 Mar 2022
- 2022Interactive Portrait Harmonization15 Mar 2022
- 2022APRNet: Attention-based Pixel-wise Rendering Network for Photo-Realistic Text Image Generation15 Mar 2022
- 2022SLOGAN: Handwriting Style Synthesis for Arbitrary-Length and Out-of-Vocabulary Text23 Feb 2022
- 2022OmniPrint: A Configurable Printed Character Synthesizer17 Jan 2022
- 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmark3 Jan 2022
- 2021Texture Reformer: Towards Fast and Universal Interactive Texture Transfer6 Dec 2021
- 2021MixSyn: Learning Composition and Style for Multi-Source Image Synthesis24 Nov 2021
- 2021ShufaNet: Classification method for calligraphers who have reached the professional level22 Nov 2021
- 2021Rebooting ACGAN: Auxiliary Classifier GANs with Stable Training1 Nov 2021
- 2021De-rendering Stylized Texts5 Oct 2021
- 2021STRIVE: Scene Text Replacement In Videos6 Sep 2021
- 2021Font Completion and Manipulation by Cycling Between Multi-Modality Representations30 Aug 2021
- 2021SSH: A Self-Supervised Framework for Image Harmonization15 Aug 2021
- 2021Black-Box Diagnosis and Calibration on GAN Intra-Mode Collapse: A Pilot Study23 Jul 2021
- 2021CAMS: Color-Aware Multi-Style Transfer26 Jun 2021
- 2021Towards A Multi-agent System for Online Hate Speech Detection3 May 2021
- 2021Coarse-to-Fine Searching for Efficient Generative Adversarial Networks19 Apr 2021
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up14 Feb 2021
- 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Modelcited by 199
- 2024Bi-LORA: A Vision-Language Approach for Synthetic Image Detectioncited by 20
- 2024FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generationcited by 9
- 2024Kinetic Typography Diffusion Modelcited by 9
- 2023On Manipulating Scene Text in the Wild with Diffusion Modelscited by 6
- 2025CraftGraffiti: Exploring Human Identity with Custom Graffiti Art via Facial-Preserving Diffusion Modelscited by 1
- 2025CraftGraffiti: Exploring Human Identity with Custom Graffiti Art via Facial-Preserving Diffusion Models28 Aug 2025
- 2024Kinetic Typography Diffusion Model15 Jul 2024
- 2024FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generation12 Jun 2024
- 2024Bi-LORA: A Vision-Language Approach for Synthetic Image Detection2 Apr 2024
- 2023On Manipulating Scene Text in the Wild with Diffusion Models1 Nov 2023
- 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Model15 Nov 2022
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
- 2021Rebooting ACGAN: Auxiliary Classifier GANs with Stable Trainingcited by 57
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 36
- 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Trainingcited by 29
- 2022SLOGAN: Handwriting Style Synthesis for Arbitrary-Length and Out-of-Vocabulary Textcited by 26
- 2021De-rendering Stylized Textscited by 24
- 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmarkcited by 24
- 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
- 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
- 2021STRIVE: Scene Text Replacement In Videoscited by 13
12 most cited of 39 All 39 (JSON)
- 2026FontCrafter: High-Fidelity Element-Driven Artistic Font Creation with Visual In-Context Generation23 Mar 2026
- 2025WordCraft: Interactive Artistic Typography with Attention Awareness and Noise Blending13 Jul 2025
- 2025WordCon: Word-level Typography Control in Scene Text Rendering26 Jun 2025
- 2025DiscoSum: Discourse-aware News Summarization7 Jun 2025
- 2024FonTS: Text Rendering with Typography and Style Controls28 Nov 2024
- 2024Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generation20 Jul 2024
- 2024Geometry Transfer for Stylizing Radiance Fields1 Feb 2024
- 2024Dynamic Texture Transfer using PatchMatch and Transformers1 Feb 2024
- 2023Towards Diverse and Consistent Typography Generation5 Sep 2023
- 2023VQ-Font: Few-Shot Font Generation with Structure-Aware Enhancement and Quantization27 Aug 2023
- 2023Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions25 Aug 2023
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Framework5 Aug 2023
12 newest of 39 All 39 (JSON)