SceneTextStylizer: A Training-Free Scene Text Style Transfer Framework with Diffusion Model
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
With the rapid development of diffusion models, style transfer has made remarkable progress. However, flexible and localized style editing for scene text remains an unsolved challenge. Although existing scene text editing methods have achieved text region editing, they are typically limited to content replacement and simple styles, which lack the ability of free-style transfer. In this paper, we introduce SceneTextStylizer, a novel training-free diffusion-based framework for flexible and high-fidelity style transfer of text in scene images. Unlike prior approaches that either perform global style transfer or focus solely on textual content modification, our method enables prompt-guided style transformation specifically for text regions, while preserving both text readability and stylistic consistency. To achieve this, we design a feature injection module that leverages diffusion model inversion and self-attention to transfer style features effectively. Additionally, a region control mechanism is introduced by applying a distance-based changing mask at each denoising step, enabling precise spatial control. To further enhance visual quality, we incorporate a style enhancement module based on the Fourier transform to reinforce stylistic richness. Extensive experiments demonstrate that our method achieves superior performance in scene text style transformation, outperforming existing state-of-the-art methods in both visual fidelity and text preservation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 28 of its 34 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
28 of 34 references.
Closest ancestors · 11
Same direction, newest first
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2025AttenST: A Training-Free Attention-Driven Style Transfer Framework with Pre-Trained Diffusion Models10 Mar
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer11 Dec
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models15 Aug
- 2023Differential Diffusion: Giving Each Pixel Its Strength1 Jun
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generation29 May
- 2023TextDiffuser: Diffusion Models as Text Painters18 May
- 2023DiffUTE: Universal Text Editing Diffusion Model18 May
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders12 Apr
- 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfer15 Mar
- 2022Inversion-Based Style Transfer with Diffusion Models23 Nov
Other references · 17
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
- 2023FreeU: Free Lunch in Diffusion U-Netcited by 196
- 2021StyTr2: Image Style Transfer with Transformerscited by 187
- 2019Editing Text in the Wildcited by 82
- 2020SwapText: Image Based Texts Transfer in Scenescited by 50
- 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 49
- 2019STEFANN: Scene Text Editor using Font Adaptive Neural Networkcited by 47
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 45
5 more
- 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 37
- 2022SimAN: Exploring Self-Supervised Representation Learning of Scene Text via Similarity-Aware Normalizationcited by 21
- 2024Choose What You Need: Disentangled Representation Learning for Scene Text Recognition, Removal and Editingcited by 18
- 2025Recognition-Synergistic Scene Text Editingcited by 12
- 2024DiffArtist: Towards Structure and Appearance Controllable Image Stylizationcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Tuning-Free Adaptive Style Incorporation for Structure-Consistent Text-Driven Style Transfer
- 2026STEPS: Scene Text Editing with Preserved Style Using Diffusion and Contrastive Style Encoding
- 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learning
- 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing
- 2026RegionRoute: Regional Style Transfer with Diffusion Model
- 2023On Manipulating Scene Text in the Wild with Diffusion Models
- 2023ControlStyle: Text-Driven Stylized Image Generation Using Diffusion Priors
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representation