mlsanityData to 14 Oct 2026

SceneTextStylizer: A Training-Free Scene Text Style Transfer Framework with Diffusion Model

arXiv 2510.10910 ↗First posted 13 Oct 2025cs.CV eess.IVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

With the rapid development of diffusion models, style transfer has made remarkable progress. However, flexible and localized style editing for scene text remains an unsolved challenge. Although existing scene text editing methods have achieved text region editing, they are typically limited to content replacement and simple styles, which lack the ability of free-style transfer. In this paper, we introduce SceneTextStylizer, a novel training-free diffusion-based framework for flexible and high-fidelity style transfer of text in scene images. Unlike prior approaches that either perform global style transfer or focus solely on textual content modification, our method enables prompt-guided style transformation specifically for text regions, while preserving both text readability and stylistic consistency. To achieve this, we design a feature injection module that leverages diffusion model inversion and self-attention to transfer style features effectively. Additionally, a region control mechanism is introduced by applying a distance-based changing mask at each denoising step, enabling precise spatial control. To further enhance visual quality, we incorporate a style enhancement module based on the Fourier transform to reinforce stylistic richness. Extensive experiments demonstrate that our method achieves superior performance in scene text style transformation, outperforming existing state-of-the-art methods in both visual fidelity and text preservation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 28 of its 34 references that are in the map. First posted on arXiv 13 Oct 2025.

Builds on

28 of 34 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  2. 2025AttenST: A Training-Free Attention-Driven Style Transfer Framework with Pre-Trained Diffusion Models10 Mar
  3. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer11 Dec
  4. 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models15 Aug
  5. 2023Differential Diffusion: Giving Each Pixel Its Strength1 Jun
  6. 2023GlyphControl: Glyph Conditional Control for Visual Text Generation29 May
  7. 2023TextDiffuser: Diffusion Models as Text Painters18 May
  8. 2023DiffUTE: Universal Text Editing Diffusion Model18 May
  9. 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders12 Apr
  10. 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfer15 Mar
  11. 2022Inversion-Based Style Transfer with Diffusion Models23 Nov

Other references · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  5. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  6. 2023FreeU: Free Lunch in Diffusion U-Netcited by 196
  7. 2021StyTr2: Image Style Transfer with Transformerscited by 187
  8. 2019Editing Text in the Wildcited by 82
  9. 2020SwapText: Image Based Texts Transfer in Scenescited by 50
  10. 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 49
  11. 2019STEFANN: Scene Text Editor using Font Adaptive Neural Networkcited by 47
  12. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 45
5 more
  1. 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 37
  2. 2022SimAN: Exploring Self-Supervised Representation Learning of Scene Text via Similarity-Aware Normalizationcited by 21
  3. 2024Choose What You Need: Disentangled Representation Learning for Scene Text Recognition, Removal and Editingcited by 18
  4. 2025Recognition-Synergistic Scene Text Editingcited by 12
  5. 2024DiffArtist: Towards Structure and Appearance Controllable Image Stylizationcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Tuning-Free Adaptive Style Incorporation for Structure-Consistent Text-Driven Style Transfer
  2. 2026STEPS: Scene Text Editing with Preserved Style Using Diffusion and Contrastive Style Encoding
  3. 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learning
  4. 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing
  5. 2026RegionRoute: Regional Style Transfer with Diffusion Model
  6. 2023On Manipulating Scene Text in the Wild with Diffusion Models
  7. 2023ControlStyle: Text-Driven Stylized Image Generation Using Diffusion Priors
  8. 2022Diffusion-based Image Translation using Disentangled Style and Content Representation