mlsanityData to 7 Oct 2026

StyleTextGen: Style-Conditioned Multilingual Scene Text Generation

arXiv 2605.14708 ↗First posted 14 May 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Style-conditioned scene text generation faces unique challenges in extracting precise text styles from complex backgrounds and maintaining fine-grained style consistency across characters, especially for multilingual scripts. We propose StyleTextGen, a novel framework that learns to perceive and replicate visual text styles across different languages and writing systems. Our approach features three key contributions: First, we introduce a dual-branch style encoder dedicated to style modeling, yielding robust multilingual text style representations in complex real-world scenes. Second, we design a text style consistency loss that enhances style coherence and improves overall visual quality. Third, we develop a mask-guided inference strategy that ensures precise style alignment between generated and reference text. To facilitate systematic evaluation, we construct StyleText-CE, a bilingual scene text style benchmark covering both monolingual and cross-lingual settings. Extensive experiments demonstrate that StyleTextGen significantly outperforms existing methods in style consistency and cross-lingual generalization, establishing new state-of-the-art performance in multilingual style-conditioned text generation.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 56 of its 60 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

56 of 60 references.

References · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  6. 2022Flow Matching for Generative Modelingcited by 5,426
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  9. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  10. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  12. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
38 more
  1. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  2. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  3. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  4. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
  5. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  6. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  7. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  8. 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 173
  9. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
  10. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 162
  11. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
  12. 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
  13. 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 105
  14. 2019Editing Text in the Wildcited by 81
  15. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
  16. 2024Rectified Diffusion: Straightness Is Not Your Need in Rectified Flowcited by 59
  17. 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 58
  18. 2020SwapText: Image Based Texts Transfer in Scenescited by 49
  19. 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 48
  20. 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
  21. 2019STEFANN: Scene Text Editor using Font Adaptive Neural Networkcited by 46
  22. 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
  23. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
  24. 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
  25. 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 36
  26. 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
  27. 2024Hi-SAM: Marrying Segment Anything Model for Hierarchical Text Segmentationcited by 30
  28. 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Modelscited by 28
  29. 2024StyleStudio: Text-Driven Style Transfer with Selective Control of Style Elementscited by 26
  30. 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
  31. 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
  32. 2024Instruction-Guided Scene Text Recognitioncited by 17
  33. 2024First Creating Backgrounds Then Rendering Texts: A New Paradigm for Visual Text Blendingcited by 16
  34. 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Modelscited by 14
  35. 2025A Token-level Text Image Foundation Model for Document Understandingcited by 13
  36. 2023IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognitioncited by 12
  37. 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesiscited by 12
  38. 2025When Semantics Mislead Vision: Mitigating Large Multimodal Models Hallucinations in Scene Text Spotting and Understandingcited by 12

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.