StyleTextGen: Style-Conditioned Multilingual Scene Text Generation
Not on the map. Why?
Abstract (arXiv)
Style-conditioned scene text generation faces unique challenges in extracting precise text styles from complex backgrounds and maintaining fine-grained style consistency across characters, especially for multilingual scripts. We propose StyleTextGen, a novel framework that learns to perceive and replicate visual text styles across different languages and writing systems. Our approach features three key contributions: First, we introduce a dual-branch style encoder dedicated to style modeling, yielding robust multilingual text style representations in complex real-world scenes. Second, we design a text style consistency loss that enhances style coherence and improves overall visual quality. Third, we develop a mask-guided inference strategy that ensures precise style alignment between generated and reference text. To facilitate systematic evaluation, we construct StyleText-CE, a bilingual scene text style benchmark covering both monolingual and cross-lingual settings. Extensive experiments demonstrate that StyleTextGen significantly outperforms existing methods in style consistency and cross-lingual generalization, establishing new state-of-the-art performance in multilingual style-conditioned text generation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 56 of its 60 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
56 of 60 references.
References · 56
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
38 more
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 173
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 162
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 105
- 2019Editing Text in the Wildcited by 81
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2024Rectified Diffusion: Straightness Is Not Your Need in Rectified Flowcited by 59
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 58
- 2020SwapText: Image Based Texts Transfer in Scenescited by 49
- 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 48
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
- 2019STEFANN: Scene Text Editor using Font Adaptive Neural Networkcited by 46
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
- 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 36
- 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
- 2024Hi-SAM: Marrying Segment Anything Model for Hierarchical Text Segmentationcited by 30
- 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Modelscited by 28
- 2024StyleStudio: Text-Driven Style Transfer with Selective Control of Style Elementscited by 26
- 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
- 2024Instruction-Guided Scene Text Recognitioncited by 17
- 2024First Creating Backgrounds Then Rendering Texts: A New Paradigm for Visual Text Blendingcited by 16
- 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Modelscited by 14
- 2025A Token-level Text Image Foundation Model for Document Understandingcited by 13
- 2023IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognitioncited by 12
- 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesiscited by 12
- 2025When Semantics Mislead Vision: Mitigating Large Multimodal Models Hallucinations in Scene Text Spotting and Understandingcited by 12
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.