mlsanityData to 7 Oct 2026

SwapText: Image Based Texts Transfer in Scenes

arXiv 2003.08152 ↗First posted 18 Mar 2020cs.CVcited by 49

Not on the map. Why?

Abstract (arXiv)

Swapping text in scene images while preserving original fonts, colors, sizes and background textures is a challenging task due to the complex interplay between different factors. In this work, we present SwapText, a three-stage framework to transfer texts across scene images. First, a novel text swapping network is proposed to replace text labels only in the foreground image. Second, a background completion network is learned to reconstruct background images. Finally, the generated foreground image and background image are used to generate the word image by the fusion network. Using the proposing framework, we can manipulate the texts of the input images even with severe geometric distortion. Qualitative and quantitative results are presented on several scene text datasets, including regular and irregular text datasets. We conducted extensive experiments to prove the usefulness of our method such as image based text translation, text image synthesis, etc.

Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Mar 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 9; 2023: 12; 2024: 13; 2025: 6; 2026: 5.

49 papers.

Sort:

By area:

  1. 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 48
  2. 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
  3. 2023DiffUTE: Universal Text Editing Diffusion Modelcited by 44
  4. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
  5. 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Modelcited by 41
  6. 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 36
  7. 2022Content and Style Aware Generation of Text-line Images for Handwriting Recognitioncited by 35
  8. 2022Look Closer to Supervise Better: One-Shot Font Generation via Component-Based Discriminatorcited by 32
  9. 2021De-rendering Stylized Textscited by 24
  10. 2022Don't Forget Me: Accurate Background Recovery for Text Removal via Modeling Local-Global Contextcited by 18
  11. 2023TextPainter: Multimodal Text Image Generation with Visual-harmony and Text-comprehension for Poster Designcited by 18
  12. 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
37 more
  1. 2024DreamText: High Fidelity Scene Text Synthesiscited by 17
  2. 2022Unsupervised Structure-Texture Separation Network for Oracle Character Recognitioncited by 15
  3. 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Modelscited by 14
  4. 2021STRIVE: Scene Text Replacement In Videoscited by 13
  5. 2023FETNet: Feature Erasing and Transferring Network for Scene Text Removalcited by 12
  6. 2023ViTEraser: Harnessing the Power of Vision Transformers for Scene Text Removal with SegMIM Pretrainingcited by 11
  7. 2023Towards Diverse and Consistent Typography Generationcited by 11
  8. 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editingcited by 10
  9. 2021RewriteNet: Reliable Scene Text Editing with Implicit Decomposition of Text Contents and Stylescited by 9
  10. 2022Self-Supervised Text Erasing with Controllable Image Synthesiscited by 9
  11. 2024Kinetic Typography Diffusion Modelcited by 9
  12. 2024How Control Information Influences Multilingual Text Image Generation and Editing?cited by 9
  13. 2024Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generationcited by 9
  14. 2024Visual Text Meets Low-level Vision: A Comprehensive Survey on Visual Text Processingcited by 8
  15. 2024TextSSR: Diffusion-based Data Synthesis for Scene Text Recognitioncited by 8
  16. 2022GenText: Unsupervised Artistic Text Generation via Decoupled Font and Texture Manipulationcited by 6
  17. 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Frameworkcited by 6
  18. 2023On Manipulating Scene Text in the Wild with Diffusion Modelscited by 6
  19. 2022OmniPrint: A Configurable Printed Character Synthesizercited by 5
  20. 2022A Scene-Text Synthesis Engine Achieved Through Learning from Decomposed Real-World Datacited by 5
  21. 2023Show Me the World in My Language: Establishing the First Baseline for Scene-Text to Scene-Text Translationcited by 5
  22. 2024Typographic Text Generation with Off-the-Shelf Diffusion Modelcited by 5
  23. 2024Type-R: Automatically Retouching Typos for Text-to-Image Generationcited by 5
  24. 2023Scene Style Text Editingcited by 4
  25. 2024DeepEraser: Deep Iterative Context Mining for Generic Text Erasercited by 3
  26. 2026StyleTextGen: Style-Conditioned Multilingual Scene Text Generationcited by 3
  27. 2023Weakly Supervised Scene Text Generation for Low-resource Languagescited by 2
  28. 2024DiffSTR: Controlled Diffusion Models for Scene Text Removalcited by 2
  29. 2025Beyond Flat Text: Dual Self-inherited Guidance for Visual Text Generationcited by 2
  30. 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulationcited by 2
  31. 2024Text Image Generation for Low-Resource Languages with Dual Translation Learningcited by 0
  32. 2025SceneTextStylizer: A Training-Free Scene Text Style Transfer Framework with Diffusion Modelcited by 0
  33. 2025TripleFDS: Triple Feature Disentanglement and Synthesis for Scene Text Editingcited by 0
  34. 2026Towards Training-Free Scene Text Editingcited by 0
  35. 2026Edit Fidelity Field: Semantics-Aware Region Isolation for Training-Free Scene Text Editingcited by 0
  36. 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learningcited by 0
  37. 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editingcited by 0