mlsanityData to 14 Oct 2026

Syn3DTxt: Embedding 3D Cues for Scene Text Generation

arXiv 2505.18479 ↗First posted 24 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This study aims to investigate the challenge of insufficient three-dimensional context in synthetic datasets for scene text rendering. Although recent advances in diffusion models and related techniques have improved certain aspects of scene text generation, most existing approaches continue to rely on 2D data, sourcing authentic training examples from movie posters and book covers, which limits their ability to capture the complex interactions among spatial layout and visual effects in real-world scenes. In particular, traditional 2D datasets do not provide the necessary geometric cues for accurately embedding text into diverse backgrounds. To address this limitation, we propose a novel standard for constructing synthetic datasets that incorporates surface normals to enrich three-dimensional scene characteristic. By adding surface normals to conventional 2D data, our approach aims to enhance the representation of spatial relationships and provide a more robust foundation for future scene text rendering methods. Extensive experiments demonstrate that datasets built under this new standard offer improved geometric context, facilitating further advancements in text rendering under complex 3D-spatial conditions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 24 May 2025.

Builds on

14 of 20 references.

References · 14

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  3. 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
  4. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
  5. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
  6. 2014Reading Text in the Wild with Convolutional Neural Networkscited by 122
  7. 2019Editing Text in the Wildcited by 82
  8. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 45
  9. 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
  10. 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 37
  11. 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
  12. 2023ICDAR 2023 Competition on Hierarchical Text Detection and Recognitioncited by 23
2 more
  1. 2024First Creating Backgrounds Then Rendering Texts: A New Paradigm for Visual Text Blendingcited by 16
  2. 2019SynthText3D: Synthesizing Scene Text Images from 3D Virtual Worldscited by 15

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Co-generation of Layout and Shape from Text via Autoregressive 3D Diffusion
  2. 2025Layout2Scene: 3D Semantic Layout Guided Scene Generation via Geometry and Appearance Diffusion Priors
  3. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields
  4. 2023SceneWiz3D: Towards Text-guided 3D Scene Composition
  5. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion
  6. 2023T3Bench: Benchmarking Current Progress in Text-to-3D Generation
  7. 2025Generating Surface for Text-to-3D using 2D Gaussian Splatting
  8. 2023PI3D: Efficient Text-to-3D Generation with Pseudo-Image Diffusion