DanceText: A Training-Free Layered Framework for Controllable Multilingual Text Transformation in Images
Not on the map. Why?
Abstract (arXiv)
We present DanceText, a training-free framework for multilingual text editing in images, designed to support complex geometric transformations and achieve seamless foreground-background integration. While diffusion-based generative models have shown promise in text-guided image synthesis, they often lack controllability and fail to preserve layout consistency under non-trivial manipulations such as rotation, translation, scaling, and warping. To address these limitations, DanceText introduces a layered editing strategy that separates text from the background, allowing geometric transformations to be performed in a modular and controllable manner. A depth-aware module is further proposed to align appearance and perspective between the transformed text and the reconstructed background, enhancing photorealism and spatial consistency. Importantly, DanceText adopts a fully training-free design by integrating pretrained modules, allowing flexible deployment without task-specific fine-tuning. Extensive experiments on the AnyWord-3M benchmark demonstrate that our method achieves superior performance in visual quality, especially under large-scale and complex transformation scenarios. Code is avaible at https://github.com/YuZhenyuLindy/DanceText.git.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 18 Apr 2025.
Builds on
27 of 39 references.
References · 27
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2024Depth Anything V2cited by 1,422
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
15 more
- 2016COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Imagescited by 236
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
- 2019EdgeConnect: Generative Image Inpainting with Adversarial Edge Learningcited by 163
- 2019ICDAR2019 Robust Reading Challenge on Multi-lingual Scene Text Detection and Recognition -- RRC-MLT-2019cited by 139
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 131
- 2019ICDAR 2019 Robust Reading Challenge on Reading Chinese Text on Signboardcited by 128
- 2019ICDAR 2019 Competition on Large-scale Street View Text with Partial Labeling -- RRC-LSVTcited by 122
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 106
- 2017ICDAR2017 Competition on Reading Chinese Text in the Wild (RCTW-17)cited by 105
- 2025Yuan: Yielding Unblemished Aesthetics Through A Unified Network for Visual Imperfections Removal in Generated Imagescited by 13
- 2025Who is Responsible? The Data, Models, Users or Regulations? A Comprehensive Survey on Responsible Generative AI for a Sustainable Futurecited by 12
- 2024Improved implicit diffusion model with knowledge distillation to estimate the spatial distribution density of carbon stock in remote sensing imagerycited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing
- 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesis
- 2025SceneTextStylizer: A Training-Free Scene Text Style Transfer Framework with Diffusion Model
- 2026InnoText: A Unified Model for Visual Text Generation and Editing
- 2026MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale
- 2024TextMastero: Mastering High-Quality Scene Text Editing in Diverse Languages and Styles
- 2026Language-Free Generative Editing from One Visual Example
- 2024JoyType: A Robust Design for Multilingual Visual Text Creation