TripleFDS: Triple Feature Disentanglement and Synthesis for Scene Text Editing
Not on the map. Why?
Abstract (arXiv)
Scene Text Editing (STE) aims to naturally modify text in images while preserving visual consistency, the decisive factors of which can be divided into three parts, i.e., text style, text content, and background. Previous methods have struggled with incomplete disentanglement of editable attributes, typically addressing only one aspect - such as editing text content - thus limiting controllability and visual consistency. To overcome these limitations, we propose TripleFDS, a novel framework for STE with disentangled modular attributes, and an accompanying dataset called SCB Synthesis. SCB Synthesis provides robust training data for triple feature disentanglement by utilizing the "SCB Group", a novel construct that combines three attributes per image to generate diverse, disentangled training groups. Leveraging this construct as a basic training unit, TripleFDS first disentangles triple features, ensuring semantic accuracy through inter-group contrastive regularization and reducing redundancy through intra-sample multi-feature orthogonality. In the synthesis phase, TripleFDS performs feature remapping to prevent "shortcut" phenomena during reconstruction and mitigate potential feature leakage. Trained on 125,000 SCB Groups, TripleFDS achieves state-of-the-art image fidelity (SSIM of 44.54) and text accuracy (ACC of 93.58%) on the mainstream STE benchmarks. Besides superior performance, the more flexible editing of TripleFDS supports new operations such as style replacement and background transfer. Code: https://github.com/yusenbao01/TripleFDS
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
22 of 35 references.
References · 22
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2022Generative Adversarial Networkscited by 5,627
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 131
- 2019Editing Text in the Wildcited by 82
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 81
- 2020SwapText: Image Based Texts Transfer in Scenescited by 50
10 more
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learningcited by 48
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 45
- 2023DiffUTE: Universal Text Editing Diffusion Modelcited by 45
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 45
- 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Modelcited by 41
- 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 37
- 2024Visual Text Generation in the Wildcited by 22
- 2024Choose What You Need: Disentangled Representation Learning for Scene Text Recognition, Removal and Editingcited by 18
- 2021Deep Learning-based Forgery Attack on Document Imagescited by 14
- 2024Visual Text Meets Low-level Vision: A Comprehensive Survey on Visual Text Processingcited by 8
Built on by
Not cited yet.