SteerVTE: Seamless Video Text Editing with Style and Glyph Control
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Visual text editing aims to precisely modify text in images and videos while preserving stylistic consistency and visual realism. Despite significant advances in the image domain, video text editing remains largely unexplored: it is a localized task demanding stroke-level precision within small text regions, which compounds the challenges of cross-frame accuracy, temporal coherence, and stylistic fidelity. We introduce SteerVTE, a unified framework that underlinesteers a frozen video diffusion model to perform precise underlineVideo underlineText underlineEditing through style and glyph control. Built on a frozen diffusion transformer, SteerVTE attaches a lightweight text context adapter with two complementary modules: a style encoder capturing the original text's visual attributes, and dual-granularity glyph encoders encoding the target text at both the line and character levels. To overcome the inherently weak text rendering priors of video foundation models, we further propose a glyph-aware spatial-focal loss and a three-stage progressive training curriculum that scales from image to video data. To support large-scale training, we also develop an automatic synthesis pipeline and construct SteerVTE-1M, a dataset of one million triplets spanning diverse scenes, fonts, and stylistic effects. Extensive experiments demonstrate that SteerVTE substantially outperforms existing video editing baselines across text accuracy, style consistency, and temporal coherence.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 59 of its 68 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
59 of 68 references.
Closest ancestors · 8
Same direction, newest first
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing6 May
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov
- 2023AnyText: Multilingual Visual Text Generation And Editing6 Nov
- 2023TextDiffuser: Diffusion Models as Text Painters18 May
- 2023DiffUTE: Universal Text Editing Diffusion Model18 May
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
Other references · 51
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025Qwen-Image Technical Reportcited by 1,044
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2025PaddleOCR 3.0 Technical Reportcited by 143
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
- 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 81
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 53
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 45
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 40
- 2024Generative Video Propagationcited by 36
- 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35
- 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
- 2024Videoshop: Localized Semantic Video Editing with Noise-Extrapolated Diffusion Inversioncited by 27
- 2021A Bilingual, OpenWorld Video Text Dataset and End-to-end Video Text Spotter with Transformercited by 26
- 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 25
- 2024Visual Text Generation in the Wildcited by 22
- 2024EffiVED:Efficient Video Editing via Text-instruction Diffusion Modelscited by 21
- 2025VIVA: VLM-Guided Instruction-Based Video Editing with Reward Optimizationcited by 16
- 2025UTDesign: A Unified Framework for Stylized Text Editing and Generation in Graphic Design Imagescited by 6
- 2026UM-Text: A Unified Multimodal Model for Image Understanding and Visual Text Editingcited by 5
- 2025DoPI: Doctor-like Proactive Interrogation LLM for Traditional Chinese Medicinecited by 1
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generationcited by 1
- 2026Enhanced Video Text Editing with Trajectory-Aligned Glyph Renderingcited by 0
- 2026Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generationcited by 0
- 2026VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation1 Oct 2026
- 2026Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generation29 Sep 2026
- 2026Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors
- 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learning
- 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
- 2023VidEdit: Zero-Shot and Spatially Aware Text-Driven Video Editing
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders
- 2023ControlVideo: Conditional Control for One-shot Text-driven Video Editing and Beyond
- 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis
- 2025DanceText: A Training-Free Layered Framework for Controllable Multilingual Text Transformation in Images