mlsanityData to 14 Oct 2026

SteerVTE: Seamless Video Text Editing with Style and Glyph Control

arXiv 2606.23254 ↗First posted 22 Jun 2026cs.CV cs.AIcited by 3

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Visual text editing aims to precisely modify text in images and videos while preserving stylistic consistency and visual realism. Despite significant advances in the image domain, video text editing remains largely unexplored: it is a localized task demanding stroke-level precision within small text regions, which compounds the challenges of cross-frame accuracy, temporal coherence, and stylistic fidelity. We introduce SteerVTE, a unified framework that underlinesteers a frozen video diffusion model to perform precise underlineVideo underlineText underlineEditing through style and glyph control. Built on a frozen diffusion transformer, SteerVTE attaches a lightweight text context adapter with two complementary modules: a style encoder capturing the original text's visual attributes, and dual-granularity glyph encoders encoding the target text at both the line and character levels. To overcome the inherently weak text rendering priors of video foundation models, we further propose a glyph-aware spatial-focal loss and a three-stage progressive training curriculum that scales from image to video data. To support large-scale training, we also develop an automatic synthesis pipeline and construct SteerVTE-1M, a dataset of one million triplets spanning diverse scenes, fonts, and stylistic effects. Extensive experiments demonstrate that SteerVTE substantially outperforms existing video editing baselines across text accuracy, style consistency, and temporal coherence.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 59 of its 68 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

59 of 68 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  2. 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing6 May
  3. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov
  4. 2023AnyText: Multilingual Visual Text Generation And Editing6 Nov
  5. 2023TextDiffuser: Diffusion Models as Text Painters18 May
  6. 2023DiffUTE: Universal Text Editing Diffusion Model18 May
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov

Other references · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2022Flow Matching for Generative Modelingcited by 5,702
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2025Qwen3-VL Technical Reportcited by 2,793
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
38 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2025Qwen-Image Technical Reportcited by 1,044
  3. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  4. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  5. 2025VACE: All-in-One Video Creation and Editingcited by 479
  6. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  7. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  8. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  9. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
  10. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
  11. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  12. 2025PaddleOCR 3.0 Technical Reportcited by 143
  13. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  14. 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
  15. 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
  16. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  17. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  18. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  19. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 81
  20. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
  21. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
  22. 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 53
  23. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 45
  24. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  25. 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 40
  26. 2024Generative Video Propagationcited by 36
  27. 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
  28. 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35
  29. 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
  30. 2024Videoshop: Localized Semantic Video Editing with Noise-Extrapolated Diffusion Inversioncited by 27
  31. 2021A Bilingual, OpenWorld Video Text Dataset and End-to-end Video Text Spotter with Transformercited by 26
  32. 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 25
  33. 2024Visual Text Generation in the Wildcited by 22
  34. 2024EffiVED:Efficient Video Editing via Text-instruction Diffusion Modelscited by 21
  35. 2025VIVA: VLM-Guided Instruction-Based Video Editing with Reward Optimizationcited by 16
  36. 2025UTDesign: A Unified Framework for Stylized Text Editing and Generation in Graphic Design Imagescited by 6
  37. 2026UM-Text: A Unified Multimodal Model for Image Understanding and Visual Text Editingcited by 5
  38. 2025DoPI: Doctor-like Proactive Interrogation LLM for Traditional Chinese Medicinecited by 1

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors
  2. 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learning
  3. 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
  4. 2023VidEdit: Zero-Shot and Spatially Aware Text-Driven Video Editing
  5. 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders
  6. 2023ControlVideo: Conditional Control for One-shot Text-driven Video Editing and Beyond
  7. 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis
  8. 2025DanceText: A Training-Free Layered Framework for Controllable Multilingual Text Transformation in Images