Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering
Not on the map. Why?
Abstract (arXiv)
Video text editing aims to replace or add text in a video while keeping the rest of the video unchanged, which requires the edited text to be correct in every frame and to move coherently with the scene. Despite the remarkable progress of video diffusion models, they struggle to reproduce exact stroke structures and often produce garbled or wrong characters, especially for characters with complex strokes. To address this, we propose a trajectory-aligned glyph rendering reference that provides explicit per-frame glyph guidance following the position and perspective of the text, and a depth-normalized recognizer feature supervision that supervises the generated text on multi-depth features of a frozen text recognizer with per-depth normalized errors, targeting stroke errors overlooked by the diffusion loss. We further build VTEdit, a benchmark of 288 real-scene clips with 440 annotated text trajectories covering text replacement and text addition, which will be publicly released to facilitate future research. Experiments on VTEdit show that our method outperforms image text editing methods, video editing methods, and commercial models in text accuracy and background preservation, achieving a sentence accuracy of 0.9408, and receives the highest preference in a user study.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
33 of 39 references.
References · 33
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2018Learning Blind Video Temporal Consistencycited by 247
21 more
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 142
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 105
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2025Kling-Omni Technical Reportcited by 60
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
- 2023DiffUTE: Universal Text Editing Diffusion Modelcited by 44
- 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editingcited by 44
- 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 34
- 2022OCR-VQGAN: Taming Text-within-Image Generationcited by 31
- 2024CharGen: High Accurate Character-Level Visual Text Generation Model with MultiModal Encodercited by 14
- 2021STRIVE: Scene Text Replacement In Videoscited by 13
- 2024JoyType: A Robust Design for Multilingual Visual Text Creationcited by 12
- 2026PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Taskscited by 12
- 2025UTDesign: A Unified Framework for Stylized Text Editing and Generation in Graphic Design Imagescited by 6
- 2026UM-Text: A Unified Multimodal Model for Image Understanding and Visual Text Editingcited by 4
- 2026SteerVTE: Seamless Video Text Editing with Style and Glyph Controlcited by 3
- 2026InnoText: A Unified Model for Visual Text Generation and Editingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors
- 2026Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generation
- 2023VidEdit: Zero-Shot and Spatially Aware Text-Driven Video Editing
- 2024TextMastero: Mastering High-Quality Scene Text Editing in Diverse Languages and Styles
- 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis
- 2026GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Rendering
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generation