mlsanityData to 7 Oct 2026

Video Text Preservation with Synthetic Text-Rich Videos

arXiv 2511.05573 ↗First posted 4 Nov 2025cs.CV cs.AIcited by 3

On the map: Diffusion models → Video generation

Abstract (arXiv)

While Text-To-Video (T2V) models have advanced rapidly, they continue to struggle with generating legible and coherent text within videos. In particular, existing models often fail to render correctly even short phrases or words and previous attempts to address this problem are computationally expensive and not suitable for video generation. In this work, we investigate a lightweight approach to improve T2V diffusion models using synthetic supervision. We first generate text-rich images using a text-to-image (T2I) diffusion model, then animate them into short videos using a text-agnostic image-to-video (I2v) model. These synthetic video-prompt pairs are used to fine-tune Wan2.1, a pre-trained T2V model, without any architectural changes. Our results show improvement in short-text legibility and temporal consistency with emerging structural priors for longer text. These findings suggest that curated synthetic data and weak supervision offer a practical path toward improving textual fidelity in T2V generation.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 20 of its 24 references that are in the map. First posted on arXiv 4 Nov 2025.

Builds on

20 of 24 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
  2. 2022Video Diffusion Models7 Apr

Other references · 18

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  3. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  4. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  5. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  6. 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 431
  7. 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 246
  8. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  9. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
  10. 2024In-Context LoRA for Diffusion Transformerscited by 155
  11. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  12. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
6 more
  1. 2023Finetuning Text-to-Image Diffusion Models for Fairnesscited by 90
  2. 2024Self-Play Fine-Tuning of Diffusion Models for Text-to-Image Generationcited by 85
  3. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
  4. 2024Harmonizing Visual Text Comprehension and Generationcited by 54
  5. 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 47
  6. 2024LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
  2. 2024TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Models
  3. 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generation
  4. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text
  5. 2023A Recipe for Scaling up Text-to-Video Generation with Text-free Videos
  6. 2024VideoTetris: Towards Compositional Text-to-Video Generation
  7. 2024HARIVO: Harnessing Text-to-Image Models for Video Generation
  8. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising