mlsanityData to 7 Oct 2026

GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Rendering

arXiv 2603.15616 ↗First posted 16 Mar 2026cs.CVcited by 4

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Generating accurate glyphs for visual text rendering is essential yet challenging. Existing methods typically enhance text rendering by training on a large amount of high-quality scene text images, but the limited coverage of glyph variations and excessive stylization often compromise glyph accuracy, especially for complex or out-of-domain characters. Some methods leverage reinforcement learning to alleviate this issue, yet their reward models usually depend on text recognition systems that are insensitive to fine-grained glyph errors, so images with incorrect glyphs may still receive high rewards. Inspired by Direct Preference Optimization (DPO), we propose GlyphPrinter, a preference-based text rendering method that eliminates reliance on explicit reward models. However, the standard DPO objective only models overall preference between two samples, which is insufficient for visual text rendering where glyph errors typically occur in localized regions. To address this issue, we construct the GlyphCorrector dataset with region-level glyph preference annotations and propose Region-Grouped DPO (R-GDPO), a region-based objective that optimizes inter- and intra-sample preferences over annotated regions, substantially enhancing glyph accuracy. Furthermore, we introduce Regional Reward Guidance, an inference strategy that samples from an optimal distribution with controllable glyph accuracy. Extensive experiments demonstrate that the proposed GlyphPrinter outperforms existing methods in glyph accuracy while maintaining a favorable balance between stylization and precision.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 53 of its 57 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

53 of 57 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Models4 Jun
  2. 2025Diffusion Blend: Inference-Time Multi-Preference Alignment for Diffusion Models24 May
  3. 2025Improving Video Generation with Human Feedback23 Jan
  4. 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov

Other references · 49

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  7. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  10. 2025Qwen3-VL Technical Reportcited by 2,534
  11. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  12. 2025Qwen-Image Technical Reportcited by 973
37 more
  1. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  2. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  3. 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 466
  4. 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
  5. 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 284
  6. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  7. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
  8. 2020PP-OCR: A Practical Ultra Lightweight OCR Systemcited by 147
  9. 2025Seedream 3.0 Technical Reportcited by 146
  10. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
  11. 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
  12. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
  13. 2023Guided Flows for Generative Modeling and Decision Makingcited by 99
  14. 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
  15. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
  16. 2024A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Modelscited by 51
  17. 2025Diffusion Guidance Is a Controllable Policy Improvement Operatorcited by 51
  18. 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
  19. 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 47
  20. 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editingcited by 44
  21. 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 41
  22. 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Modelscited by 37
  23. 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
  24. 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Modelscited by 28
  25. 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 25
  26. 2025Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMscited by 22
  27. 2024PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generationcited by 18
  28. 2025BizGen: Advancing Article-level Visual Text Rendering for Infographics Generationcited by 18
  29. 2025Free-Form Motion Control: Controlling the 6D Poses of Camera and Objects in Video Generationcited by 15
  30. 2024JoyType: A Robust Design for Multilingual Visual Text Creationcited by 12
  31. 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesiscited by 12
  32. 2025AnyI2V: Animating Any Conditional Image with Motion Controlcited by 11
  33. 2025ControlText: Unlocking Controllable Fonts in Multilingual Text Rendering without Font Annotationscited by 10
  34. 2025SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulationcited by 9
  35. 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesiscited by 8
  36. 2025RepText: Rendering Visual Text via Replicatingcited by 7
  37. 2025Free-Form Scene Editor: Enabling Multi-Round Object Manipulation like in a 3D Enginecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TextAlign: Preference Alignment for Text Rendering with Hierarchical Rewards
  2. 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
  3. 2025HDGlyph: A Hierarchical Disentangled Glyph-Based Framework for Long-Tail Text Rendering in Diffusion Models
  4. 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows
  5. 2023GlyphDiffusion: Text Generation as Image Generation
  6. 2026VecGlypher: Unified Vector Glyph Generation with Language Models
  7. 2024Refining Text-to-Image Generation: Towards Accurate Training-Free Glyph-Enhanced Image Generation
  8. 2026Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering