GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Rendering
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Generating accurate glyphs for visual text rendering is essential yet challenging. Existing methods typically enhance text rendering by training on a large amount of high-quality scene text images, but the limited coverage of glyph variations and excessive stylization often compromise glyph accuracy, especially for complex or out-of-domain characters. Some methods leverage reinforcement learning to alleviate this issue, yet their reward models usually depend on text recognition systems that are insensitive to fine-grained glyph errors, so images with incorrect glyphs may still receive high rewards. Inspired by Direct Preference Optimization (DPO), we propose GlyphPrinter, a preference-based text rendering method that eliminates reliance on explicit reward models. However, the standard DPO objective only models overall preference between two samples, which is insufficient for visual text rendering where glyph errors typically occur in localized regions. To address this issue, we construct the GlyphCorrector dataset with region-level glyph preference annotations and propose Region-Grouped DPO (R-GDPO), a region-based objective that optimizes inter- and intra-sample preferences over annotated regions, substantially enhancing glyph accuracy. Furthermore, we introduce Regional Reward Guidance, an inference strategy that samples from an optimal distribution with controllable glyph accuracy. Extensive experiments demonstrate that the proposed GlyphPrinter outperforms existing methods in glyph accuracy while maintaining a favorable balance between stylization and precision.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 53 of its 57 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
53 of 57 references.
Closest ancestors · 4
Same direction, newest first
- 2025DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Models4 Jun
- 2025Diffusion Blend: Inference-Time Multi-Preference Alignment for Diffusion Models24 May
- 2025Improving Video Generation with Human Feedback23 Jan
- 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
Other references · 49
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025Qwen-Image Technical Reportcited by 973
37 more
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 466
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
- 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 284
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2020PP-OCR: A Practical Ultra Lightweight OCR Systemcited by 147
- 2025Seedream 3.0 Technical Reportcited by 146
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2023Guided Flows for Generative Modeling and Decision Makingcited by 99
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2024A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Modelscited by 51
- 2025Diffusion Guidance Is a Controllable Policy Improvement Operatorcited by 51
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
- 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 47
- 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editingcited by 44
- 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 41
- 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Modelscited by 37
- 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
- 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Modelscited by 28
- 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 25
- 2025Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMscited by 22
- 2024PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generationcited by 18
- 2025BizGen: Advancing Article-level Visual Text Rendering for Infographics Generationcited by 18
- 2025Free-Form Motion Control: Controlling the 6D Poses of Camera and Objects in Video Generationcited by 15
- 2024JoyType: A Robust Design for Multilingual Visual Text Creationcited by 12
- 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesiscited by 12
- 2025AnyI2V: Animating Any Conditional Image with Motion Controlcited by 11
- 2025ControlText: Unlocking Controllable Fonts in Multilingual Text Rendering without Font Annotationscited by 10
- 2025SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulationcited by 9
- 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesiscited by 8
- 2025RepText: Rendering Visual Text via Replicatingcited by 7
- 2025Free-Form Scene Editor: Enabling Multi-Round Object Manipulation like in a 3D Enginecited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priorscited by 2
- 2026Edit Fidelity Field: Semantics-Aware Region Isolation for Training-Free Scene Text Editingcited by 0
- 2026Seek to Segment: Active Perception for Panoramic Referring Segmentationcited by 0
- 2026Decompose Radicals, Then Reward: Fine-Grained Inspection for Accurate Chinese Text Renderingcited by 0
- 2026Decompose Radicals, Then Reward: Fine-Grained Inspection for Accurate Chinese Text Rendering29 Sep 2026
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors2 Sep 2026
- 2026Seek to Segment: Active Perception for Panoramic Referring Segmentation2 Jul 2026
- 2026Edit Fidelity Field: Semantics-Aware Region Isolation for Training-Free Scene Text Editing19 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026TextAlign: Preference Alignment for Text Rendering with Hierarchical Rewards
- 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
- 2025HDGlyph: A Hierarchical Disentangled Glyph-Based Framework for Long-Tail Text Rendering in Diffusion Models
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows
- 2023GlyphDiffusion: Text Generation as Image Generation
- 2026VecGlypher: Unified Vector Glyph Generation with Language Models
- 2024Refining Text-to-Image Generation: Towards Accurate Training-Free Glyph-Enhanced Image Generation
- 2026Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering