GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Despite recent advances in generative models driving significant progress in text rendering, accurately generating complex text and mathematical formulas remains a formidable challenge. This difficulty primarily stems from the limited instruction-following capabilities of current models when encountering out-of-distribution prompts. To address this, we introduce GlyphBanana, alongside a corresponding benchmark specifically designed for rendering complex characters and formulas. GlyphBanana employs an agentic workflow that integrates auxiliary tools to inject glyph templates into both the latent space and attention maps, facilitating the iterative refinement of generated images. Notably, our training-free approach can be seamlessly applied to various Text-to-Image (T2I) models, achieving superior precision compared to existing baselines. Extensive experiments demonstrate the effectiveness of our proposed workflow. Associated code is publicly available at https://github.com/yuriYanZeXuan/GlyphBanana.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 56 of its 68 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
56 of 68 references.
Closest ancestors · 5
Same direction, newest first
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Tooling9 Feb
- 2026Kimi K2.5: Visual Agentic Intelligence2 Feb
- 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent21 Jun
- 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoning29 May
- 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct
Other references · 51
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
38 more
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2024Taming Rectified Flow for Inversion and Editingcited by 200
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 100
- 2025Controllable Video Generation: A Surveycited by 93
- 2022Character-Aware Models Improve Visual Text Renderingcited by 90
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 61
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editingcited by 44
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 41
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2025KABB: Knowledge-Aware Bayesian Bandits for Dynamic Expert Coordination in Multi-Agent Systemscited by 36
- 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
- 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
- 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 34
- 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
- 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Modelcited by 31
- 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
- 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 25
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 23
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2025Investigating Text Insulation and Attention Mechanisms for Complex Visual Text Generationcited by 22
- 2025Follow-Your-Preference: Towards Preference-Aligned Image Inpaintingcited by 18
- 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
- 2025Personalized Vision via Visual In-Context Learningcited by 14
- 2025MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restorationcited by 12
- 2024TextMaster: A Unified Framework for Realistic Text Editing via Glyph-Style Dual-Controlcited by 4
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026AgentDisCo: Towards Disentanglement and Collaboration in Open-ended Deep Research Agentscited by 2
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priorscited by 2
- 2026Edit Fidelity Field: Semantics-Aware Region Isolation for Training-Free Scene Text Editingcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors2 Sep 2026
- 2026AgentDisCo: Towards Disentanglement and Collaboration in Open-ended Deep Research Agents12 May 2026
- 2026Edit Fidelity Field: Semantics-Aware Region Isolation for Training-Free Scene Text Editing19 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
- 2023GlyphDiffusion: Text Generation as Image Generation
- 2026GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Rendering
- 2025HDGlyph: A Hierarchical Disentangled Glyph-Based Framework for Long-Tail Text Rendering in Diffusion Models
- 2024Refining Text-to-Image Generation: Towards Accurate Training-Free Glyph-Enhanced Image Generation
- 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Models
- 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis
- 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation