mlsanityData to 7 Oct 2026

GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows

arXiv 2603.12155 ↗First posted 12 Mar 2026cs.CV cs.AIcited by 4

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Despite recent advances in generative models driving significant progress in text rendering, accurately generating complex text and mathematical formulas remains a formidable challenge. This difficulty primarily stems from the limited instruction-following capabilities of current models when encountering out-of-distribution prompts. To address this, we introduce GlyphBanana, alongside a corresponding benchmark specifically designed for rendering complex characters and formulas. GlyphBanana employs an agentic workflow that integrates auxiliary tools to inject glyph templates into both the latent space and attention maps, facilitating the iterative refinement of generated images. Notably, our training-free approach can be seamlessly applied to various Text-to-Image (T2I) models, achieving superior precision compared to existing baselines. Extensive experiments demonstrate the effectiveness of our proposed workflow. Associated code is publicly available at https://github.com/yuriYanZeXuan/GlyphBanana.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 56 of its 68 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

56 of 68 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Tooling9 Feb
  2. 2026Kimi K2.5: Visual Agentic Intelligence2 Feb
  3. 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent21 Jun
  4. 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoning29 May
  5. 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct

Other references · 51

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  9. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  10. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  11. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
  12. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
38 more
  1. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  2. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  3. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  4. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  5. 2024Taming Rectified Flow for Inversion and Editingcited by 200
  6. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  7. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
  8. 2025HunyuanImage 3.0 Technical Reportcited by 138
  9. 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
  10. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
  11. 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 100
  12. 2025Controllable Video Generation: A Surveycited by 93
  13. 2022Character-Aware Models Improve Visual Text Renderingcited by 90
  14. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  15. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
  16. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 61
  17. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
  18. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  19. 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editingcited by 44
  20. 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 41
  21. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  22. 2025KABB: Knowledge-Aware Bayesian Bandits for Dynamic Expert Coordination in Multi-Agent Systemscited by 36
  23. 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
  24. 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
  25. 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 34
  26. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
  27. 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Modelcited by 31
  28. 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30
  29. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  30. 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 25
  31. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 23
  32. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
  33. 2025Investigating Text Insulation and Attention Mechanisms for Complex Visual Text Generationcited by 22
  34. 2025Follow-Your-Preference: Towards Preference-Aligned Image Inpaintingcited by 18
  35. 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
  36. 2025Personalized Vision via Visual In-Context Learningcited by 14
  37. 2025MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restorationcited by 12
  38. 2024TextMaster: A Unified Framework for Realistic Text Editing via Glyph-Style Dual-Controlcited by 4

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
  2. 2023GlyphDiffusion: Text Generation as Image Generation
  3. 2026GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Rendering
  4. 2025HDGlyph: A Hierarchical Disentangled Glyph-Based Framework for Long-Tail Text Rendering in Diffusion Models
  5. 2024Refining Text-to-Image Generation: Towards Accurate Training-Free Glyph-Enhanced Image Generation
  6. 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Models
  7. 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis
  8. 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation