Beyond Patches: Global-aware Autoregressive Model for Multimodal Few-Shot Font Generation
Not on the map. Why?
Abstract (arXiv)
Manual font design is an intricate process that transforms a stylistic visual concept into a coherent glyph set. This challenge persists in automated Few-shot Font Generation (FFG), where models often struggle to preserve both the structural integrity and stylistic fidelity from limited references. While autoregressive (AR) models have demonstrated impressive generative capabilities, their application to FFG is constrained by conventional patch-level tokenization, which neglects global dependencies crucial for coherent font synthesis. Moreover, existing FFG methods remain within the image-to-image paradigm, relying solely on visual references and overlooking the role of language in conveying stylistic intent during font design. To address these limitations, we propose GAR-Font, a novel AR framework for multimodal few-shot font generation. GAR-Font introduces a global-aware tokenizer that effectively captures both local structures and global stylistic patterns, a multimodal style encoder offering flexible style control through a lightweight language-style adapter without requiring intensive multimodal pretraining, and a post-refinement pipeline that further enhances structural fidelity and style coherence. Extensive experiments show that GAR-Font outperforms existing FFG methods, excelling in maintaining global style faithfulness and achieving higher-quality results with textual stylistic guidance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 64 of its 80 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
64 of 80 references.
References · 64
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2017Neural Discrete Representation Learningcited by 4,650
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2025Qwen-Image Technical Reportcited by 973
38 more
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2018Image Transformercited by 770
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 301
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 226
- 2023Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuningcited by 168
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2024AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detectioncited by 126
- 2024Randomized Autoregressive Visual Generationcited by 125
- 2025FlexTok: Resampling Images into 1D Token Sequences of Flexible Lengthcited by 105
- 2024ImageFolder: Autoregressive Image Generation with Folded Tokenscited by 93
- 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 85
- 2021DG-Font: Deformable Generative Networks for Unsupervised Font Generationcited by 70
- 2017Separating Style and Content for Generalized Style Transfercited by 64
- 2024Parallelized Autoregressive Visual Generationcited by 58
- 2019Artistic Glyph Image Synthesis via One-Stage Few-Shot Learningcited by 53
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learningcited by 48
- 2020Few-shot Font Generation with Localized Style Representations and Factorizationcited by 47
- 2021Multiple Heads are Better than One: Few-shot Font Generation with Multiple Localized Expertscited by 46
- 2020Few-shot Compositional Font Generation with Dual Memorycited by 44
- 2022Diff-Font: Diffusion Model for Robust One-Shot Font Generationcited by 40
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2024Language-Guided Image Tokenization for Generationcited by 36
- 2022Few-Shot Font Generation by Learning Fine-Grained Local Stylescited by 34
- 2023Efficient-VQGAN: Towards High-Resolution Image Generation with Efficient Vision Transformerscited by 33
- 2022Look Closer to Supervise Better: One-Shot Font Generation via Component-Based Discriminatorcited by 32
- 2023Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image Generationcited by 28
- 2024STAR: Scale-wise Text-conditioned AutoRegressive image generationcited by 28
- 2023DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Qualitycited by 27
- 2023CF-Font: Content Fusion for Few-shot Font Generationcited by 26
- 2018Generating Handwritten Chinese Characters using CycleGANcited by 21
- 2021ZiGAN: Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approachcited by 20
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.