On the Limitations of Cross-Lingual Consistency in Multilingual Text-to-image Generation
Not on the map. Why?
Abstract (arXiv)
Text-to-image (T2I) generation has achieved remarkable progress in recent years. However, existing research has largely focused on English-only settings, leaving cross-lingual performance gaps and language-specific effects insufficiently explored. To fill this gap, we introduce LingT2I, a benchmark covering 10 widely used languages with 33K prompts, designed to evaluate cross-lingual effects in both content generation and text rendering. Building on this benchmark, we conduct a comprehensive cross-lingual analysis, uncovering linguistic inequality and language-dependent trade-offs across evaluation dimensions. Beyond quantitative evaluation, we further reveal a range of language-dependent generation patterns, highlighting how linguistic factors and their corresponding cultural contexts systematically impact model outputs. Our benchmark and analysis provide a foundation for studying cross-lingual behavior in T2I generation and facilitate the development of more robust and inclusive models. Code and dataset are available at https://github.com/RISys-Lab/LingT2I.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 34 of its 69 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
34 of 69 references.
References · 34
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,549
- 2024Qwen2.5 Technical Reportcited by 4,840
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,323
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,141
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,815
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,452
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,154
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 799
- 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 741
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 166
22 more
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
- 2024DOCCI: Descriptions of Connected and Contrasting Imagescited by 131
- 2020Improving Image Captioning with Better Use of Captionscited by 84
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2025Meta CLIP 2: A Worldwide Scaling Recipecited by 62
- 2023TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Modelscited by 51
- 2023Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Reviewcited by 50
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 49
- 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 47
- 2023Inspecting the Geographical Representativeness of Images from Text-to-Image Modelscited by 44
- 2021Assessing Multilingual Fairness in Pre-trained Multimodal Representationscited by 35
- 2022Exploiting Cultural Biases via Homoglyphs in Text-to-Image Synthesiscited by 29
- 2023GlueGen: Plug and Play Multi-modal Encoders for X-to-image Generationcited by 25
- 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 25
- 2022Multilingual Multimodal Learning with Machine Translated Textcited by 16
- 2024Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Modelscited by 11
- 2024An Empirical Study and Analysis of Text-to-Image Generation Using Large Language Model-Powered Textual Representationcited by 11
- 2026The Roots of Performance Disparity in Multilingual Language Models: Intrinsic Modeling Difficulty or Design Choices?cited by 10
- 2025Can we Debias Social Stereotypes in AI-Generated Images? Examining Text-to-Image Outputs and User Perceptionscited by 6
- 2024Navigating Text-to-Image Generative Bias across Indic Languagescited by 5
- 2025NeoBabel: A Multilingual Open Tower for Visual Generationcited by 2
Built on by
Not cited yet.