Text-to-Image Models Leave Identifiable Signatures: Implications for Leaderboard Security
Not on the map. Why?
Abstract (arXiv)
Generative AI leaderboards are central to evaluating model capabilities, but remain vulnerable to manipulation. Among key adversarial objectives is rank manipulation, where an attacker must first deanonymize the models behind displayed outputs -- a threat previously demonstrated and explored for large language models (LLMs). We show that this problem can be even more severe for text-to-image leaderboards, where deanonymization is markedly easier. Using over 150,000 generated images from 280 prompts and 19 diverse models spanning multiple organizations, architectures, and sizes, we demonstrate that simple real-time classification in CLIP embedding space identifies the generating model with high accuracy, even without prompt control or historical data. We further introduce a prompt-level separability metric and identify prompts that enable near-perfect deanonymization. Our results indicate that rank manipulation in text-to-image leaderboards is easier than previously recognized, underscoring the need for stronger defenses.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
21 of 27 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 256
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 96
- 2025The Leaderboard Illusioncited by 66
- 2024LLMmap: Fingerprinting For Large Language Modelscited by 58
9 more
- 2025Exploring and Mitigating Adversarial Manipulation of Voting-Based Leaderboardscited by 20
- 2025Improving Your Model Ranking on Chatbot Arena by Vote Riggingcited by 17
- 2024TTSDS -- Text-to-Speech Distribution Scorecited by 14
- 2024Challenges in Trustworthy Human Evaluation of Chatbotscited by 14
- 2024From Protoscience to Epistemic Monoculture: How Benchmarking Set the Stage for the Deep Learning Revolutioncited by 12
- 2024Iteratively Prompting Multimodal LLMs to Reproduce Natural and AI-Generated Imagescited by 9
- 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Modelscited by 5
- 2024One Prompt to Verify Your Models: Black-Box Text-to-Image Models Verification via Non-Transferable Adversarial Attackscited by 4
- 2025SPRINT: Robust Model Attribution of Generated Images via Secret Pixel Reconstructioncited by 4
Built on by
Not cited yet.