Exploring the AI Obedience: Why is Generating a Pure Color Image Harder than CyberPunk?
Not on the map. Why?
Abstract (arXiv)
Recent advances in generative AI have shown human-level performance in complex content creation. However, we identify a "Paradox of Simplicity": models that can render complex scenes often fail at trivial, low-entropy tasks, such as generating a uniform pure color image. We argue this is a systemic failure related to uncontrollable emergent abilities. As models scale, strong priors for aesthetics and complexity override deterministic simplicity, creating an "aesthetic bias" that hinders the model's transition from data simulation to true intellectual abstraction. To better investigate this problem, we formalize the concept of AI Obedience, a hierarchical framework that grades a model's ability to transition from probabilistic approximation to pixel-level determinism (Levels 1 to 5). We introduce Violin, the first systematic benchmark designed to evaluate Level 4 Obedience through three deterministic tasks: color purity, image masking, and geometric shape generation. Using Violin, we evaluate several state-of-the-art models and reveal that closed-source models generally outperform open-source ones in deterministic precision. Interestingly, performance on our benchmark correlates with the benchmark in natural image generation. Our work provides a foundational framework and tools for achieving better alignment between human instructions and model outputs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 65 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
52 of 65 references.
References · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
38 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 325
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2022Predictability and Surprise in Large Generative Modelscited by 209
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 130
- 2023What You See is What You Read? Improving Text-Image Alignment Evaluationcited by 105
- 2022Benchmarking Spatial Relationships in Text-to-Image Generationcited by 96
- 2019Semantic Object Accuracy for Generative Text-to-Image Synthesiscited by 89
- 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 85
- 2024GenAI Arena: An Open Evaluation Platform for Generative Modelscited by 81
- 2024ControlAR: Controllable Image Generation with Autoregressive Modelscited by 48
- 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objectscited by 47
- 2025Emergent Abilities in Large Language Models: A Surveycited by 34
- 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 31
- 2023VideoCon: Robust Video-Language Alignment via Contrast Captionscited by 29
- 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglementcited by 28
- 2025ColorBench: Can VLMs See and Understand the Colorful World? A Comprehensive Benchmark for Color Perception, Reasoning, and Robustnesscited by 28
- 2023TIAM -- A Metric for Evaluating Alignment in Text-to-Image Generationcited by 18
- 2025How Well Does GPT-4o Understand Vision? Evaluating Multimodal Foundation Models on Standard Computer Vision Taskscited by 14
- 2025Color Alignment in Diffusioncited by 10
- 2025TNG-CLIP:Training-Time Negation Data Generation for Negation Awareness of CLIPcited by 6
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.