mlsanityData to 7 Oct 2026

Exploring the AI Obedience: Why is Generating a Pure Color Image Harder than CyberPunk?

arXiv 2603.00166 ↗First posted 26 Feb 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in generative AI have shown human-level performance in complex content creation. However, we identify a "Paradox of Simplicity": models that can render complex scenes often fail at trivial, low-entropy tasks, such as generating a uniform pure color image. We argue this is a systemic failure related to uncontrollable emergent abilities. As models scale, strong priors for aesthetics and complexity override deterministic simplicity, creating an "aesthetic bias" that hinders the model's transition from data simulation to true intellectual abstraction. To better investigate this problem, we formalize the concept of AI Obedience, a hierarchical framework that grades a model's ability to transition from probabilistic approximation to pixel-level determinism (Levels 1 to 5). We introduce Violin, the first systematic benchmark designed to evaluate Level 4 Obedience through three deterministic tasks: color purity, image masking, and geometric shape generation. Using Violin, we evaluate several state-of-the-art models and reveal that closed-source models generally outperform open-source ones in deterministic precision. Interestingly, performance on our benchmark correlates with the benchmark in natural image generation. Our work provides a foundational framework and tools for achieving better alignment between human instructions and model outputs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 65 references that are in the map. First posted on arXiv 26 Feb 2026.

Builds on

52 of 65 references.

References · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2020Scaling Laws for Neural Language Modelscited by 6,411
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2022Generative Adversarial Networkscited by 5,603
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  12. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
38 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  3. 2022Emergent Abilities of Large Language Modelscited by 2,483
  4. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  5. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  6. 2025Qwen-Image Technical Reportcited by 973
  7. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  8. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  9. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  10. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  11. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  12. 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
  13. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  14. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  15. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
  16. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 325
  17. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  18. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  19. 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
  20. 2022Predictability and Surprise in Large Generative Modelscited by 209
  21. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  22. 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 130
  23. 2023What You See is What You Read? Improving Text-Image Alignment Evaluationcited by 105
  24. 2022Benchmarking Spatial Relationships in Text-to-Image Generationcited by 96
  25. 2019Semantic Object Accuracy for Generative Text-to-Image Synthesiscited by 89
  26. 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 85
  27. 2024GenAI Arena: An Open Evaluation Platform for Generative Modelscited by 81
  28. 2024ControlAR: Controllable Image Generation with Autoregressive Modelscited by 48
  29. 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objectscited by 47
  30. 2025Emergent Abilities in Large Language Models: A Surveycited by 34
  31. 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 31
  32. 2023VideoCon: Robust Video-Language Alignment via Contrast Captionscited by 29
  33. 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglementcited by 28
  34. 2025ColorBench: Can VLMs See and Understand the Colorful World? A Comprehensive Benchmark for Color Perception, Reasoning, and Robustnesscited by 28
  35. 2023TIAM -- A Metric for Evaluating Alignment in Text-to-Image Generationcited by 18
  36. 2025How Well Does GPT-4o Understand Vision? Evaluating Multimodal Foundation Models on Standard Computer Vision Taskscited by 14
  37. 2025Color Alignment in Diffusioncited by 10
  38. 2025TNG-CLIP:Training-Time Negation Data Generation for Negation Awareness of CLIPcited by 6

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.