mlsanityData to 13 Oct 2026

Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generation

arXiv 2608.06751 ↗First posted 7 Aug 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Artist-grounded image generation requires more than appending an artist name to a prompt. Image models often respond to artist names through canonical shortcuts, such as recurring motifs, generic palettes, or overrepresented period signatures, rather than preserving the user's intended scene. We introduce Atelier, a shortcut-aware control-state planning framework for artist-grounded image generation. Atelier translates underspecified artistic intent into an explicit control state that separates scene anchors, preserve/transform decisions, style-regime hypotheses, role-bound artist evidence, and shortcut-avoidance constraints. It grounds this state using artist-level knowledge and local patch references, compiles backend-aware generation plans, and iteratively refines candidates through global and local authenticity feedback. We further introduce ArtIntentBench, a benchmark covering Van Gogh and Qi Baishi across artwork re-rendering, period/style-controlled generation, historically unseen subjects, shortcut auditing, and human preference evaluation. Across open-weight and closed-source generators, Atelier improves artist-level style fidelity, preserves source structure more faithfully, and substantially reduces shortcut substitution compared with prompt-engineered, retrieval-augmented, and general-purpose agent baselines. These results suggest that artist-grounded generation is bottlenecked not only by image synthesis, but by the upstream inference of explicit, evidence-grounded artistic controls.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 42 of its 100 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

42 of 100 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,502
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,915
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,339
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,484
  8. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,156
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,294
  11. 2025Qwen3-VL Technical Reportcited by 2,663
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,604
30 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,421
  2. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,240
  3. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,005
  4. 2020Shortcut Learning in Deep Neural Networkscited by 1,944
  5. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,453
  6. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,342
  7. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,180
  8. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,163
  9. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,104
  10. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,028
  11. 2025Qwen-Image Technical Reportcited by 1,002
  12. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 919
  13. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 327
  14. 2023Tool Learning with Foundation Modelscited by 302
  15. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 237
  16. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 227
  17. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
  18. 2025HunyuanImage 3.0 Technical Reportcited by 144
  19. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
  20. 2025LongCat-Image Technical Reportcited by 95
  21. 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 61
  22. 2024ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficultycited by 60
  23. 2024GalleryGPT: Analyzing Paintings with Large Multimodal Modelscited by 28
  24. 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 23
  25. 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 17
  26. 2024Have Large Vision-Language Models Mastered Art History?cited by 9
  27. 2024Towards Artwork Explanation in Large-scale Vision Language Modelscited by 8
  28. 2025Preventing Shortcuts in Adapter Training via Providing the Shortcutscited by 4
  29. 2024IntroStyle: Training-Free Introspective Style Attribution using Diffusion Featurescited by 3
  30. 2026Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Stylecited by 3

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Silent Brush: Evaluating Artistic Style Leakage in AI Art Generation
  2. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Models
  3. 2026Through Van Gogh's Eyes: Global Style Transfer with Diffusion Model
  4. 2025CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art
  5. 2022The Stable Artist: Steering Semantics in Diffusion Latent Space
  6. 2025AttriCtrl: Fine-Grained Control of Aesthetic Attribute Intensity in Diffusion Models
  7. 2024KnobGen: Controlling the Sophistication of Artwork in Sketch-Based Diffusion Models
  8. 2026ImagenWorld: Stress-Testing Image Generation Models with Explainable Human Evaluation on Open-ended Real-World Tasks