Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generation
Not on the map. Why?
Abstract (arXiv)
Artist-grounded image generation requires more than appending an artist name to a prompt. Image models often respond to artist names through canonical shortcuts, such as recurring motifs, generic palettes, or overrepresented period signatures, rather than preserving the user's intended scene. We introduce Atelier, a shortcut-aware control-state planning framework for artist-grounded image generation. Atelier translates underspecified artistic intent into an explicit control state that separates scene anchors, preserve/transform decisions, style-regime hypotheses, role-bound artist evidence, and shortcut-avoidance constraints. It grounds this state using artist-level knowledge and local patch references, compiles backend-aware generation plans, and iteratively refines candidates through global and local authenticity feedback. We further introduce ArtIntentBench, a benchmark covering Van Gogh and Qi Baishi across artwork re-rendering, period/style-controlled generation, historically unseen subjects, shortcut auditing, and human preference evaluation. Across open-weight and closed-source generators, Atelier improves artist-level style fidelity, preserves source structure more faithfully, and substantially reduces shortcut substitution compared with prompt-engineered, retrieval-augmented, and general-purpose agent baselines. These results suggest that artist-grounded generation is bottlenecked not only by image synthesis, but by the upstream inference of explicit, evidence-grounded artistic controls.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 42 of its 100 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
42 of 100 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,502
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,915
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,339
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,484
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,156
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,294
- 2025Qwen3-VL Technical Reportcited by 2,663
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,604
30 more
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,421
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,240
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,005
- 2020Shortcut Learning in Deep Neural Networkscited by 1,944
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,453
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,342
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,180
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,163
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,104
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,028
- 2025Qwen-Image Technical Reportcited by 1,002
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 919
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 327
- 2023Tool Learning with Foundation Modelscited by 302
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 237
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 227
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
- 2025HunyuanImage 3.0 Technical Reportcited by 144
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
- 2025LongCat-Image Technical Reportcited by 95
- 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 61
- 2024ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficultycited by 60
- 2024GalleryGPT: Analyzing Paintings with Large Multimodal Modelscited by 28
- 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 23
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 17
- 2024Have Large Vision-Language Models Mastered Art History?cited by 9
- 2024Towards Artwork Explanation in Large-scale Vision Language Modelscited by 8
- 2025Preventing Shortcuts in Adapter Training via Providing the Shortcutscited by 4
- 2024IntroStyle: Training-Free Introspective Style Attribution using Diffusion Featurescited by 3
- 2026Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Stylecited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026The Silent Brush: Evaluating Artistic Style Leakage in AI Art Generation
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Models
- 2026Through Van Gogh's Eyes: Global Style Transfer with Diffusion Model
- 2025CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art
- 2022The Stable Artist: Steering Semantics in Diffusion Latent Space
- 2025AttriCtrl: Fine-Grained Control of Aesthetic Attribute Intensity in Diffusion Models
- 2024KnobGen: Controlling the Sophistication of Artwork in Sketch-Based Diffusion Models
- 2026ImagenWorld: Stress-Testing Image Generation Models with Explainable Human Evaluation on Open-ended Real-World Tasks