ArtMine: Discovering and Formalizing Artistic Processes
Not on the map. Why?
Abstract (arXiv)
Understanding how artworks are created requires reasoning about the iterative decisions, material operations, and contextual influences that shape artistic production. While recent generative AI systems can synthesize artworks with high fidelity, they primarily model distributions over finished artifacts rather than the creative processes underlying their creation. In practice, artistic workflows are only partially documented through fragmented sources such as archival records, preparatory studies, correspondence, etc., making process-level understanding difficult to formalize computationally. In this work, we introduce ArtMine, a framework for discovering and formalizing artistic processes from heterogeneous historical evidence. Our approach synthesizes heterogeneous artwork evidence into a structured repository, from which a Peircean abductive agent infers evidence-grounded production steps. These steps are converted into a compositional graph and rendering prompt, then optimized through self-reflection over deviations between the generated and reference artworks. We provide a preliminary proof-of-concept case study using open-domain historical sources across multiple artists and artistic movements, demonstrating that fragmented documentary evidence can support coherent, interpretable, and auditable representations of artistic workflows. By modeling creative processes rather than only final artifacts, our work moves toward process-centred human-AI co-creativity systems that can support artistic interpretation, creative education, reflective collaboration, and computational studies of cultural production.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 82 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
37 of 82 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
25 more
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2020Jukebox: A Generative Model for Musiccited by 535
- 2022Large Language Models are Better Reasoners with Self-Verificationcited by 304
- 2019Abductive Commonsense Reasoningcited by 300
- 2022Reasoning with Language Model Prompting: A Surveycited by 251
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
- 2019Seeing What a GAN Cannot Generatecited by 148
- 2018Training Millions of Personalized Dialogue Agentscited by 126
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 93
- 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 72
- 2013Recognizing Image Stylecited by 64
- 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 64
- 2023BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biologycited by 42
- 2018The Shape of Art History in the Eyes of the Machinecited by 33
- 2024FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Modelscited by 21
- 2024Have Large Vision-Language Models Mastered Art History?cited by 9
- 2026Escher-Loop: Mutual Evolution by Closed-Loop Self-Referential Optimizationcited by 6
- 2020Explaining AI as an Exploratory Process: The Peircean Abduction Modelcited by 5
- 2021Discerning the painter's hand: machine learning on surface topographycited by 5
- 2024Style-based Clustering of Visual Artworks and the Play of Neural Style-Representationscited by 3
- 2026Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Stylecited by 3
- 2026On the Explainability of Vision-Language Models in Art Historycited by 2
- 2026Polaris: A G"odel Agent Framework for Small Language Models through Experience-Abstracted Policy Repaircited by 2
Built on by
Not cited yet.