# Modeling Artistic Workflows for Image Generation and Editing

arXiv: https://arxiv.org/abs/2007.07238 · HTML: https://mlsanity.com/paper/2007.07238/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Jul 2020.

## Built on by (most cited first, 11 of 11)

- [Regularizing Generative Adversarial Networks under Limited Data](https://mlsanity.com/paper/2104.03310/) (2021)
- [Discrete Contrastive Diffusion for Cross-Modal Music and Image Generation](https://mlsanity.com/paper/2206.07771/) (2022)
- [Eliminating Gradient Conflict in Reference-based Line-Art Colorization](https://mlsanity.com/paper/2207.06095/) (2022)
- [Deep Learning Technique for Human Parsing: A Survey and Outlook](https://mlsanity.com/paper/2301.00394/) (2023)
- [dualFace:Two-Stage Drawing Guidance for Freehand Portrait Sketching](https://mlsanity.com/paper/2104.12297/) (2021)
- [Collaborative Neural Rendering using Anime Character Sheets](https://mlsanity.com/paper/2207.05378/) (2022)
- [AniFaceDrawing: Anime Portrait Exploration during Your Sketching](https://mlsanity.com/paper/2306.07476/) (2023)
- [Cartoondiff: Training-free Cartoon Image Generation with Diffusion Transformer Models](https://mlsanity.com/paper/2309.08251/) (2023)
- [Dynamically Masked Discriminator for Generative Adversarial Networks](https://mlsanity.com/paper/2306.07716/) (2023)
- [AccioScene: Compositional 3D Scene Generation via Graph Diffusion and Interaction-driven Critics](https://mlsanity.com/paper/2502.06819/) (2025)
- [Learning to Synthesize Graphics Programs for Geometric Artworks](https://mlsanity.com/paper/2410.15768/) (2024)

## Abstract (arXiv)

People often create art by following an artistic workflow involving multiple stages that inform the overall design. If an artist wishes to modify an earlier decision, significant work may be required to propagate this new decision forward to the final artwork. Motivated by the above observations, we propose a generative model that follows a given artistic workflow, enabling both multi-stage image generation as well as multi-stage image editing of an existing piece of art. Furthermore, for the editing scenario, we introduce an optimization process along with learning-based regularization to ensure the edited image produced by the model closely aligns with the originally provided image. Qualitative and quantitative results on three different artistic datasets demonstrate the effectiveness of the proposed framework on both image generation and editing tasks.
