Loomis Painter: Reconstructing the Painting Process
Not on the map. Why?
Abstract (arXiv)
Step-by-step painting tutorials are vital for learning artistic techniques, but existing video resources (e.g., YouTube) lack interactivity and personalization. While recent generative models have advanced artistic image synthesis, they struggle to generalize across media and often show temporal or structural inconsistencies, hindering faithful reproduction of human creative workflows. To address this, we propose a unified framework for multi-media painting process generation with a semantics-driven style control mechanism that embeds multiple media into a diffusion models conditional space and uses cross-medium style augmentation. This enables consistent texture evolution and process transfer across styles. A reverse-painting training strategy further ensures smooth, human-aligned generation. We also build a large-scale dataset of real painting processes and evaluate cross-media consistency, temporal coherence, and final-image fidelity, achieving strong results on LPIPS, DINO, and CLIP metrics. Finally, our Perceptual Distance Profile (PDP) curve quantitatively models the creative sequence, i.e., composition, color blocking, and detail refinement, mirroring human artistic progression.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 38 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
30 of 38 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
18 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2025Qwen-Image Technical Reportcited by 1,044
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 38
- 2022Revisiting Image Pyramid Structure for High Resolution Salient Object Detectioncited by 36
- 2020Painting Many Pasts: Synthesizing Time Lapse Videos of Paintingscited by 7
- 2024Inverse Painting: Reconstructing The Painting Processcited by 6
- 2023Interactive Neural Paintingcited by 1
- 2023Collaborative Neural Paintingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2022Inversion-Based Style Transfer with Diffusion Models
- 2025Style Composition within Distinct LoRA modules for Traditional Art
- 2024CreativeSynth: Cross-Art-Attention for Artistic Image Synthesis with Multimodal Diffusion
- 2023Stable Diffusion Reference Only: Image Prompt and Blueprint Jointly Guided Multi-Condition Diffusion Model for Secondary Painting
- 2022Creative Painting with Latent Diffusion Models
- 2026Data-Efficient Brushstroke Generation with Diffusion Models for Oil Painting
- 2025PPJudge: Towards Human-Aligned Assessment of Artistic Painting Process
- 2023Not Only Generative Art: Stable Diffusion for Content-Style Disentanglement in Art Analysis