A New Chinese Landscape Paintings Generation Model based on Stable Diffusion using DreamBooth
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
This study mainly introduces a method combining the Stable Diffusion Model (SDM) and Parameter-Efficient Fine-Tuning method for generating Chinese Landscape Paintings. This training process is accelerated by combining LoRA with pre-trained SDM and DreamBooth with pre-trained SDM, respectively. On the Chinese Landscape Paintings Internet dataset used in this paper, this study finds that SDM combined with DreamBooth exhibits superior performance, outperforming other models, including the generic pre-trained SDM and LoRA-based fine-tuning SDM. The SDM combined with DreamBooth achieves a FID of 12.75 on the dataset and outperforms all other models in terms of expert evaluation, highlighting the model's versatility in the field of Chinese Landscape Paintings given the unique identifier, high fidelity and high quality. This study illustrates the potential of specialised fine-tuning method to improve the performance of SDM on domain-specific tasks, particularly in the domain of Landscape Paintings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 9 of its 11 references that are in the map. First posted on arXiv 16 Aug 2024.
Builds on
9 of 11 references.
Closest ancestors · 4
Same direction, newest first
- 2024Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generation12 Mar
- 2023X-IQE: eXplainable Image Quality Evaluation for Text-to-Image Generation with Visual Large Language Models18 May
- 2023CCLAP: Controllable Chinese Landscape Painting Generation via Latent Diffusion Model9 Apr
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
Other references · 5
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Optimizing Prompts for Text-to-Image Generationcited by 204
- 2021LAFITE: Towards Language-Free Training for Text-to-Image Generationcited by 126
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024ConCLVD: Controllable Chinese Landscape Video Generation via Diffusion Model
- 2023Stable Diffusion Reference Only: Image Prompt and Blueprint Jointly Guided Multi-Condition Diffusion Model for Secondary Painting
- 2025DiffuMural: Restoring Dunhuang Murals with Multi-scale Diffusion
- 2024Fine Tuning Text-to-Image Diffusion Models for Correcting Anomalous Images
- 2024JieHua Paintings Style Feature Extracting Model using Stable Diffusion with ControlNet
- 2023A Survey of Diffusion Based Image Generation Models: Issues and Their Solutions
- 2023Diffusion Brush: A Latent Diffusion Model-based Editing Tool for AI-generated Images
- 2023Space Narrative: Generating Images and 3D Scenes of Chinese Garden from Text using Deep Learning