mlsanityData to 7 Oct 2026

AI for Cultural Heritage Textiles: Fine-Tuned Latent Diffusion for Novel Ulos Motif Synthesis

arXiv 2607.06590 ↗First posted 6 Jul 2026cs.CV cs.LGcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Preserving and revitalising traditional textiles such as Ulos, a cultural heritage of the Batak ethnic group in North Sumatra, Indonesia, requires balancing fidelity to tradition with innovative approaches that meet contemporary design demands. Traditional Ulos weaving faces two key limitations: a narrow range of motifs and a time-intensive design process. This study presents a generative AI framework that fine-tunes two pretrained latent diffusion models: Protogen v3.4 and Stable Diffusion v1.4, on a curated, annotated dataset of high-resolution Ulos motifs to generate culturally consistent yet novel designs. Model performance is evaluated quantitatively using Frechet Inception Distance (FID), Inception Score (IS), and qualitatively through assessments by traditional weavers and members of the public. Protogen v3.4 consistently outperforms Stable Diffusion v1.4, achieving substantially lower FID (~10.5x) and higher IS (2.0x), indicating superior visual fidelity, diversity, and closer alignment with the real Ulos motif distribution. We further examine the effects of strength and guidance scale on generation quality across both models. Lower strength values consistently yield higher fidelity (lower FID), while higher strength values increase generative diversity at the cost of realism, revealing a clear fidelity-diversity tradeoff for both models. Across all tested configurations, a guidance scale of 5-9 provides the most effective balance between fidelity and diversity, stabilising FID, KID, and IS, and is recommended as the operating range for high-quality, diverse Ulos motif generation. These findings demonstrate that carefully fine-tuned generative AI can support the creative renewal of intangible cultural heritage while preserving its stylistic and symbolic integrity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 14 of its 25 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

14 of 25 references.

References · 14

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  5. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  7. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  8. 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
  9. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  10. 2022Image Data Augmentation for Deep Learning: A Surveycited by 96
  11. 2020StyleGAN2 Distillation for Feed-forward Image Manipulationcited by 78
  12. 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Modelscited by 61
2 more
  1. 2023Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Modelscited by 48
  2. 2023Synthesis of Batik Motifs using a Diffusion -- Generative Adversarial Networkcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Multimodal Conditioning of Fine-Tuned Stable Diffusion XL for Controllable and Culturally Faithful Ulos Motif Generation
  2. 2026FabricGen: Microstructure-Aware Woven Fabric Generation
  3. 2025Cross-Cultural Fashion Design via Interactive Large Language Models and Diffusion Models
  4. 2023Textile Pattern Generation Using Diffusion Models
  5. 2024Multimodal Latent Diffusion Model for Complex Sewing Pattern Generation
  6. 2025GarmageNet: A Multimodal Generative Framework for Sewing Pattern Design and Generic Garment Modeling
  7. 2025Diffusion Models Through a Global Lens: Are They Culturally Inclusive?
  8. 2024FashionSD-X: Multimodal Fashion Garment Synthesis using Latent Diffusion