mlsanityData to 7 Oct 2026

Learning Aesthetic Layouts via Visual Guidance

arXiv 2107.06262 ↗First posted 13 Jul 2021cs.CV cs.GR cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

We explore computational approaches for visual guidance to aid in creating aesthetically pleasing art and graphic design. Our work complements and builds on previous work that developed models for how humans look at images. Our approach comprises three steps. First, we collected a dataset of art masterpieces and labeled the visual fixations with state-of-art vision models. Second, we clustered the visual guidance templates of the art masterpieces with unsupervised learning. Third, we developed a pipeline using generative adversarial networks to learn the principles of visual guidance and that can produce aesthetically pleasing layouts. We show that the aesthetic visual guidance principles can be learned and integrated into a high-dimensional model and can be queried by the features of graphic elements. We evaluate our approach by generating layouts on various drawings and graphic designs. Moreover, our model considers the color and structure of graphic elements when generating layouts. Consequently, we believe our tool, which generates multiple aesthetic layout options in seconds, can help artists create beautiful art and graphic designs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 44 references that are in the map. First posted on arXiv 13 Jul 2021.

Builds on

22 of 44 references.

References · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  4. 2013Auto-Encoding Variational Bayescited by 3,980
  5. 2017Improved Training of Wasserstein GANscited by 2,223
  6. 2014Conditional Generative Adversarial Netscited by 2,152
  7. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  8. 2016Least Squares Generative Adversarial Networkscited by 1,000
  9. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  10. 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
  11. 2019Kornia: an Open Source Differentiable Computer Vision Library for PyTorchcited by 231
  12. 2016Richer Convolutional Features for Edge Detectioncited by 141
10 more
  1. 2019Wasserstein Weisfeiler-Lehman Graph Kernelscited by 104
  2. 2017Dual Discriminator Generative Adversarial Netscited by 55
  3. 2016DeepGaze II: Reading fixations from deep features trained on object recognitioncited by 54
  4. 2018GRAINS: Generative Recursive Autoencoders for INdoor Scenescited by 38
  5. 2020Predicting Visual Importance Across Graphic Design Typescited by 30
  6. 2017Learning Visual Importance for Graphic Designs and Data Visualizationscited by 22
  7. 2020LayoutGMN: Neural Graph Matching for Structural Layout Similaritycited by 19
  8. 2020Graph2Plan: Learning Floorplan Generation from Layout Graphscited by 15
  9. 2017Automatic Image Cropping for Visual Aesthetic Enhancement Using Deep Neural Networks and Cascaded Regressioncited by 11
  10. 2020Discovering Pattern Structure Using Differentiable Compositingcited by 11

Built on by

Not cited yet.