mlsanityData to 7 Oct 2026

DogLayout: Denoising Diffusion GAN for Discrete and Continuous Layout Generation

arXiv 2412.00381 ↗First posted 30 Nov 2024cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Layout Generation aims to synthesize plausible arrangements from given elements. Currently, the predominant methods in layout generation are Generative Adversarial Networks (GANs) and diffusion models, each presenting its own set of challenges. GANs typically struggle with handling discrete data due to their requirement for differentiable generated samples and have historically circumvented the direct generation of discrete labels by treating them as fixed conditions. Conversely, diffusion-based models, despite achieving state-of-the-art performance across several metrics, require extensive sampling steps which lead to significant time costs. To address these limitations, we propose DogLayout (Denoising Diffusion GAN Layout model), which integrates a diffusion process into GANs to enable the generation of discrete label data and significantly reduce diffusion's sampling time. Experiments demonstrate that DogLayout considerably reduces sampling costs by up to 175 times and cuts overlap from 16.43 to 9.59 compared to existing diffusion models, while also surpassing GAN based and other layout methods. Code is available at https://github.com/deadsmither5/DogLayout.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 19 of its 27 references that are in the map. First posted on arXiv 30 Nov 2024.

Builds on

19 of 27 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generation14 Mar
  2. 2023Unifying Layout Generation with a Decoupled Diffusion Model9 Mar

Other references · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  5. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  6. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  7. 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 375
  8. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  9. 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
  10. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  11. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  12. 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
5 more
  1. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  2. 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 67
  3. 2016GANS for Sequences of Discrete Elements with the Gumbel-softmax Distributioncited by 47
  4. 2017Boundary-Seeking Generative Adversarial Networkscited by 27
  5. 2023Semi-Implicit Denoising Diffusion Models (SIDDMs)cited by 14

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023LayoutDM: Transformer-based Diffusion Model for Layout Generation
  2. 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models
  3. 2024Adversarial Supervision Makes Layout-to-Image Diffusion Models Thrive
  4. 2023LayoutDiffuse: Adapting Foundational Diffusion Models for Layout-to-Image Generation
  5. 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer
  6. 2024Training-free Composite Scene Generation for Layout-to-Image Synthesis
  7. 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformer
  8. 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusion