mlsanityData to 14 Oct 2026

Dolfin: Diffusion Layout Transformers without Autoencoder

arXiv 2310.16305 ↗First posted 25 Oct 2023cs.CV cs.LGcited by 23

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce a novel generative model, Diffusion Layout Transformers without Autoencoder (Dolfin), which significantly improves the modeling capability with reduced complexity compared to existing methods. Dolfin employs a Transformer-based diffusion process to model layout generation. In addition to an efficient bi-directional (non-causal joint) sequence representation, we further propose an autoregressive diffusion model (Dolfin-AR) that is especially adept at capturing rich semantic correlations for the neighboring objects, such as alignment, size, and overlap. When evaluated against standard generative layout benchmarks, Dolfin notably improves performance across various metrics (fid, alignment, overlap, MaxIoU and DocSim scores), enhancing transparency and interoperability in the process. Moreover, Dolfin's applications extend beyond layout generation, making it suitable for modeling geometric structures, such as line segments. Our experiments present both qualitative and quantitative results to demonstrate the advantages of Dolfin.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 32 of its 50 references that are in the map. First posted on arXiv 25 Oct 2023.

Builds on

32 of 50 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  10. 2022Video Diffusion Modelscited by 2,305
  11. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
20 more
  1. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  2. 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
  3. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  4. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
  5. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 143
  6. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
  7. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 123
  8. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  9. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 95
  10. 2021Variational Transformer Networks for Layout Generationcited by 88
  11. 2020House-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generationcited by 87
  12. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  13. 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
  14. 2022HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoisingcited by 73
  15. 2020Learning to Parse Wireframes in Images of Man-Made Environmentscited by 71
  16. 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 70
  17. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  18. 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusioncited by 24
  19. 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformercited by 20
  20. 2017Wasserstein Introspective Neural Networkscited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 8; 2025: 13; 2026: 1.

23 papers.

Sort:

By area:

  1. 2023GenTron: Diffusion Transformers for Image and Video Generationcited by 82
  2. 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformerscited by 37
  3. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  4. 2024The Fine-Grained Complexity of Gradient Computation for Training Large Language Modelscited by 30
  5. 2024Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspectivecited by 24
  6. 2024Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Timecited by 22
  7. 2024Looped ReLU MLPs May Be All You Need as Practical Programmable Computerscited by 19
  8. 2024HSR-Enhanced Sparse Attention Accelerationcited by 19
  9. 2025High-Order Matching for One-Step Shortcut Diffusion Modelscited by 15
  10. 2025X-Dancer: Expressive Music to Human Dance Video Generationcited by 15
  11. 2024Differential Privacy Mechanisms in Neural Tangent Kernel Regressioncited by 14
  12. 2024Provable Differentially Private Computation of the Cross-Attention Mechanismcited by 14
11 more
  1. 2025Force Matching with Relativistic Constraints: A Physics-Inspired Approach to Stable and Efficient Generative Modelingcited by 12
  2. 2025Circuit Complexity Bounds for Visual Autoregressive Modelcited by 10
  3. 2025On Computational Limits of FlowAR Models: Expressivity and Efficiencycited by 10
  4. 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flowscited by 10
  5. 2025T2VTextBench: A Human Evaluation Benchmark for Textual Control in Video Generation Modelscited by 10
  6. 2025OverLayBench: A Benchmark for Layout-to-Image Generation with Dense Overlapscited by 10
  7. 2025Dissecting Submission Limit in Desk-Rejections: A Mathematical Analysis of Fairness in AI Conference Policiescited by 9
  8. 2025Lay-Your-Scene: Natural Scene Layout Generation with Diffusion Transformerscited by 7
  9. 2025HOFAR: High-Order Augmentation of Flow Autoregressive Transformerscited by 4
  10. 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligencecited by 4
  11. 2025Identity-Preserving Text-to-Image Generation via Dual-Level Feature Decoupling and Expert-Guided Fusioncited by 2

Similar, not cited

Close in wording, no citation either way

  1. 2026Benchmarking Layout-Guided Diffusion Models through Unified Semantic-Spatial Evaluation in Closed and Open Settings
  2. 2023LayoutDM: Transformer-based Diffusion Model for Layout Generation
  3. 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models
  4. 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generation
  5. 2024DogLayout: Denoising Diffusion GAN for Discrete and Continuous Layout Generation
  6. 2023DiffPattern: Layout Pattern Generation via Discrete Diffusion
  7. 2023Reason out Your Layout: Evoking the Layout Master from Large Language Models for Text-to-Image Synthesis
  8. 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformer