Diffusion-based Document Layout Generation
Not on the map. Why?
Abstract (arXiv)
We develop a diffusion-based approach for various document layout sequence generation. Layout sequences specify the contents of a document design in an explicit format. Our novel diffusion-based approach works in the sequence domain rather than the image domain in order to permit more complex and realistic layouts. We also introduce a new metric, Document Earth Mover's Distance (Doc-EMD). By considering similarity between heterogeneous categories document designs, we handle the shortcomings of prior document metrics that only evaluate the same category of layouts. Our empirical analysis shows that our diffusion-based approach is comparable to or outperforming other previous methods for layout generation across various document datasets. Moreover, our metric is capable of differentiating documents better than previous metrics for specific cases.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 38 of its 48 references that are in the map. First posted on arXiv 19 Mar 2023.
Builds on
38 of 48 references.
References · 38
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2017Neural Discrete Representation Learningcited by 4,650
26 more
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2023MusicLM: Generating Music From Textcited by 442
- 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 375
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2015Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networkscited by 214
- 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
- 2023Dreamix: Video Diffusion Models are General Video Editorscited by 189
- 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
- 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 130
- 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 122
- 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
- 2017Long Text Generation via Adversarial Training with Leaked Informationcited by 100
- 2021Variational Transformer Networks for Layout Generationcited by 88
- 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
- 2019READ: Recursive Autoencoders for Document Layout Generationcited by 51
- 2017Maximum-Likelihood Augmented Discrete Generative Adversarial Networkscited by 39
- 2020Variational Transformers for Diverse Response Generationcited by 36
- 2022ObjectStitch: Generative Object Compositingcited by 36
- 2018Image Colorization with Generative Adversarial Networkscited by 24
Built on by
Citing papers per year: 2023: 3; 2024: 11; 2025: 6; 2026: 1.
21 papers.
Sort:
By area:
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
- 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraintscited by 26
- 2024CityCraft: A Real Crafter for 3D City Generationcited by 25
- 2024Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimizationcited by 25
- 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
- 2024Alfie: Democratising RGBA Image Generation With No cited by 20
- 2024Kubrick: Multimodal Agent Collaborations for Synthetic Video Generationcited by 16
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Modelscited by 16
- 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generationcited by 15
- 2024COHO: Context-Sensitive City-Scale Hierarchical Urban Layout Generationcited by 10
9 more
- 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 8
- 2024Refine-by-Align: Reference-Guided Artifacts Refinement through Semantic Alignmentcited by 5
- 2024Latent Diffusion for Guided Document Table Generationcited by 2
- 2025Coeff-Tuning: A Graph Filter Subspace View for Tuning Attention-Based Large Modelscited by 2
- 2025Relation-Rich Visual Document Generator for Visual Information Extractioncited by 2
- 2025AI-Generated Lecture Slides for Improving Slide Element Detection and Retrievalcited by 0
- 2025Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generationcited by 0
- 2026Evaluating Reasoning Fidelity in Visual Text Generationcited by 0
- 2026Evaluating Reasoning Fidelity in Visual Text Generation3 Jun 2026
- 2025Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generation11 Jul 2025
- 2025AI-Generated Lecture Slides for Improving Slide Element Detection and Retrieval30 Jun 2025
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Models26 May 2025
- 2025Relation-Rich Visual Document Generator for Visual Information Extraction14 Apr 2025
- 2025Coeff-Tuning: A Graph Filter Subspace View for Tuning Attention-Based Large Models24 Mar 2025
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models1 Mar 2025
- 2024Refine-by-Align: Reference-Guided Artifacts Refinement through Semantic Alignment30 Nov 2024
- 2024Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimization4 Oct 2024
- 2024Alfie: Democratising RGBA Image Generation With No 27 Aug 2024
- 2024Kubrick: Multimodal Agent Collaborations for Synthetic Video Generation19 Aug 2024
- 2024Latent Diffusion for Guided Document Table Generation19 Aug 2024
9 more
- 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generation17 Jul 2024
- 2024COHO: Context-Sensitive City-Scale Hierarchical Urban Layout Generation16 Jul 2024
- 2024CityCraft: A Real Crafter for 3D City Generation7 Jun 2024
- 2024LayoutFlow: Flow Matching for Layout Generation27 Mar 2024
- 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation15 Mar 2024
- 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints7 Feb 2024
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov 2023
- 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generation19 Jul 2023
- 2023TextDiffuser: Diffusion Models as Text Painters18 May 2023
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraintscited by 26
- 2024Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimizationcited by 25
- 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
- 2024Latent Diffusion for Guided Document Table Generationcited by 2
- 2024Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimization4 Oct 2024
- 2024Latent Diffusion for Guided Document Table Generation19 Aug 2024
- 2024LayoutFlow: Flow Matching for Layout Generation27 Mar 2024
- 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints7 Feb 2024
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov 2023
- 2023TextDiffuser: Diffusion Models as Text Painters18 May 2023
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 8
- 2025Relation-Rich Visual Document Generator for Visual Information Extractioncited by 2
- 2025Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generationcited by 0
- 2025Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generation11 Jul 2025
- 2025Relation-Rich Visual Document Generator for Visual Information Extraction14 Apr 2025
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models1 Mar 2025
- 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
- 2024CityCraft: A Real Crafter for 3D City Generationcited by 25
- 2024Alfie: Democratising RGBA Image Generation With No cited by 20
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Modelscited by 16
- 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generationcited by 15
- 2024COHO: Context-Sensitive City-Scale Hierarchical Urban Layout Generationcited by 10
- 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10
- 2024Refine-by-Align: Reference-Guided Artifacts Refinement through Semantic Alignmentcited by 5
- 2025Coeff-Tuning: A Graph Filter Subspace View for Tuning Attention-Based Large Modelscited by 2
- 2025AI-Generated Lecture Slides for Improving Slide Element Detection and Retrievalcited by 0
- 2026Evaluating Reasoning Fidelity in Visual Text Generationcited by 0
- 2026Evaluating Reasoning Fidelity in Visual Text Generation3 Jun 2026
- 2025AI-Generated Lecture Slides for Improving Slide Element Detection and Retrieval30 Jun 2025
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Models26 May 2025
- 2025Coeff-Tuning: A Graph Filter Subspace View for Tuning Attention-Based Large Models24 Mar 2025
- 2024Refine-by-Align: Reference-Guided Artifacts Refinement through Semantic Alignment30 Nov 2024
- 2024Alfie: Democratising RGBA Image Generation With No 27 Aug 2024
- 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generation17 Jul 2024
- 2024COHO: Context-Sensitive City-Scale Hierarchical Urban Layout Generation16 Jul 2024
- 2024CityCraft: A Real Crafter for 3D City Generation7 Jun 2024
- 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation15 Mar 2024
- 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generation19 Jul 2023