mlsanityData to 14 Oct 2026

DiffCollage: Parallel Generation of Large Content with Diffusion Models

arXiv 2303.17076 ↗First posted 30 Mar 2023cs.CV cs.LGcited by 103

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We present DiffCollage, a compositional diffusion model that can generate large content by leveraging diffusion models trained on generating pieces of the large content. Our approach is based on a factor graph representation where each factor node represents a portion of the content and a variable node represents their overlap. This representation allows us to aggregate intermediate outputs from diffusion models defined on individual nodes to generate content of arbitrary size and shape in parallel without resorting to an autoregressive generation procedure. We apply DiffCollage to various tasks, including infinite image generation, panorama image generation, and long-duration text-guided motion generation. Extensive experimental results with a comparison to strong autoregressive baselines verify the effectiveness of our approach.

Key facts. Cited by 103 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 57 of its 76 references that are in the map. First posted on arXiv 30 Mar 2023.

Builds on

57 of 76 references.

Closest ancestors · 8

Same direction, newest first

  1. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
  2. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
  3. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  7. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  8. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  11. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  12. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
37 more
  1. 2022Video Diffusion Modelscited by 2,305
  2. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  3. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  4. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  5. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  6. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  7. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  8. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  9. 2022Human Motion Diffusion Modelcited by 1,080
  10. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  11. 2022Denoising Diffusion Restoration Modelscited by 963
  12. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
  13. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
  14. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  15. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
  16. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  17. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
  18. 2022Diffusion Models for Adversarial Purificationcited by 476
  19. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 307
  20. 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
  21. 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
  22. 2020Adversarial Generation of Continuous Imagescited by 135
  23. 2022gDDIM: Generalized denoising diffusion implicit modelscited by 125
  24. 2020Image Generators with Conditionally-Independent Pixel Synthesiscited by 106
  25. 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
  26. 2022Any-resolution Training for High-resolution Image Synthesiscited by 72
  27. 2022NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesiscited by 71
  28. 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
  29. 2022Subspace Diffusion Generative Modelscited by 70
  30. 2019COCO-GAN: Generation by Parts via Conditional Coordinatingcited by 67
  31. 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
  32. 2021M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformerscited by 36
  33. 2022Pyramidal Denoising Diffusion Probabilistic Modelscited by 22
  34. 2022Arbitrary-Scale Image Synthesiscited by 20
  35. 2022Vector Quantized Image-to-Image Translationcited by 16
  36. 2020LocoGAN -- Locally Convolutional GANcited by 6
  37. 2020Inference with Aggregate Data: An Optimal Transport Approachcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 15; 2024: 45; 2025: 23; 2026: 20.

103 papers.

Sort:

By area:

  1. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  2. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
  3. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  4. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 110
  5. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 109
  6. 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Modelscited by 98
  7. 2023Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Modelscited by 91
  8. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
  9. 2023Expressive Text-to-Image Generation with Rich Textcited by 89
  10. 2024RandAR: Decoder-only Autoregressive Visual Generation in Random Orderscited by 83
  11. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  12. 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
38 more
  1. 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 58
  2. 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 58
  3. 2023Enhancing Deep Reinforcement Learning: A Tutorial on Generative Diffusion Models in Network Optimizationcited by 56
  4. 2024Symbolic Music Generation with Non-Differentiable Rule Guided Diffusioncited by 54
  5. 2023RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texturecited by 53
  6. 2024SemCity: Semantic Scene Generation with Triplane Diffusioncited by 53
  7. 2025GENMO: A GENeralist Model for Human MOtioncited by 49
  8. 2023Customizing 360-Degree Panoramas through Text-to-Image Diffusion Modelscited by 47
  9. 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 44
  10. 2024Compositional Generative Modeling: A Single Model is Not All You Needcited by 41
  11. 2025Generative Trajectory Stitching through Diffusion Compositioncited by 41
  12. 2024HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objectscited by 36
  13. 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generationcited by 35
  14. 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 31
  15. 2023DiffInfinite: Large Mask-Image Synthesis via Parallel Random Patch Diffusion in Histopathologycited by 29
  16. 2024in2IN: Leveraging individual Information to Generate Human INteractionscited by 29
  17. 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
  18. 2024SyncTweedies: A General Generative Framework Based on Synchronized Diffusionscited by 26
  19. 2024DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenescited by 24
  20. 20253D Scene Generation: A Surveycited by 24
  21. 2025DiT360: High-Fidelity Panoramic Image Generation via Hybrid Trainingcited by 24
  22. 2024Factorized Diffusion: Perceptual Illusions by Noise Decompositioncited by 23
  23. 2024Edify Image: High-Quality Image Generation with Pixel Space Laplacian Diffusion Modelscited by 23
  24. 2024Explorative Inbetweening of Time and Spacecited by 21
  25. 2024Alfie: Democratising RGBA Image Generation With No cited by 20
  26. 2024PanoFree: Tuning-Free Holistic Multi-view Image Generation with Cross-view Self-Guidancecited by 18
  27. 2023Dehazing Ultrasound using Diffusion Modelscited by 17
  28. 2024KMM: Key Frame Mask Mamba for Extended Motion Generationcited by 16
  29. 2023Generative Powers of Tencited by 15
  30. 2025Towards One-step Causal Video Generation via Adversarial Self-Distillationcited by 15
  31. 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
  32. 2025REWIND: Real-Time Egocentric Whole-Body Motion Diffusion with Exemplar-Based Identity Conditioningcited by 14
  33. 2023Curved Diffusion: A Generative Model With Optical Geometry Controlcited by 13
  34. 2024SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Modelcited by 13
  35. 2025MixerMDM: Learnable Composition of Human Motion Diffusion Modelscited by 13
  36. 2024Taming Stable Diffusion for Text to 360deg Panorama Image Generationcited by 12
  37. 2024InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillationcited by 12
  38. 2025Cafe-Talk: Generating 3D Talking Face Animation with Multimodal Coarse- and Fine-grained Controlcited by 12

50 most cited of 103 All 103 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation
  2. 2023Diffusion Cocktail: Mixing Domain-Specific Diffusion Models for Diversified Image Generations
  3. 2026Creative Image Generation with Diffusion Models
  4. 2025Efficient Diffusion Models: A Survey
  5. 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation
  6. 2023Nested Diffusion Processes for Anytime Image Generation
  7. 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusion
  8. 2023DiffBlender: Composable and Versatile Multimodal Text-to-Image Diffusion Models