mlsanityData to 7 Oct 2026

LSReGen: Large-Scale Regional Generator via Backward Guidance Framework

arXiv 2407.15066 ↗First posted 21 Jul 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In recent years, advancements in AIGC (Artificial Intelligence Generated Content) technology have significantly enhanced the capabilities of large text-to-image models. Despite these improvements, controllable image generation remains a challenge. Current methods, such as training, forward guidance, and backward guidance, have notable limitations. The first two approaches either demand substantial computational resources or produce subpar results. The third approach depends on phenomena specific to certain model architectures, complicating its application to large-scale image generation.To address these issues, we propose a novel controllable generation framework that offers a generalized interpretation of backward guidance without relying on specific assumptions. Leveraging this framework, we introduce LSReGen, a large-scale layout-to-image method designed to generate high-quality, layout-compliant images. Experimental results show that LSReGen outperforms existing methods in the large-scale layout-to-image task, underscoring the effectiveness of our proposed framework. Our code and models will be open-sourced.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 49 references that are in the map. First posted on arXiv 21 Jul 2024.

Builds on

42 of 49 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,276
30 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  5. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  7. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  8. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  9. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  10. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  11. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  12. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  13. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  14. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  15. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
  16. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  17. 2023Zero-shot Image-to-Image Translationcited by 503
  18. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  19. 2022Blended Latent Diffusioncited by 430
  20. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
  21. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
  22. 2023FreeU: Free Lunch in Diffusion U-Netcited by 195
  23. 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
  24. 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
  25. 2023Dense Text-to-Image Generation with Attention Modulationcited by 162
  26. 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
  27. 2023Zero-shot spatial layout conditioning for text-to-image diffusion modelscited by 64
  28. 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Modelscited by 54
  29. 2021GiT: Graph Interactive Transformer for Vehicle Re-identificationcited by 49
  30. 2020Exploring Spatial Significance via Hybrid Pyramidal Graph Network for Vehicle Re-identificationcited by 37

Built on by

Not cited yet.