LSReGen: Large-Scale Regional Generator via Backward Guidance Framework
Not on the map. Why?
Abstract (arXiv)
In recent years, advancements in AIGC (Artificial Intelligence Generated Content) technology have significantly enhanced the capabilities of large text-to-image models. Despite these improvements, controllable image generation remains a challenge. Current methods, such as training, forward guidance, and backward guidance, have notable limitations. The first two approaches either demand substantial computational resources or produce subpar results. The third approach depends on phenomena specific to certain model architectures, complicating its application to large-scale image generation.To address these issues, we propose a novel controllable generation framework that offers a generalized interpretation of backward guidance without relying on specific assumptions. Leveraging this framework, we introduce LSReGen, a large-scale layout-to-image method designed to generate high-quality, layout-compliant images. Experimental results show that LSReGen outperforms existing methods in the large-scale layout-to-image task, underscoring the effectiveness of our proposed framework. Our code and models will be open-sourced.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 49 references that are in the map. First posted on arXiv 21 Jul 2024.
Builds on
42 of 49 references.
References · 42
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
30 more
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2022Blended Latent Diffusioncited by 430
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
- 2023FreeU: Free Lunch in Diffusion U-Netcited by 195
- 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 162
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2023Zero-shot spatial layout conditioning for text-to-image diffusion modelscited by 64
- 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Modelscited by 54
- 2021GiT: Graph Interactive Transformer for Vehicle Re-identificationcited by 49
- 2020Exploring Spatial Significance via Hybrid Pyramidal Graph Network for Vehicle Re-identificationcited by 37
Built on by
Not cited yet.