mlsanityData to 7 Oct 2026

TCIG: Two-Stage Controlled Image Generation with Quality Enhancement through Diffusion

arXiv 2403.01212 ↗First posted 2 Mar 2024cs.CVcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

In recent years, significant progress has been made in the development of text-to-image generation models. However, these models still face limitations when it comes to achieving full controllability during the generation process. Often, specific training or the use of limited models is required, and even then, they have certain restrictions. To address these challenges, A two-stage method that effectively combines controllability and high quality in the generation of images is proposed. This approach leverages the expertise of pre-trained models to achieve precise control over the generated images, while also harnessing the power of diffusion models to achieve state-of-the-art quality. By separating controllability from high quality, This method achieves outstanding results. It is compatible with both latent and image space diffusion models, ensuring versatility and flexibility. Moreover, This approach consistently produces comparable outcomes to the current state-of-the-art methods in the field. Overall, This proposed method represents a significant advancement in text-to-image generation, enabling improved controllability without compromising on the quality of the generated images.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 13 of its 19 references that are in the map. First posted on arXiv 2 Mar 2024.

Builds on

13 of 19 references.

Closest ancestors · 4

Same direction, newest first

  1. 2022SpaText: Spatio-Textual Representation for Controllable Image Generation25 Nov
  2. 2022Diffusion-based Image Translation using Disentangled Style and Content Representation30 Sep
  3. 2022Blended Latent Diffusion6 Jun
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 9

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  6. 2022Diffusion Models in Vision: A Surveycited by 1,008
  7. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  8. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  9. 2022Leveraging Off-the-shelf Diffusion Model for Multi-attribute Fashion Image Manipulationcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Controllable Generation with Text-to-Image Diffusion Models: A Survey
  2. 2026Improving Controllable Generation: Faster Training and Better Performance via x0-Supervision
  3. 2026MixDiffusion: Mixing Diffusion-based Uni-condition Text-to-Image Generation Models for Multi-condition Image Synthesis
  4. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation
  5. 2023Nested Diffusion Processes for Anytime Image Generation
  6. 2026Efficient Text-to-Image Generation: An Adaptive Step Schedule Controller for Diffusion Models
  7. 2024CtrLoRA: An Extensible and Efficient Framework for Controllable Image Generation
  8. 2024ECNet: Effective Controllable Text-to-Image Diffusion Models