mlsanityData to 14 Oct 2026

RankT2I: A Submodular Framework for Discovering Interpretable and Diverse Semantics in Text-to-Image Models

arXiv 2608.14226 ↗First posted 14 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in text-to-image (T2I) models have revolutionized the field of image generation and editing. However, identifying semantics that a T2I model can successfully edit in an image continues to be a challenging task. Most existing approaches require users to manually specify semantics to modify a particular image, a time-consuming process that often involves extensive trial and error. In this paper, we present RankT2I, a novel, training-free, and model-agnostic framework that automates the discovery of editable semantics in diffusion and FLUX-based models. Given a visual domain, we first utilize a multimodal vision-language model to gather a broad set of candidate semantics. We then frame semantic discovery as a set selection problem and use a submodular objective to identify semantics that are relevant, editable, and diverse. Our method helps users efficiently identify a wide range of semantics for text-to-image editing models across several domains while outperforming existing methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 70 of its 86 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

70 of 86 references.

References · 70

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2022Flow Matching for Generative Modelingcited by 5,702
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
38 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  5. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  6. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  7. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  8. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  10. 2025OpenAI GPT-5 System Cardcited by 989
  11. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  12. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  13. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  14. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
  15. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  16. 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 265
  17. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  18. 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Modelcited by 199
  19. 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
  20. 2019Controllable Text-to-Image Generationcited by 187
  21. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  22. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
  23. 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 148
  24. 2023Editing Implicit Assumptions in Text-to-Image Diffusion Modelscited by 130
  25. 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wildcited by 109
  26. 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Modelscited by 99
  27. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
  28. 2023Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Modelscited by 77
  29. 2024Understanding the Limits of Vision Language Models Through the Lens of the Binding Problemcited by 75
  30. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Modelscited by 64
  31. 2023Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Modelscited by 60
  32. 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Modelscited by 54
  33. 2021LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directionscited by 52
  34. 2024Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoningcited by 50
  35. 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 47
  36. 2024Continuous, Subject-Specific Attribute Control in T2I Models by Identifying Semantic Directionscited by 41
  37. 2023ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptationcited by 40
  38. 2024Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidancecited by 34

50 most cited of 70 All 70 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Latent Space Disentanglement in Diffusion Transformers Enables Zero-shot Fine-grained Semantic Editing
  2. 2025EDITS: Enhancing Dataset Distillation with Implicit Textual Semantics
  3. 2024Learn Once, Edit Anywhere: Visual Direction Transfer for Diffusion Models
  4. 2025Instructing Text-to-Image Diffusion Models via Classifier-Guided Semantic Optimization
  5. 2024Pioneering Reliable Assessment in Text-to-Image Knowledge Editing: Leveraging a Fine-Grained Dataset and an Innovative Criterion
  6. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance
  7. 2025TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Rendering
  8. 2023Localizing and Editing Knowledge in Text-to-Image Generative Models