mlsanityData to 7 Oct 2026

Understanding the Limitations of Diffusion Concept Algebra Through Food

arXiv 2406.03582 ↗First posted 5 Jun 2024cs.CV cs.AIcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Image generation techniques, particularly latent diffusion models, have exploded in popularity in recent years. Many techniques have been developed to manipulate and clarify the semantic concepts these large-scale models learn, offering crucial insights into biases and concept relationships. However, these techniques are often only validated in conventional realms of human or animal faces and artistic style transitions. The food domain offers unique challenges through complex compositions and regional biases, which can shed light on the limitations and opportunities within existing methods. Through the lens of food imagery, we analyze both qualitative and quantitative patterns within a concept traversal technique. We reveal measurable insights into the model's ability to capture and represent the nuances of culinary diversity, while also identifying areas where the model's biases and limitations emerge.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 17 of its 21 references that are in the map. First posted on arXiv 5 Jun 2024.

Builds on

17 of 21 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Get What You Want, Not What You Don't: Image Content Suppression for Text-to-Image Diffusion Models8 Feb
  2. 2023Lego: Learning to Disentangle and Invert Personalized Concepts Beyond Object Appearance in Text-to-Image Diffusion Models23 Nov
  3. 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models20 Nov
  4. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment15 Jun
  5. 2023The Hidden Language of Diffusion Models1 Jun
  6. 2023Concept Algebra for (Score-Based) Text-Controlled Generative Models7 Feb
  7. 2022Compositional Visual Generation with Composable Diffusion Models3 Jun

Other references · 10

  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  2. 2023Erasing Concepts from Diffusion Modelscited by 530
  3. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  4. 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 312
  5. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  6. 2023Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Modelscited by 60
  7. 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 46
  8. 2023Unsupervised Discovery of Semantic Latent Directions in Diffusion Modelscited by 28
  9. 2023Parts of Speech-Grounded Subspaces in Vision-Language Modelscited by 9
  10. 2024Closed-Loop Unsupervised Representation Disentanglement with β-VAE Distillation and Diffusion Probabilistic Feedbackcited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023FoodFusion: A Latent Diffusion Model for Realistic Food Image Generation
  2. 2026Training-Free Text-to-Image Compositional Food Generation via Prompt Grafting
  3. 2025Chain-of-Cooking:Cooking Process Visualization via Bidirectional Chain-of-Thought Guidance
  4. 2024Foodfusion: A Novel Approach for Food Image Composition via Diffusion Models
  5. 2025CookAnything: A Framework for Flexible and Consistent Multi-Step Recipe Image Generation
  6. 2026FoodSense: A Multisensory Food Dataset and Benchmark for Predicting Taste, Smell, Texture, and Sound from Images
  7. 2026CulturalMenuBench: Probing the Knowledge-Application Gap in Multimodal Culinary Reasoning
  8. 2026ReGraph: Learning to Generate Recipe Graphs from Food Images