Food Image Generation on Multi-Noun Categories
Not on the map. Why?
Abstract (arXiv)
Generating realistic food images for categories with multiple nouns is surprisingly challenging. For instance, the prompt "egg noodle" may result in images that incorrectly contain both eggs and noodles as separate entities. Multi-noun food categories are common in real-world datasets and account for a large portion of entries in benchmarks such as UEC-256. These compound names often cause generative models to misinterpret the semantics, producing unintended ingredients or objects. This is due to insufficient multi-noun category related knowledge in the text encoder and misinterpretation of multi-noun relationships, leading to incorrect spatial layouts. To overcome these challenges, we propose FoCULR (Food Category Understanding and Layout Refinement) which incorporates food domain knowledge and introduces core concepts early in the generation process. Experimental results demonstrate that the integration of these techniques improves image generation performance in the food domain.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 46 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
35 of 46 references.
References · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2024GPT-4o System Cardcited by 4,467
23 more
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 626
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 169
- 2023Text-to-Image Diffusion Models are Zero-Shot Classifierscited by 140
- 2024Towards Understanding the Working Mechanism of Text-to-Image Diffusion Modelcited by 48
- 2020Visual Aware Hierarchy Based Food Recognitioncited by 38
- 2023SUR-adapter: Enhancing Text-to-Image Pre-trained Diffusion Models with Large Language Modelscited by 29
- 2024TextCraftor: Your Text Encoder Can be Image Quality Controllercited by 27
- 2023Long-Tailed Continual Learning For Visual Food Recognitioncited by 20
- 2024ChefFusion: Multimodal Foundation Model Integrating Recipe and Food Image Generationcited by 11
- 2024Object-Attribute Binding in Text-to-Image Generation: Evaluation and Controlcited by 10
- 2024Box It to Bind It: Unified Layout Control and Attribute Binding in T2I Diffusion Modelscited by 9
- 2022Adma-GAN: Attribute-Driven Memory Augmented GANs for Text-to-Image Generationcited by 6
- 2024OVFoodSeg: Elevating Open-Vocabulary Food Image Segmentation via Image-Informed Textual Representationcited by 5
- 2023Diffusion Model with Clustering-based Conditioning for Food Image Generationcited by 4
- 2024ARChef: An iOS-Based Augmented Reality Cooking Assistant Powered by Multimodal Gemini LLMcited by 2
Built on by
Not cited yet.