Training-Free Text-to-Image Compositional Food Generation via Prompt Grafting
Not on the map. Why?
Abstract (arXiv)
Real-world meal images often contain multiple food items, making reliable compositional food image generation important for applications such as image-based dietary assessment, where multi-food data augmentation is needed, and recipe visualization. However, modern text-to-image diffusion models struggle to generate accurate multi-food images due to object entanglement, where adjacent foods (e.g., rice and soup) fuse together because many foods do not have clear boundaries. To address this challenge, we introduce Prompt Grafting (PG), a training-free framework that combines explicit spatial cues in text with implicit layout guidance during sampling. PG runs a two-stage process where a layout prompt first establishes distinct regions and the target prompt is grafted once layout formation stabilizes. The framework enables food entanglement control: users can specify which food items should remain separated or be intentionally mixed by editing the arrangement of layouts. Across two food datasets, our method significantly improves the presence of target objects and provides qualitative evidence of controllable separation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 36 references that are in the map. First posted on arXiv 25 Jan 2026.
Builds on
23 of 36 references.
References · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
11 more
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 298
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 169
- 2024Towards Understanding the Working Mechanism of Text-to-Image Diffusion Modelcited by 48
- 2020Visual Aware Hierarchy Based Food Recognitioncited by 38
- 2023Text encoders bottleneck compositionality in contrastive vision-language modelscited by 34
- 2023Long-Tailed Continual Learning For Visual Food Recognitioncited by 20
- 2021An Integrated System for Mobile Image-Based Dietary Assessmentcited by 18
- 2024ChefFusion: Multimodal Foundation Model Integrating Recipe and Food Image Generationcited by 11
- 2023Diffusion Model with Clustering-based Conditioning for Food Image Generationcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023FoodFusion: A Latent Diffusion Model for Realistic Food Image Generation
- 2025CookAnything: A Framework for Flexible and Consistent Multi-Step Recipe Image Generation
- 2024Foodfusion: A Novel Approach for Food Image Composition via Diffusion Models
- 2025CookingDiffusion: Cooking Procedural Image Generation with Stable Diffusion
- 2024Understanding the Limitations of Diffusion Concept Algebra Through Food
- 2025Chain-of-Cooking:Cooking Process Visualization via Bidirectional Chain-of-Thought Guidance
- 2026FoodSense: A Multisensory Food Dataset and Benchmark for Predicting Taste, Smell, Texture, and Sound from Images
- 2023SeeDS: Semantic Separable Diffusion Synthesizer for Zero-shot Food Detection