CookAnything: A Framework for Flexible and Consistent Multi-Step Recipe Image Generation
Not on the map. Why?
Abstract (arXiv)
Cooking is a sequential and visually grounded activity, where each step such as chopping, mixing, or frying carries both procedural logic and visual semantics. While recent diffusion models have shown strong capabilities in text-to-image generation, they struggle to handle structured multi-step scenarios like recipe illustration. Additionally, current recipe illustration methods are unable to adjust to the natural variability in recipe length, generating a fixed number of images regardless of the actual instructions structure. To address these limitations, we present CookAnything, a flexible and consistent diffusion-based framework that generates coherent, semantically distinct image sequences from textual cooking instructions of arbitrary length. The framework introduces three key components: (1) Step-wise Regional Control (SRC), which aligns textual steps with corresponding image regions within a single denoising process; (2) Flexible RoPE, a step-aware positional encoding mechanism that enhances both temporal coherence and spatial diversity; and (3) Cross-Step Consistency Control (CSCC), which maintains fine-grained ingredient consistency across steps. Experimental results on recipe illustration benchmarks show that CookAnything performs better than existing methods in training-based and training-free settings. The proposed framework supports scalable, high-quality visual synthesis of complex multi-step instructions and holds significant potential for broad applications in instructional media, and procedural content creation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 44 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
19 of 44 references.
References · 19
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2023Grounded Text-to-Image Synthesis with Attention Refocusingcited by 163
- 2024In-Context LoRA for Diffusion Transformerscited by 155
- 2018Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Imagescited by 118
- 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
- 2022StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuationcited by 74
- 2021Nutrition5k: Towards Automatic Nutritional Understanding of Generic Foodcited by 58
- 2020ISIA Food-500: A Dataset for Large-Scale Food Recognition via Stacked Global-Local Attention Networkcited by 47
- 2021A Large-Scale Benchmark for Food Image Segmentationcited by 45
7 more
- 2021Visual Goal-Step Inference using wikiHowcited by 42
- 2023FoodLMM: A Versatile Food Assistant using Large Multi-modal Modelcited by 32
- 2020Multi-modal Cooking Workflow Construction for Food Recipescited by 15
- 2020CookGAN: Meal Image Synthesis from Ingredientscited by 14
- 2024FoodSky: A Food-oriented Large Language Model that Passes the Chef and Dietetic Examinationcited by 10
- 2024Navigating Weight Prediction with Diet Diarycited by 7
- 2023SeeDS: Semantic Separable Diffusion Synthesizer for Zero-shot Food Detectioncited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025CookingDiffusion: Cooking Procedural Image Generation with Stable Diffusion
- 2026Training-Free Text-to-Image Compositional Food Generation via Prompt Grafting
- 2025Chain-of-Cooking:Cooking Process Visualization via Bidirectional Chain-of-Thought Guidance
- 2023FoodFusion: A Latent Diffusion Model for Realistic Food Image Generation
- 2022Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows
- 2024Retrieval Augmented Recipe Generation
- 2024Foodfusion: A Novel Approach for Food Image Composition via Diffusion Models
- 2024Understanding the Limitations of Diffusion Concept Algebra Through Food