mlsanityData to 7 Oct 2026

Inverse Cooking: Recipe Generation from Food Images

arXiv 1812.06164 ↗First posted 14 Dec 2018cs.CVcited by 47

Not on the map. Why?

Abstract (arXiv)

People enjoy food photography because they appreciate food. Behind each meal there is a story described in a complex recipe and, unfortunately, by simply looking at a food image we do not have access to its preparation process. Therefore, in this paper we introduce an inverse cooking system that recreates cooking recipes given food images. Our system predicts ingredients as sets by means of a novel architecture, modeling their dependencies without imposing any order, and then generates cooking instructions by attending to both image and its inferred ingredients simultaneously. We extensively evaluate the whole system on the large-scale Recipe1M dataset and show that (1) we improve performance w.r.t. previous baselines for ingredient prediction; (2) we are able to obtain high quality recipes by leveraging both image and ingredients; (3) our system is able to produce more compelling recipes than retrieval-based approaches according to human judgment. We make code and models publicly available.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Dec 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 9; 2022: 12; 2023: 6; 2024: 8; 2025: 9; 2026: 3.

47 papers.

Sort:

By area:

  1. 2021Large Scale Visual Food Recognitioncited by 75
  2. 2021A Large-Scale Benchmark for Food Image Segmentationcited by 45
  3. 2023FoodLMM: A Versatile Food Assistant using Large Multi-modal Modelcited by 32
  4. 2021Explain Me the Painting: Multi-Topic Knowledgeable Art Description Generationcited by 30
  5. 2021Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers and Self-supervised Learningcited by 28
  6. 2022Visual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioningcited by 21
  7. 2023FIRE: Food Image to REcipe generationcited by 18
  8. 2021Learning Structural Representations for Recipe Generation and Food Retrievalcited by 17
  9. 2022Learning Program Representations for Food Images and Cooking Recipescited by 16
  10. 2021SHARE: a System for Hierarchical Assistive Recipe Editingcited by 15
  11. 2024LLaVA-Chef: A Multi-modal Generative Model for Food Recipescited by 14
  12. 2024RoDE: Linear Rectified Mixture of Diverse Experts for Food Large Multi-Modal Modelscited by 11
35 more
  1. 2024ChefFusion: Multimodal Foundation Model Integrating Recipe and Food Image Generationcited by 11
  2. 2021Transferring Knowledge from Text to Video: Zero-Shot Anticipation for Procedural Actionscited by 10
  3. 2023Dietary Assessment with Multimodal ChatGPT: A Systematic Analysiscited by 10
  4. 2024FoodSky: A Food-oriented Large Language Model that Passes the Chef and Dietetic Examinationcited by 10
  5. 2023Learning to Substitute Ingredients in Recipescited by 8
  6. 2021A Comprehensive Survey of Image-Based Food Recognition and Volume Estimation Methods for Dietary Assessmentcited by 7
  7. 2022Plug-and-Play Recipe Generation with Content Planningcited by 5
  8. 2022Ratatouille: A tool for Novel Recipe Generationcited by 4
  9. 2022RecipeMind: Guiding Ingredient Choices from Food Pairing to Recipe Completion using Cascaded Set Transformercited by 4
  10. 2023Non-Sequential Graph Script Induction via Multimedia Groundingcited by 4
  11. 2025CookingDiffusion: Cooking Procedural Image Generation with Stable Diffusioncited by 4
  12. 2024Retrieval Augmented Recipe Generationcited by 3
  13. 2026Enhancing Action and Ingredient Modeling for Semantically Grounded Recipe Generationcited by 3
  14. 2022Food Recipe Recommendation Based on Ingredients Detection Using Deep Learningcited by 2
  15. 2022Assistive Recipe Editing through Critiquingcited by 2
  16. 2022Recipe Generation from Unsegmented Cooking Videoscited by 2
  17. 2022Human in the loop approaches in multi-modal conversational task guidance system developmentcited by 2
  18. 2024Coherent Zero-Shot Visual Instruction Generationcited by 2
  19. 2024FoodMLLM-JP: Leveraging Multimodal Large Language Models for Japanese Recipe Generationcited by 2
  20. 2022A Mobile Food Recognition System for Dietary Assessmentcited by 1
  21. 2022Towards Fine-Dining Recipe Generation with Generative Pre-trained Transformerscited by 1
  22. 2023MALM: Mask Augmentation based Local Matching for Food-Recipe Retrievalcited by 1
  23. 2025Stitch-a-Demo: Video Demonstrations from Multistep Descriptionscited by 1
  24. 2025World Food Atlas Projectcited by 1
  25. 2025Mitigating Cross-modal Representation Bias for Multicultural Image-to-Recipe Retrievalcited by 1
  26. 2021Calorie Aware Automatic Meal Kit Generation from an Imagecited by 0
  27. 2022RecipeSnap -- a lightweight image-to-recipe modelcited by 0
  28. 2024Deep Image-to-Recipe Translationcited by 0
  29. 2025The Digital Sous Chef -- A Comparative Study on Fine-Tuning Language Models for Recipe Generationcited by 0
  30. 2025Evaluating Spatiotemporal Consistency in Automatically Generated Sewing Instructionscited by 0
  31. 2025Building a Macedonian Recipe Dataset: Collection, Parsing, and Comparative Analysiscited by 0
  32. 2025Thought-For-Food: Reasoning Chain Induced Food Visual Question Answeringcited by 0
  33. 2025Towards Unbiased Cross-Modal Representation Learning for Food Image-to-Recipe Retrievalcited by 0
  34. 2026V-Nutri: Dish-Level Nutrition Estimation from Egocentric Cooking Videoscited by 0
  35. 2026ReGraph: Learning to Generate Recipe Graphs from Food Imagescited by 0