mlsanityData to 14 Oct 2026

Learning to Substitute Ingredients in Recipes

arXiv 2302.07960 ↗First posted 15 Feb 2023cs.LG cs.HCcited by 8

Not on the map. Why?

Abstract (arXiv)

Recipe personalization through ingredient substitution has the potential to help people meet their dietary needs and preferences, avoid potential allergens, and ease culinary exploration in everyone's kitchen. To address ingredient substitution, we build a benchmark, composed of a dataset of substitution pairs with standardized splits, evaluation metrics, and baselines. We further introduce Graph-based Ingredient Substitution Module (GISMo), a novel model that leverages the context of a recipe as well as generic ingredient relational information encoded within a graph to rank plausible substitutions. We show through comprehensive experimental validation that GISMo surpasses the best performing baseline by a large margin in terms of mean reciprocal rank. Finally, we highlight the benefits of GISMo by integrating it in an improved image-to-recipe generation pipeline, enabling recipe personalization through user intervention. Quantitative and qualitative results show the efficacy of our proposed system, paving the road towards truly personalized cooking and tasting experiences.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 34 of its 65 references that are in the map. First posted on arXiv 15 Feb 2023.

Builds on

34 of 65 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  7. 2017Inductive Representation Learning on Large Graphscited by 6,320
  8. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  9. 2018How Powerful are Graph Neural Networks?cited by 4,393
  10. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  11. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  12. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
22 more
  1. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
  2. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  3. 2018Hypergraph Neural Networkscited by 488
  4. 2019Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networkscited by 242
  5. 2020Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddingscited by 214
  6. 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
  7. 2018Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Imagescited by 118
  8. 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 110
  9. 2019Enriching Pre-trained Language Model with Entity Information for Relation Classificationcited by 82
  10. 2018Inverse Cooking: Recipe Generation from Food Imagescited by 47
  11. 2017Knowledge Base Completion: Baselines Strike Backcited by 39
  12. 2021Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers and Self-supervised Learningcited by 28
  13. 2020Structure-Aware Generation Network for Recipe Generation from Imagescited by 19
  14. 2021Personalized Food Recommendation as Constrained Question Answering over a Large-scale Food Knowledge Graphcited by 17
  15. 2021The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architecturescited by 16
  16. 2021SHARE: a System for Hierarchical Assistive Recipe Editingcited by 15
  17. 2020CookGAN: Meal Image Synthesis from Ingredientscited by 14
  18. 2019Elucidating image-to-set prediction: An analysis of models, losses and datasetscited by 10
  19. 2018Personalized Classifier for Food Image Recognitioncited by 9
  20. 2018Improved Knowledge Graph Embedding using Background Taxonomic Informationcited by 8
  21. 2016Extracting Food Substitutes From Food Diary via Distributional Similaritycited by 4
  22. 2017A neural network system for transformation of regional cuisine stylecited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 1; 2026: 3.

8 papers.

  1. 2024LLaVA-Chef: A Multi-modal Generative Model for Food Recipescited by 14
  2. 2023Generating Illustrated Instructionscited by 7
  3. 2026GLEN-Bench: A Graph-Language based Benchmark for Nutritional Healthcited by 7
  4. 2024Large Language Models for Ingredient Substitution in Food Recipes using Supervised Fine-tuning and Direct Preference Optimizationcited by 1
  5. 2024Optimizing Ingredient Substitution Using Large Language Models to Enhance Phytochemical Content in Recipescited by 0
  6. 2025"Stop replacing salt with sugar!'': Towards Intuitive Human-Agent Teachingcited by 0
  7. 2026Fuzzy Categorical Planning: Autonomous Goal Satisfaction with Graded Semantic Constraintscited by 0
  8. 2026FlavourBench: Executable Culinary Reward Maps for Language Model Evaluation and Post-Trainingcited by 0