mlsanityData to 14 Oct 2026

Cross-Modal Retrieval in the Cooking Context: Learning Semantic Text-Image Embeddings

arXiv 1804.11146 ↗First posted 30 Apr 2018cs.CL cs.CV cs.IRcited by 35

Not on the map. Why?

Abstract (arXiv)

Designing powerful tools that support cooking activities has rapidly gained popularity due to the massive amounts of available data, as well as recent advances in machine learning that are capable of analyzing them. In this paper, we propose a cross-modal retrieval model aligning visual and textual data (like pictures of dishes and their recipes) in a shared representation space. We describe an effective learning scheme, capable of tackling large-scale problems, and validate it on the Recipe1M dataset containing nearly 1 million picture-recipe pairs. We show the effectiveness of our approach regarding previous state-of-the-art models and present qualitative results over computational cooking use cases.

Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 12; 2022: 13; 2023: 7; 2024: 0; 2025: 2; 2026: 1.

35 papers.

Sort:

By area:

  1. 2022MTEB: Massive Text Embedding Benchmarkcited by 640
  2. 2021Large Scale Visual Food Recognitioncited by 75
  3. 2022Multi-Modal Knowledge Graph Construction and Application: A Surveycited by 74
  4. 2021Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers and Self-supervised Learningcited by 28
  5. 2021Robust and Decomposable Average Precision for Image Retrievalcited by 19
  6. 2021Learning Structural Representations for Recipe Generation and Food Retrievalcited by 17
  7. 2022Learning Program Representations for Food Images and Cooking Recipescited by 16
  8. 2022Recipe2Vec: Multi-modal Recipe Representation Learning with Graph Neural Networkscited by 12
  9. 2021Transferring Knowledge from Text to Video: Zero-Shot Anticipation for Procedural Actionscited by 10
  10. 2023Optimization of Rank Losses for Image Retrievalcited by 10
  11. 2023Learnable Pillar-based Re-ranking for Image-Text Retrievalcited by 9
  12. 2021Learning Text-Image Joint Embedding for Efficient Cross-Modal Retrieval with Deep Feature Engineeringcited by 8
23 more
  1. 2021CHEF: Cross-modal Hierarchical Embeddings for Food Domain Retrievalcited by 7
  2. 2021Egocentric Image Captioning for Privacy-Preserved Passive Dietary Intake Monitoringcited by 7
  3. 2021Learning TFIDF Enhanced Joint Embedding for Recipe-Image Cross-Modal Retrieval Servicecited by 6
  4. 2022Transformer Decoders with MultiModal Regularization for Cross-Modal Food Retrievalcited by 6
  5. 2022Paired Cross-Modal Data Augmentation for Fine-Grained Image-to-Text Retrievalcited by 5
  6. 2023The Multimodal And Modular Ai Chef: Complex Recipe Generation From Imagerycited by 5
  7. 2021Learning Joint Embedding with Modality Alignments for Cross-Modal Retrieval of Recipes and Food Imagescited by 4
  8. 2022A Comprehensive Empirical Study of Vision-Language Pre-trained Model for Supervised Cross-Modal Retrievalcited by 4
  9. 2022RecipeMind: Guiding Ingredient Choices from Food Pairing to Recipe Completion using Cascaded Set Transformercited by 4
  10. 2022Cross-lingual Adaptation for Recipe Retrieval with Mixupcited by 3
  11. 2022Vision and Structured-Language Pretraining for Cross-Modal Food Retrievalcited by 3
  12. 2023Scene-centric vs. Object-centric Image-Text Cross-modal Retrieval: A Reproducibility Studycited by 3
  13. 2023Cross-Modal Entity Matching for Visually Rich Documentscited by 2
  14. 2022Transformer-based Cross-Modal Recipe Embeddings with Large Batch Trainingcited by 1
  15. 2022Facing the Void: Overcoming Missing Data in Multi-View Imagerycited by 1
  16. 2022QMRNet: Quality Metric Regression for EO Image Quality Assessment and Super-Resolutioncited by 1
  17. 2023MALM: Mask Augmentation based Local Matching for Food-Recipe Retrievalcited by 1
  18. 2025Mitigating Cross-modal Representation Bias for Multicultural Image-to-Recipe Retrievalcited by 1
  19. 2021Efficient Deep Feature Calibration for Cross-Modal Joint Embedding Learningcited by 0
  20. 2021Calorie Aware Automatic Meal Kit Generation from an Imagecited by 0
  21. 2023Predefined domain specific embeddings of food concepts and recipes: A case study on heterogeneous recipe datasetscited by 0
  22. 2025Towards Unbiased Cross-Modal Representation Learning for Food Image-to-Recipe Retrievalcited by 0
  23. 2026SIMMER: Cross-Modal Food Image--Recipe Retrieval via MLLM-Based Embeddingcited by 0