mlsanityData to 14 Oct 2026

Learning to Taste: A Multimodal Wine Dataset

arXiv 2308.16900 ↗First posted 31 Aug 2023cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

We present WineSensed, a large multimodal wine dataset for studying the relations between visual perception, language, and flavor. The dataset encompasses 897k images of wine labels and 824k reviews of wines curated from the Vivino platform. It has over 350k unique bottlings, annotated with year, region, rating, alcohol percentage, price, and grape composition. We obtained fine-grained flavor annotations on a subset by conducting a wine-tasting experiment with 256 participants who were asked to rank wines based on their similarity in flavor, resulting in more than 5k pairwise flavor distances. We propose a low-dimensional concept embedding algorithm that combines human experience with automatic machine similarity kernels. We demonstrate that this shared concept embedding space improves upon separate embedding spaces for coarse flavor classification (alcohol percentage, country, grape, price, rating) and aligns with the intricate human perception of flavor.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 29 of its 95 references that are in the map. First posted on arXiv 31 Aug 2023.

Builds on

29 of 95 references.

References · 29

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  8. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  9. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  10. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  11. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  12. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
17 more
  1. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  2. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  3. 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 605
  4. 2017Look, Listen and Learncited by 458
  5. 2023MusicLM: Generating Music From Textcited by 448
  6. 2020VirTex: Learning Visual Representations from Textual Annotationscited by 339
  7. 2023Multimodal Deep Learningcited by 258
  8. 2015Learning Visual Features from Large Weakly Supervised Datacited by 165
  9. 2015Visually Indicated Soundscited by 128
  10. 2022Touch and Go: Learning from Human-Collected Vision and Touchcited by 87
  11. 2022Mix and Localize: Localizing Sound Sources in Mixturescited by 54
  12. 2020ISIA Food-500: A Dataset for Large-Scale Food Recognition via Stacked Global-Local Attention Networkcited by 47
  13. 2023Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotationcited by 18
  14. 2021Strumming to the Beat: Audio-Conditioned Contrastive Video Texturescited by 14
  15. 2015Learning Concept Embeddings with Combined Human-Machine Expertisecited by 6
  16. 2022Searching for Structure in Unfalsifiable Claimscited by 4
  17. 2022MealRec: A Meal Recommendation Datasetcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 4.

6 papers.

  1. 2024Binding Touch to Everything: Learning Unified Multimodal Tactile Representationscited by 95
  2. 2025New York Smells: A Large Multimodal Dataset for Olfactioncited by 3
  3. 2026SommBench: Assessing Sommelier Expertise of Language Modelscited by 0
  4. 2026What Images Cannot Say: Language-Guided Olfactory Representation Learningcited by 0
  5. 2026Sense it with your eyes: Sensation Generation and Understanding for Advertisementscited by 0
  6. 2026When Does Geometric View Synthesis Help Wine Label Retrieval? A Public One-Shot Benchmark Across Self-Supervised and Vision-Language Backbonescited by 0