mlsanityData to 14 Oct 2026

Do LLMs Understand Wine Descriptors Across Cultures? A Benchmark for Cultural Adaptations of Wine Reviews

arXiv 2509.12961 ↗First posted 16 Sep 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in large language models (LLMs) have opened the door to culture-aware language tasks. We introduce the novel problem of adapting wine reviews across Chinese and English, which goes beyond literal translation by incorporating regional taste preferences and culture-specific flavor descriptors. In a case study on cross-cultural wine review adaptation, we compile the first parallel corpus of professional reviews, containing 8k Chinese and 16k Anglophone reviews. We benchmark both neural-machine-translation baselines and state-of-the-art LLMs with automatic metrics and human evaluation. For the latter, we propose three culture-oriented criteria -- Cultural Proximity, Cultural Neutrality, and Cultural Genuineness -- to assess how naturally a translated review resonates with target-culture readers. Our analysis shows that current models struggle to capture cultural nuances, especially in translating wine descriptions across different cultures. This highlights the challenges and limitations of translation models in handling cultural content.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 42 references that are in the map. First posted on arXiv 16 Sep 2025.

Builds on

11 of 42 references.

References · 11

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  4. 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
  5. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
  6. 2020Deep Learning for Text Style Transfer: A Surveycited by 162
  7. 2021Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Colorcited by 119
  8. 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
  9. 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
  10. 2024Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledgecited by 29
  11. 2024FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culturecited by 25

Built on by

Not cited yet.