We Politely Insist: Your LLM Must Learn the Persian Art of Taarof
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) struggle to navigate culturally specific communication norms, limiting their effectiveness in global contexts. We focus on Persian taarof, a social norm in Iranian interactions, which is a sophisticated system of ritual politeness that emphasizes deference, modesty, and indirectness, yet remains absent from existing cultural benchmarks. We introduce TaarofBench, the first benchmark for evaluating LLM understanding of taarof, comprising 450 role-play scenarios covering 12 common social interaction topics, validated by native speakers. Our evaluation of five frontier LLMs reveals substantial gaps in cultural competence, with accuracy rates 40-48% below native speakers when taarof is culturally appropriate. Performance varies between interaction topics, improves with Persian-language prompts, and exhibits gender-based asymmetries. We also show that responses rated "polite" by standard metrics often violate taarof norms, indicating the limitations of Western politeness frameworks. Through supervised fine-tuning and Direct Preference Optimization, we achieve 21.8% and 42.3% improvement in model alignment with cultural expectations. Our human study with 33 participants (11 native Persian, 11 heritage, and 11 non-Iranian speakers) forms baselines in varying degrees of familiarity with Persian norms. This work lays the foundation for developing diverse and culturally aware LLMs, enabling applications that better navigate complex social interactions.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 11 of its 37 references that are in the map. First posted on arXiv 1 Sep 2025.
Builds on
11 of 37 references.
References · 11
- 2024Investigating Cultural Alignment of Large Language Modelscited by 143
- 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
- 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
- 2024WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Modelscited by 60
- 2024Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsensecited by 51
- 2023EtiCor: Corpus for Analyzing LLMs for Etiquettescited by 33
- 2024CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledgecited by 28
- 2023NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violationcited by 24
- 2025Cultural Learning-Based Culture Adaptation of Language Modelscited by 16
- 2025PerCul: A Story-Driven Cultural Evaluation of LLMs in Persiancited by 8
- 2024Can I introduce my boyfriend to my grandmother? Evaluating Large Language Models Capabilities on Iranian Social Norm Classificationcited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culturecited by 1
- 2026Unmasking the Factual-Conceptual Gap in Persian Language Modelscited by 1
- 2026BanglaSocialBench: A Benchmark for Evaluating Sociopragmatic and Cultural Alignment of LLMs in Bangladeshi Social Interactioncited by 1
- 2026TARAZ: Persian Short-Answer Question Benchmark for Cultural Evaluation of Language Modelscited by 0
- 2026Progressing beyond Art Masterpieces or Touristic Clich'es: how to assess your LLMs for cultural alignment?cited by 0
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems18 Sep 2026
- 2026Progressing beyond Art Masterpieces or Touristic Clich'es: how to assess your LLMs for cultural alignment?28 Apr 2026
- 2026BanglaSocialBench: A Benchmark for Evaluating Sociopragmatic and Cultural Alignment of LLMs in Bangladeshi Social Interaction16 Mar 2026
- 2026TARAZ: Persian Short-Answer Question Benchmark for Cultural Evaluation of Language Models26 Feb 2026
- 2026Unmasking the Factual-Conceptual Gap in Persian Language Models19 Feb 2026
- 2025BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culture5 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Whose Norms? Disentangling Cultural and Personal Alignment in Large Language Models
- 2024Navigating the Cultural Kaleidoscope: A Hitchhiker's Guide to Sensitivity in Large Language Models
- 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Models
- 2026MasalBench: A Benchmark for Contextual and Cross-Cultural Understanding of Persian Proverbs in LLMs
- 2025Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Cultural Intelligence with CQ-Bench
- 2026BenSyc: Benchmarking Conversational Sycophancy and Human Alignment in LLMs for Bengali Contexts
- 2026DiSCo: A Distribution-First Steering and Cultural Prior Evaluation Framework for Measuring Cultural Preference Bias in LLMs
- 2025Randomness, Not Representation: The Unreliability of Evaluating Cultural Alignment in LLMs