Extracting Cultural Commonsense Knowledge at Scale
Not on the map. Why?
Abstract (arXiv)
Structured knowledge is important for many AI applications. Commonsense knowledge, which is crucial for robust human-centric AI, is covered by a small number of structured knowledge projects. However, they lack knowledge about human traits and behaviors conditioned on socio-cultural contexts, which is crucial for situative AI. This paper presents CANDLE, an end-to-end methodology for extracting high-quality cultural commonsense knowledge (CCSK) at scale. CANDLE extracts CCSK assertions from a huge web corpus and organizes them into coherent clusters, for 3 domains of subjects (geography, religion, occupation) and several cultural facets (food, drinks, clothing, traditions, rituals, behaviors). CANDLE includes judicious techniques for classification-based filtering and scoring of interestingness. Experimental evaluations show the superiority of the CANDLE CCSK collection over prior works, and an extrinsic use case demonstrates the benefits of CCSK for the GPT-3 language model. Code and data can be accessed at https://candle.mpi-inf.mpg.de/.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). Builds on 31 of its 50 references that are in the map. First posted on arXiv 14 Oct 2022.
Builds on
31 of 50 references.
References · 31
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2020Knowledge Graphscited by 619
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
19 more
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
- 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
- 2021Visually Grounded Reasoning across Languages and Culturescited by 188
- 2020How Context Affects Language Models' Factual Predictionscited by 181
- 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
- 2021Broaden the Vision: Geo-Diverse Visual Commonsense Reasoningcited by 59
- 2020Machine Knowledge: Creation and Curation of Comprehensive Knowledge Basescited by 55
- 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
- 2020GenericsKB: A Knowledge Base of Generic Statementscited by 51
- 2020CSKG: The CommonSense Knowledge Graphcited by 45
- 2022GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Modelscited by 30
- 2020Towards an Atlas of Cultural Commonsense for Machine Reasoningcited by 28
- 2021ASER: Towards Large-scale Commonsense Knowledge Acquisition via Higher-order Selectional Preference over Eventualitiescited by 28
- 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
- 2020Advanced Semantics for Commonsense Knowledge Extractioncited by 24
- 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
- 2022StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypescited by 14
- 2021Materialized Knowledge Bases from Commonsense Transformerscited by 2
Built on by
Citing papers per year: 2023: 5; 2024: 33; 2025: 22; 2026: 16.
76 papers.
Sort:
By area:
- 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 171
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
- 2024Benchmarking Vision Language Models for Cultural Understandingcited by 100
- 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
- 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
- 2023GPT4GEO: How a Language Model Sees the World's Geographycited by 68
- 2024Massively Multi-Cultural Knowledge Acquisition & LM Benchmarkingcited by 63
- 2024CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Promptingcited by 55
- 2024Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsensecited by 50
- 2024CultureLLM: Incorporating Cultural Differences into Large Language Modelscited by 49
- 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 47
38 more
- 2024Evaluating Cultural and Social Awareness of LLM Web Agentscited by 43
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
- 2024IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provincescited by 38
- 2024CaLMQA: Exploring culturally specific long-form question answering across 23 languagescited by 31
- 2024Beyond Aesthetics: Cultural Competence in Text-to-Image Modelscited by 30
- 2024CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledgecited by 28
- 2024CulturalBench: A Robust, Diverse, and Challenging Cultural Benchmark by Human-AI CulturalTeamingcited by 27
- 2024Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Modelscited by 26
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2024CulturePark: Boosting Cross-cultural Understanding in Large Language Modelscited by 24
- 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subculturescited by 23
- 2025Presumed Cultural Identity: How Names Shape LLM Responsescited by 21
- 2024Cultural Commonsense Knowledge for Intercultural Dialoguescited by 20
- 2025Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMscited by 15
- 2025CARE: Multilingual Human Preference Learning for Cultural Awarenesscited by 15
- 2024From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Modelscited by 14
- 2025Beyond Words: Exploring Cultural Value Sensitivity in Multimodal Modelscited by 14
- 2025CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesiscited by 14
- 2023GD-COMET: A Geo-Diverse Commonsense Inference Modelcited by 13
- 2025Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkishcited by 12
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
- 2024SafeWorld: Geo-Diverse Safety Alignmentcited by 10
- 2024The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioningcited by 9
- 2024CIC: A Framework for Culturally-Aware Image Captioningcited by 8
- 2024Attributing Culture-Conditioned Generations to Pretraining Corporacited by 8
- 2025SaudiCulture: A Benchmark for Evaluating Large Language Models Cultural Competence within Saudi Arabiacited by 8
- 2025When Cultures Meet: Multicultural Text-to-Image Generationcited by 7
- 2024Unveiling and Mitigating Bias in Large Language Model Recommendations: A Path to Fairnesscited by 6
- 2024One world, one opinion? The superstar effect in LLM responsescited by 5
- 2025CAReDiO: Cultural Alignment via Representativeness and Distinctiveness Guided Data Optimizationcited by 5
- 2025AI Agent Behavioral Sciencecited by 5
- 2025DIWALI: Diversity and Inclusivity aWare cuLture specific Items for India: Dataset and Assessment of LLMs for Cultural Text Adaptation in Indian Contextcited by 5
- 2025A large-scale evaluation of commonsense knowledge in humans and large language modelscited by 4
- 2025VideoNorms: Benchmarking Cultural Awareness of Video Language Modelscited by 4
- 2026Steering LLMs for Culturally Localized Generationcited by 4
- 2025What are Foundation Models Cooking in the Post-Soviet World?cited by 3
- 2025Evaluation of Cultural Competence of Vision-Language Modelscited by 3
50 most cited of 76 All 76 (JSON)
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026MemeBridge: A Dataset for Benchmarking and Mitigating the Bidirectional Cultural Gap in Meme Interpretation31 Aug 2026
- 2026The "Knowledge-Behavior Gap" in Cultural Taboo Safety of Large Language Models3 Jun 2026
- 2026Why are all LLMs Obsessed with Japanese Culture? On the Hidden Cultural and Regional Biases of LLMs23 Apr 2026
- 2026C-Mining: Unsupervised Discovery of Seeds for Cultural Data Synthesis via Geometric Misalignment17 Apr 2026
- 2026GaelEval: Benchmarking LLM Performance for Scottish Gaelic2 Apr 2026
- 2026Steering LLMs for Culturally Localized Generation24 Mar 2026
- 2026EgoGroups: A Benchmark For Detecting Social Groups of People in the Wild23 Mar 2026
- 2026A Unified Framework to Quantify Cultural Intelligence of AI1 Mar 2026
- 2026MMCOMET: A Large-Scale Multimodal Commonsense Knowledge Graph for Contextual Reasoning1 Mar 2026
- 2026Long-Tail Knowledge in Large Language Models: Taxonomy, Mechanisms, Interventions and Implications18 Feb 2026
- 2026Leveraging Wikidata for Geographically Informed Sociocultural Bias Dataset Creation: Application to Latin America16 Feb 2026
38 more
- 2026Conceptual Cultural Index: A Metric for Cultural Specificity via Relative Generality10 Feb 2026
- 2026LLMs as Cultural Archives: Cultural Commonsense Knowledge Graph Extraction25 Jan 2026
- 2026Common to Whom? Regional Cultural Commonsense and LLM Bias in India22 Jan 2026
- 2026To Generate or Discriminate? Methodological Considerations for Measuring Cultural Alignment in LLMs6 Jan 2026
- 2025Culture Cartography: Mapping the Landscape of Cultural Knowledge31 Oct 2025
- 2025VideoNorms: Benchmarking Cultural Awareness of Video Language Models9 Oct 2025
- 2025Bias Mitigation or Cultural Commonsense? Evaluating LLMs with a Japanese Dataset29 Sep 2025
- 2025DIWALI: Diversity and Inclusivity aWare cuLture specific Items for India: Dataset and Assessment of LLMs for Cultural Text Adaptation in Indian Context22 Sep 2025
- 2025ALIGN: Word Association Learning for Cultural Alignment in Large Language Models19 Aug 2025
- 2025PETLP: A Privacy-by-Design Pipeline for Social Media Data in AI Research12 Aug 2025
- 2025EtiCor++: Towards Understanding Etiquettical Bias in LLMs10 Jun 2025
- 2025AI Agent Behavioral Science4 Jun 2025
- 2025BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluation31 May 2025
- 2025Evaluation of Cultural Competence of Vision-Language Models28 May 2025
- 2025CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesis26 May 2025
- 2025A large-scale evaluation of commonsense knowledge in humans and large language models15 May 2025
- 2025Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkish13 Apr 2025
- 2025CAReDiO: Cultural Alignment via Representativeness and Distinctiveness Guided Data Optimization9 Apr 2025
- 2025CARE: Multilingual Human Preference Learning for Cultural Awareness7 Apr 2025
- 2025SaudiCulture: A Benchmark for Evaluating Large Language Models Cultural Competence within Saudi Arabia21 Mar 2025
- 2025Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMs28 Feb 2025
- 2025What are Foundation Models Cooking in the Post-Soviet World?25 Feb 2025
- 2025When Cultures Meet: Multicultural Text-to-Image Generation21 Feb 2025
- 2025Beyond Words: Exploring Cultural Value Sensitivity in Multimodal Models18 Feb 2025
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLP17 Feb 2025
- 2025Presumed Cultural Identity: How Names Shape LLM Responses17 Feb 2025
- 2024Attributing Culture-Conditioned Generations to Pretraining Corpora30 Dec 2024
- 2024One world, one opinion? The superstar effect in LLM responses13 Dec 2024
- 2024SafeWorld: Geo-Diverse Safety Alignment9 Dec 2024
- 2024The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioning18 Nov 2024
- 2024Culinary Class Wars: Evaluating LLMs using ASH in Cuisine Transfer Task4 Nov 2024
- 2024Evaluating Cultural and Social Awareness of LLM Web Agents30 Oct 2024
- 2024CulturalBench: A Robust, Diverse, and Challenging Cultural Benchmark by Human-AI CulturalTeaming3 Oct 2024
- 2024Robo-CSK-Organizer: Commonsense Knowledge to Organize Detected Objects for Multipurpose Robots27 Sep 2024
- 2024Unveiling and Mitigating Bias in Large Language Model Recommendations: A Path to Fairness17 Sep 2024
- 2024Benchmarking Vision Language Models for Cultural Understanding15 Jul 2024
- 2024Beyond Aesthetics: Cultural Competence in Text-to-Image Models9 Jul 2024
- 2024From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models28 Jun 2024
50 newest of 76 All 76 (JSON)
- 2024Benchmarking Vision Language Models for Cultural Understandingcited by 100
- 2024From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Modelscited by 14
- 2024The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioningcited by 9
- 2024CIC: A Framework for Culturally-Aware Image Captioningcited by 8
- 2025Evaluation of Cultural Competence of Vision-Language Modelscited by 3
- 2025Evaluation of Cultural Competence of Vision-Language Models28 May 2025
- 2024The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioning18 Nov 2024
- 2024Benchmarking Vision Language Models for Cultural Understanding15 Jul 2024
- 2024From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models28 Jun 2024
- 2024CIC: A Framework for Culturally-Aware Image Captioning8 Feb 2024
- 2024IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provincescited by 38
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subculturescited by 23
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans6 Jun 2024
- 2024IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provinces2 Apr 2024
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures23 Feb 2024
- 2024Evaluating Cultural and Social Awareness of LLM Web Agentscited by 43
- 2025AI Agent Behavioral Sciencecited by 5
- 2025AI Agent Behavioral Science4 Jun 2025
- 2024Evaluating Cultural and Social Awareness of LLM Web Agents30 Oct 2024
- 2023GPT4GEO: How a Language Model Sees the World's Geographycited by 68
- 2024SafeWorld: Geo-Diverse Safety Alignmentcited by 10
- 2024SafeWorld: Geo-Diverse Safety Alignment9 Dec 2024
- 2023GPT4GEO: How a Language Model Sees the World's Geography30 May 2023
- 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 171
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
- 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
- 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
- 2024Massively Multi-Cultural Knowledge Acquisition & LM Benchmarkingcited by 63
- 2024CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Promptingcited by 55
- 2024Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsensecited by 50
- 2024CultureLLM: Incorporating Cultural Differences into Large Language Modelscited by 49
- 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 47
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
- 2024CaLMQA: Exploring culturally specific long-form question answering across 23 languagescited by 31
12 most cited of 59 All 59 (JSON)
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026MemeBridge: A Dataset for Benchmarking and Mitigating the Bidirectional Cultural Gap in Meme Interpretation31 Aug 2026
- 2026The "Knowledge-Behavior Gap" in Cultural Taboo Safety of Large Language Models3 Jun 2026
- 2026Why are all LLMs Obsessed with Japanese Culture? On the Hidden Cultural and Regional Biases of LLMs23 Apr 2026
- 2026GaelEval: Benchmarking LLM Performance for Scottish Gaelic2 Apr 2026
- 2026Steering LLMs for Culturally Localized Generation24 Mar 2026
- 2026EgoGroups: A Benchmark For Detecting Social Groups of People in the Wild23 Mar 2026
- 2026A Unified Framework to Quantify Cultural Intelligence of AI1 Mar 2026
- 2026MMCOMET: A Large-Scale Multimodal Commonsense Knowledge Graph for Contextual Reasoning1 Mar 2026
- 2026Long-Tail Knowledge in Large Language Models: Taxonomy, Mechanisms, Interventions and Implications18 Feb 2026
- 2026Leveraging Wikidata for Geographically Informed Sociocultural Bias Dataset Creation: Application to Latin America16 Feb 2026
- 2026Conceptual Cultural Index: A Metric for Cultural Specificity via Relative Generality10 Feb 2026
12 newest of 59 All 59 (JSON)