mlsanityData to 14 Oct 2026

NormBank: A Knowledge Bank of Situational Social Norms

arXiv 2305.17008 ↗First posted 26 May 2023cs.CLcited by 60

Not on the map. Why?

Abstract (arXiv)

We present NormBank, a knowledge bank of 155k situational norms. This resource is designed to ground flexible normative reasoning for interactive, assistive, and collaborative AI systems. Unlike prior commonsense resources, NormBank grounds each inference within a multivalent sociocultural frame, which includes the setting (e.g., restaurant), the agents' contingent roles (waiter, customer), their attributes (age, gender), and other physical, social, and cultural constraints (e.g., the temperature or the country of operation). In total, NormBank contains 63k unique constraints from a taxonomy that we introduce and iteratively refine here. Constraints then apply in different combinations to frame social norms. Under these manipulations, norms are non-monotonic - one can cancel an inference by updating its frame even slightly. Still, we find evidence that neural models can help reliably extend the scope and coverage of NormBank. We further demonstrate the utility of this resource with a series of transfer experiments.

Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). Builds on 34 of its 107 references that are in the map. First posted on arXiv 26 May 2023.

Builds on

34 of 107 references.

References · 34

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  8. 2019Language Models as Knowledge Bases?cited by 1,936
  9. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  10. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  11. 2020Aligning AI With Shared Human Valuescited by 723
  12. 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 439
22 more
  1. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 380
  2. 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 285
  3. 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 255
  4. 2018A Simple Method for Commonsense Reasoningcited by 223
  5. 2019WinoGrande: An Adversarial Winograd Schema Challenge at Scalecited by 204
  6. 2018ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehensioncited by 200
  7. 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 135
  8. 2020Scruples: A Corpus of Community Ethical Judgments on 32,000 Real-Life Anecdotescited by 101
  9. 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
  10. 2022The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systemscited by 93
  11. 2017MovieGraphs: Towards Understanding Human-Centric Situations from Videoscited by 67
  12. 2017Open-World Knowledge Graph Completioncited by 64
  13. 2020Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graphcited by 57
  14. 2015Modeling Relation Paths for Representation Learning of Knowledge Basescited by 56
  15. 2020ProtoQA: A Question Answering Dataset for Prototypical Common-Sense Reasoningcited by 46
  16. 2019Does It Make Sense? And Why? A Pilot Study for Sense Making and Explanationcited by 43
  17. 2021Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Taskscited by 24
  18. 2019How Additional Knowledge can Improve Natural Language Commonsense Question Answering?cited by 22
  19. 2013Connecting Language and Knowledge Bases with Embedding Models for Relation Extractioncited by 21
  20. 2019Embodiment in Socially Interactive Robotscited by 11
  21. 2021Could you give me a hint? Generating inference graphs for defeasible reasoningcited by 10
  22. 2020Generating Commonsense Explanation by Extracting Bridge Concepts from Reasoning Pathscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 5; 2024: 24; 2025: 14; 2026: 17.

60 papers.

Sort:

By area:

  1. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
  2. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
  3. 2024Best Practices and Lessons Learned on Synthetic Datacited by 106
  4. 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
  5. 2024SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agentscited by 93
  6. 2024Massively Multi-Cultural Knowledge Acquisition & LM Benchmarkingcited by 63
  7. 2024CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Promptingcited by 55
  8. 2024Can Unconfident LLM Annotations Be Used for Confident Conclusions?cited by 49
  9. 2024Evaluating Cultural and Social Awareness of LLM Web Agentscited by 45
  10. 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
  11. 2024IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provincescited by 39
  12. 2023EtiCor: Corpus for Analyzing LLMs for Etiquettescited by 33
38 more
  1. 2024CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledgecited by 28
  2. 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
  3. 2023NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violationcited by 24
  4. 2024Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questionscited by 22
  5. 2025Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human Statescited by 19
  6. 2025SOTOPIA-Omega: Dynamic Strategy Injection Learning and Social Instruction Following Evaluation for Social Agentscited by 16
  7. 2025EgoNormia: Benchmarking Physical Social Norm Understandingcited by 13
  8. 2024Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Futurecited by 11
  9. 2024Evaluating Moral Beliefs across LLMs through a Pluralistic Frameworkcited by 11
  10. 2024EgoSocialArena: Benchmarking the Social Intelligence of Large Language Models from a First-person Perspectivecited by 10
  11. 2024ProgressGym: Alignment with a Millennium of Moral Progresscited by 9
  12. 2025Entailed Between the Lines: Incorporating Implication into NLIcited by 9
  13. 2024How Well Do LLMs Identify Cultural Unity in Diversity?cited by 8
  14. 2024Norm Violation Detection in Multi-Agent Systems using Large Language Models: A Pilot Studycited by 6
  15. 2024Language Models as Critical Thinking Tools: A Case Study of Philosopherscited by 6
  16. 2025CAReDiO: Cultural Alignment via Representativeness and Distinctiveness Guided Data Optimizationcited by 6
  17. 2025Communication is All You Need: Persuasion Dataset Construction via Multi-LLM Communicationcited by 5
  18. 2026Using large language models for embodied planning introduces systematic safety riskscited by 5
  19. 2026Positive Alignment: Artificial Intelligence for Human Flourishingcited by 5
  20. 2025Isolating Culture Neurons in Multilingual Large Language Modelscited by 4
  21. 2025VideoNorms: Benchmarking Cultural Awareness of Video Language Modelscited by 4
  22. 2025MINDS: A Cross-cultural Dialogue Corpus for Social Norm Classification and Adherence Detectioncited by 4
  23. 2023STREAM: Social data and knowledge collective intelligence platform for TRaining Ethical AI Modelscited by 3
  24. 2024Social Life Simulation for Non-Cognitive Skills Learningcited by 3
  25. 2025C-VARC: A Large-Scale Chinese Value Rule Corpus for Value Alignment of Large Language Modelscited by 3
  26. 2025EtiCor++: Towards Understanding Etiquettical Bias in LLMscited by 3
  27. 2024LLM-Human Pipeline for Cultural Context Grounding of Conversationscited by 2
  28. 2024Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Playcited by 2
  29. 2025Culture Cartography: Mapping the Landscape of Cultural Knowledgecited by 2
  30. 2026NormAct: Benchmarking Embodied Agents' Proactive Compliance with Unspoken Social Normscited by 2
  31. 2024Examining the Role of Relationship Alignment in Large Language Modelscited by 1
  32. 2024Scalable Frame-based Construction of Sociocultural NormBases for Socially-Aware Dialoguescited by 1
  33. 2025Implicit Values Embedded in How Humans and LLMs Complete Subjective Everyday Taskscited by 1
  34. 2026Interactionless Inverse Reinforcement Learning: A Data-Centric Framework for Durable Alignmentcited by 1
  35. 2026Do Audio Language Models Use Paralinguistic Evidence? Counterfactual Audits for Response Evaluationcited by 1
  36. 2026What Does Activation Steering Control? Attribution Across Answer Encodings and Output-Sensitive Subspacescited by 1
  37. 2023Moral Sparks in Social Media Narrativescited by 0
  38. 2026Understanding Mental States to Guide Social Influence in Multi-Person Group Dialoguecited by 0

50 most cited of 60 All 60 (JSON)