Where Norms and References Collide: Evaluating LLMs on Normative Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Embodied agents, such as robots, will need to interact in situated environments where successful communication often depends on reasoning over social norms: shared expectations that constrain what actions are appropriate in context. A key capability in such settings is norm-based reference resolution (NBRR), where interpreting referential expressions requires inferring implicit normative expectations grounded in physical and social context. Yet it remains unclear whether Large Language Models (LLMs) can support this kind of reasoning. In this work, we introduce SNIC (Situated Norms in Context), a human-validated diagnostic testbed designed to probe how well state-of-the-art LLMs can extract and utilize normative principles relevant to NBRR. SNIC emphasizes physically grounded norms that arise in everyday tasks such as cleaning, tidying, and serving. Across a range of controlled evaluations, we find that even the strongest LLMs struggle to consistently identify and apply social norms, particularly when norms are implicit, underspecified, or in conflict. These findings reveal a blind spot in current LLMs and highlight a key challenge for deploying language-based systems in socially situated, embodied settings.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 14 of its 32 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
14 of 32 references.
Closest ancestors · 1
Same direction, newest first
Other references · 13
- 2023GPT-4 Technical Reportcited by 18,132
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2024Phi-4 Technical Reportcited by 675
- 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
- 2024AI Agents That Mattercited by 199
- 2024Granite Code Models: A Family of Open Foundation Models for Code Intelligencecited by 116
- 2023ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Modelscited by 63
- 2019SocialIQA: Commonsense Reasoning about Social Interactionscited by 33
- 2024LLMs for Robotic Object Disambiguationcited by 4
1 more
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Who Owns That? Evaluating Ownership Intuitions in Large Language Models30 Sep 2026
- 2026Naturalistic measure of social norms alignment22 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026NormAct: Benchmarking Embodied Agents' Proactive Compliance with Unspoken Social Norms
- 2026Social Norm Reasoning in Multimodal Language Models: An Evaluation
- 2024Harnessing the power of LLMs for normative reasoning in MASs
- 2024Norm Violation Detection in Multi-Agent Systems using Large Language Models: A Pilot Study
- 2026Reading the Room: Foundations, Design, and Challenges of Normative Competence in LLMs
- 2026Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models
- 2024Are Large Language Models Aligned with People's Social Intuitions for Human-Robot Interactions?
- 2025Normative Reasoning in Large Language Models: A Comparative Benchmark from Logical and Modal Perspectives