A Matter of Perspective(s): Contrasting Human and LLM Argumentation in Subjective Decision-Making on Subtle Sexism
Not on the map. Why?
Abstract (arXiv)
In subjective decision-making, where decisions are based on contextual interpretation, Large Language Models (LLMs) can be integrated to present users with additional rationales to consider. The diversity of these rationales is mediated by the ability to consider the perspectives of different social actors. However, it remains unclear whether and how models differ in the distribution of perspectives they provide. We compare the perspectives taken by humans and different LLMs when assessing subtle sexism scenarios. We show that these perspectives can be classified within a finite set (perpetrator, victim, decision-maker), consistently present in argumentations produced by humans and LLMs, but in different distributions and combinations, demonstrating differences and similarities with human responses, and between models. We argue for the need to systematically evaluate LLMs' perspective-taking to identify the most suitable models for a given decision-making task. We discuss the implications for model evaluation.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Feb 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 5; 2026: 4.
9 papers.
- 2025Meaning Is Not A Metric: Using LLMs to make cultural context legible at scalecited by 10
- 2025Diversity-Enhanced Reasoning for Subjective Questionscited by 9
- 2025DICE: A Framework for Dimensional and Contextual Evaluation of Language Modelscited by 3
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotationcited by 2
- 2025Supernova Event Dataset: Interpreting Large Language Models' Personality through Critical Event Analysiscited by 1
- 2026From Fallback to Frontline: When Can LLMs be Superior Annotators of Human Perspectives?cited by 1
- 2025Words to Describe What I'm Feeling: Exploring the Potential of AI Agents for High Subjectivity Decisions in Advance Care Planningcited by 0
- 2026Improving Implicit Hate Speech Detection via a Community-Driven Multi-Agent Frameworkcited by 0
- 2026Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenderscited by 0
- 2026Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenders11 Jul 2026
- 2026From Fallback to Frontline: When Can LLMs be Superior Annotators of Human Perspectives?20 Apr 2026
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotation11 Feb 2026
- 2026Improving Implicit Hate Speech Detection via a Community-Driven Multi-Agent Framework14 Jan 2026
- 2025Words to Describe What I'm Feeling: Exploring the Potential of AI Agents for High Subjectivity Decisions in Advance Care Planning12 Dec 2025
- 2025Diversity-Enhanced Reasoning for Subjective Questions27 Jul 2025
- 2025Supernova Event Dataset: Interpreting Large Language Models' Personality through Critical Event Analysis13 Jun 2025
- 2025Meaning Is Not A Metric: Using LLMs to make cultural context legible at scale23 May 2025
- 2025DICE: A Framework for Dimensional and Contextual Evaluation of Language Models14 Apr 2025