AnthroScore: A Computational Linguistic Measure of Anthropomorphism
Not on the map. Why?
Abstract (arXiv)
Anthropomorphism, or the attribution of human-like characteristics to non-human entities, has shaped conversations about the impacts and possibilities of technology. We present AnthroScore, an automatic metric of implicit anthropomorphism in language. We use a masked language model to quantify how non-human entities are implicitly framed as human by the surrounding context. We show that AnthroScore corresponds with human judgments of anthropomorphism and dimensions of anthropomorphism described in social science literature. Motivated by concerns of misleading anthropomorphism in computer science discourse, we use AnthroScore to analyze 15 years of research papers and downstream news articles. In research papers, we find that anthropomorphism has steadily increased over time, and that papers related to language models have the most anthropomorphism. Within ACL papers, temporal increases in anthropomorphism are correlated with key neural advancements. Building upon concerns of scientific misinformation in mass media, we identify higher levels of anthropomorphism in news headlines compared to the research papers they cite. Since AnthroScore is lexicon-free, it can be directly applied to a wide range of text sources.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 25 of its 130 references that are in the map. First posted on arXiv 3 Feb 2024.
Builds on
25 of 130 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2018Deep contextualized word representationscited by 2,285
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
- 2019Measuring Bias in Contextualized Word Representationscited by 275
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
- 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 204
- 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
- 2021Alignment of Language Agentscited by 167
13 more
- 2019Show Your Work: Improved Reporting of Experimental Resultscited by 164
- 2019On the Use of ArXiv as a Datasetcited by 101
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
- 2022Human-AI Collaboration Enables More Empathic Conversations in Text-based Peer-to-Peer Mental Health Supportcited by 68
- 2023Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Taskscited by 51
- 2021Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLPcited by 47
- 2016Long-Term Trends in the Public Perception of Artificial Intelligencecited by 22
- 2021AI Ethics Statements -- Analysis and lessons learnt from NeurIPS Broader Impact Statementscited by 16
- 2023The ACL OCL Corpus: Advancing Open Science in Computational Linguisticscited by 16
- 2022Modeling Information Change in Science Communication with Semantically Matched Paraphrasescited by 14
- 2022Robots-Dont-Cry: Understanding Falsely Anthropomorphic Utterances in Dialog Systemscited by 8
- 2019Message Distortion in Information Cascadescited by 3
- 2022Information Retention in the Multi-platform Sharing of Sciencecited by 1
Built on by
Citing papers per year: 2024: 7; 2025: 11; 2026: 9.
27 papers.
Sort:
By area:
- 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 136
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
- 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 49
- 2025Understanding Aha Moments: from External Observations to Internal Mechanismscited by 48
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
- 2024Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliancecited by 15
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Surveycited by 15
- 2025The AI Gap: How Socioeconomic Status Affects Language Technology Interactionscited by 15
- 2025Thinking beyond the anthropomorphic paradigm benefits LLM researchcited by 13
- 2025HumT DumT: Measuring and controlling human-like language in LLMscited by 11
- 2025Dehumanizing Machines: Mitigating Anthropomorphic Behaviors in Text Generation Systemscited by 11
- 2025From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphorscited by 9
15 more
- 2025Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Moralitycited by 9
- 2024"I Am the One and Only, Your Cyber BFF": Understanding the Impact of GenAI Requires Understanding the Impact of Anthropomorphic AIcited by 7
- 2025Humanlike AI Design Increases Anthropomorphism but Yields Divergent Outcomes on Engagement and Trust Globallycited by 6
- 2026SWAY: A Counterfactual Computational Linguistic Approach to Measuring and Mitigating Sycophancycited by 6
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependencecited by 5
- 2024How ChatGPT Changed the Media's Narratives on AI: A Semi-Automated Narrative Analysis Through Frame Semanticscited by 4
- 2026Identity, Cooperation and Framing Effects within Groups of Real and Simulated Humanscited by 4
- 2024From Pixels to Personas: Investigating and Modeling Self-Anthropomorphism in Human-Robot Dialoguescited by 3
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Modelscited by 3
- 2026F-Actor: Controllable Conversational Behaviour in Full-Duplex Modelscited by 2
- 2026RealityTest: How People Probe AI Identity and Whether Models Disclose Itcited by 1
- 2026Breaking the Illusion of Identity in LLM Toolingcited by 0
- 2026What do Reward Models Memorize?cited by 0
- 2026Six misconceptions about large language models: A minimal model and diagnostic taxonomycited by 0
- 2026Expectation, Backlash, Recovery, and Excitement: How Model Releases Shape Reddit Perceptions of Conversational AI Systemscited by 0
- 2026Expectation, Backlash, Recovery, and Excitement: How Model Releases Shape Reddit Perceptions of Conversational AI Systems25 Aug 2026
- 2026Six misconceptions about large language models: A minimal model and diagnostic taxonomy19 Aug 2026
- 2026What do Reward Models Memorize?27 Jul 2026
- 2026RealityTest: How People Probe AI Identity and Whether Models Disclose It29 May 2026
- 2026Breaking the Illusion of Identity in LLM Tooling8 Apr 2026
- 2026SWAY: A Counterfactual Computational Linguistic Approach to Measuring and Mitigating Sycophancy2 Apr 2026
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Models27 Jan 2026
- 2026Identity, Cooperation and Framing Effects within Groups of Real and Simulated Humans22 Jan 2026
- 2026F-Actor: Controllable Conversational Behaviour in Full-Duplex Models16 Jan 2026
- 2025Humanlike AI Design Increases Anthropomorphism but Yields Divergent Outcomes on Engagement and Trust Globally19 Dec 2025
- 2025Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Morality13 Oct 2025
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence1 Oct 2025
15 more
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMs20 May 2025
- 2025The AI Gap: How Socioeconomic Status Affects Language Technology Interactions17 May 2025
- 2025Understanding Aha Moments: from External Observations to Internal Mechanisms3 Apr 2025
- 2025Dehumanizing Machines: Mitigating Anthropomorphic Behaviors in Text Generation Systems19 Feb 2025
- 2025HumT DumT: Measuring and controlling human-like language in LLMs18 Feb 2025
- 2025Thinking beyond the anthropomorphic paradigm benefits LLM research13 Feb 2025
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models10 Feb 2025
- 2025From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphors29 Jan 2025
- 2024"I Am the One and Only, Your Cyber BFF": Understanding the Impact of GenAI Requires Understanding the Impact of Anthropomorphic AI11 Oct 2024
- 2024From Pixels to Personas: Investigating and Modeling Self-Anthropomorphism in Human-Robot Dialogues4 Oct 2024
- 2024How ChatGPT Changed the Media's Narratives on AI: A Semi-Automated Narrative Analysis Through Frame Semantics12 Aug 2024
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Survey11 Jul 2024
- 2024Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance10 Jul 2024
- 2024Virtual Personas for Language Models via an Anthology of Backstories9 Jul 2024
- 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models24 Apr 2024
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
- 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 49
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
- 2024Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliancecited by 15
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Surveycited by 15
- 2025The AI Gap: How Socioeconomic Status Affects Language Technology Interactionscited by 15
- 2025HumT DumT: Measuring and controlling human-like language in LLMscited by 11
- 2025Dehumanizing Machines: Mitigating Anthropomorphic Behaviors in Text Generation Systemscited by 11
- 2025From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphorscited by 9
- 2025Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Moralitycited by 9
- 2024"I Am the One and Only, Your Cyber BFF": Understanding the Impact of GenAI Requires Understanding the Impact of Anthropomorphic AIcited by 7
- 2025Humanlike AI Design Increases Anthropomorphism but Yields Divergent Outcomes on Engagement and Trust Globallycited by 6
12 most cited of 23 All 23 (JSON)
- 2026Expectation, Backlash, Recovery, and Excitement: How Model Releases Shape Reddit Perceptions of Conversational AI Systems25 Aug 2026
- 2026Six misconceptions about large language models: A minimal model and diagnostic taxonomy19 Aug 2026
- 2026RealityTest: How People Probe AI Identity and Whether Models Disclose It29 May 2026
- 2026Breaking the Illusion of Identity in LLM Tooling8 Apr 2026
- 2026SWAY: A Counterfactual Computational Linguistic Approach to Measuring and Mitigating Sycophancy2 Apr 2026
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Models27 Jan 2026
- 2026Identity, Cooperation and Framing Effects within Groups of Real and Simulated Humans22 Jan 2026
- 2026F-Actor: Controllable Conversational Behaviour in Full-Duplex Models16 Jan 2026
- 2025Humanlike AI Design Increases Anthropomorphism but Yields Divergent Outcomes on Engagement and Trust Globally19 Dec 2025
- 2025Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Morality13 Oct 2025
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence1 Oct 2025
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMs20 May 2025
12 newest of 23 All 23 (JSON)