mlsanityData to 7 Oct 2026

Animate, or Inanimate, That is the Question for Large Language Models

arXiv 2408.06332 ↗First posted 12 Aug 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The cognitive essence of humans is deeply intertwined with the concept of animacy, which plays an essential role in shaping their memory, vision, and multi-layered language understanding. Although animacy appears in language via nuanced constraints on verbs and adjectives, it is also learned and refined through extralinguistic information. Similarly, we assume that the LLMs' limited abilities to understand natural language when processing animacy are motivated by the fact that these models are trained exclusively on text. Hence, the question this paper aims to answer arises: can LLMs, in their digital wisdom, process animacy in a similar way to what humans would do? We then propose a systematic analysis via prompting approaches. In particular, we probe different LLMs by prompting them using animate, inanimate, usual, and stranger contexts. Results reveal that, although LLMs have been trained predominantly on textual data, they exhibit human-like behavior when faced with typical animate and inanimate entities in alignment with earlier studies. Hence, LLMs can adapt to understand unconventional situations by recognizing oddities as animated without needing to interface with unspoken cognitive triggers humans rely on to break down animations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 46 references that are in the map. First posted on arXiv 12 Aug 2024.

Builds on

17 of 46 references.

References · 17

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  4. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 553
  5. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 454
  6. 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 317
  7. 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
  8. 2023Language models are not naysayers: An analysis of language models on negation benchmarkscited by 73
  9. 2023When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviourcited by 61
  10. 2021Structural Persistence in Language Models: Priming as a Window into Abstract Language Representationscited by 44
  11. 2022Event knowledge in large language models: the gap between the impossible and the unlikelycited by 44
  12. 2024Do Language Models Exhibit Human-like Structural Priming Effects?cited by 21
5 more
  1. 2020How well does surprisal explain N400 amplitude under different experimental conditions?cited by 18
  2. 2023When Language Models Fall in Love: Animacy Processing in Transformer Language Modelscited by 12
  3. 2022EvEntS ReaLM: Event Reasoning of Entity States via Language Modelscited by 7
  4. 2023A Psycholinguistic Analysis of BERT's Representations of Compoundscited by 7
  5. 2023Can Peanuts Fall in Love with Distributional Semantics?cited by 6

Built on by

Not cited yet.