How Humans and LLMs Organize Conceptual Knowledge: Exploring Subordinate Categories in Italian
Not on the map. Why?
Abstract (arXiv)
People can categorize the same entity at multiple taxonomic levels, such as basic (bear), superordinate (animal), and subordinate (grizzly bear). While prior research has focused on basic-level categories, this study is the first attempt to examine the organization of categories by analyzing exemplars produced at the subordinate level. We present a new Italian psycholinguistic dataset of human-generated exemplars for 187 concrete words. We then use these data to evaluate whether textual and vision LLMs produce meaningful exemplars that align with human category organization across three key tasks: exemplar generation, category induction, and typicality judgment. Our findings show a low alignment between humans and LLMs, consistent with previous studies. However, their performance varies notably across different semantic domains. Ultimately, this study highlights both the promises and the constraints of using AI-generated exemplars to support psychological and linguistic research.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 52 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
9 of 52 references.
References · 9
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 195
- 2022Event knowledge in large language models: the gap between the impossible and the unlikelycited by 45
- 2021Do language models learn typicality judgments from text?cited by 32
- 2022Semantic features of object concepts generated with GPT-3cited by 12
- 2022Cognitive Modeling of Semantic Fluency Using Transformerscited by 2
- 2023Exploring Category Structure with Contextual Language Models and Lexical Semantic Networkscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.