Human-like Category Learning by Injecting Ecological Priors from Large Language Models into Neural Networks
Not on the map. Why?
Abstract (arXiv)
Ecological rationality refers to the notion that humans are rational agents adapted to their environment. However, testing this theory remains challenging due to two reasons: the difficulty in defining what tasks are ecologically valid and building rational models for these tasks. In this work, we demonstrate that large language models can generate cognitive tasks, specifically category learning tasks, that match the statistics of real-world tasks, thereby addressing the first challenge. We tackle the second challenge by deriving rational agents adapted to these tasks using the framework of meta-learning, leading to a class of models called ecologically rational meta-learned inference (ERMI). ERMI quantitatively explains human data better than seven other cognitive models in two different experiments. It additionally matches human behavior on a qualitative level: (1) it finds the same tasks difficult that humans find difficult, (2) it becomes more reliant on an exemplar-based strategy for assigning categories with learning, and (3) it generalizes to unseen stimuli in a human-like way. Furthermore, we show that ERMI's ecologically valid priors allow it to achieve state-of-the-art performance on the OpenML-CC18 classification benchmark.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 26 of its 76 references that are in the map. First posted on arXiv 2 Feb 2024.
Builds on
26 of 76 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
- 2023Textbooks Are All You Needcited by 569
- 2016Learning to reinforcement learncited by 377
- 2021Transformers Can Do Bayesian Inferencecited by 360
- 2022Data Distributional Properties Drive Emergent In-Context Learning in Transformerscited by 309
- 2023Improving Text Embeddings with Large Language Modelscited by 303
14 more
- 2022Language Models are Realistic Tabular Data Generatorscited by 294
- 2023When Do Neural Nets Outperform Boosted Trees on Tabular Data?cited by 223
- 2021Generating Datasets with Pretrained Language Modelscited by 193
- 2017OpenML Benchmarking Suitescited by 178
- 2023Orca 2: Teaching Small Language Models How to Reasoncited by 159
- 2023Evaluating and Mitigating Discrimination in Language Model Decisionscited by 124
- 2019Meta-learning of Sequential Strategiescited by 70
- 2023Meta-in-context learning in large language modelscited by 59
- 2019Cognitive Model Priors for Predicting Human Decisionscited by 25
- 2023Bayes in the age of intelligent machinescited by 22
- 2022Using Natural Language and Program Abstractions to Instill Human Inductive Biases in Machinescited by 20
- 2022Modeling Human Exploration Through Resource-Rational Reinforcement Learningcited by 13
- 2017Cognition and Realitycited by 1
- 2023Building artificial neural circuits for domain-general cognition: a primer on brain-inspired systems-level architecturecited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Generating Computational Cognitive Models using Large Language Modelscited by 14
- 2025A Review of Incorporating Psychological Theories in LLMscited by 6
- 2025Meta-learning ecological priors from large language models explains human learning and decision makingcited by 4
- 2026Meta-learning as a principle for human-like visual representationscited by 0
- 2026More accurate behavioral predictions with hybrid Bayesian-connectionist modelscited by 0
- 2026More accurate behavioral predictions with hybrid Bayesian-connectionist models23 Aug 2026
- 2026Meta-learning as a principle for human-like visual representations24 Jun 2026
- 2025Meta-learning ecological priors from large language models explains human learning and decision making28 Aug 2025
- 2025A Review of Incorporating Psychological Theories in LLMs28 Mar 2025
- 2025Generating Computational Cognitive Models using Large Language Models2 Feb 2025