# Not Yet AlphaFold for the Mind: Evaluating Centaur as a Synthetic Participant

arXiv: https://arxiv.org/abs/2508.07887 · HTML: https://mlsanity.com/paper/2508.07887/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 1 of its 15 references that are in the map.
- First posted on arXiv 11 Aug 2025.

## Builds on (most cited first, 1 of 1)

- [Automating the Practice of Science -- Opportunities, Challenges, and Implications](https://mlsanity.com/paper/2409.05890/) (2024)

## Built on by (most cited first, 5 of 5)

- [Closing the Loop to Discover Psychological Theories with an Automated Cognitive Scientist](https://mlsanity.com/paper/2606.26448/) (2026)
- [From Prediction to Understanding: Will AI Foundation Models Transform Brain Science?](https://mlsanity.com/paper/2509.17280/) (2025)
- [Small Foundation Models of Human Cognition and Behaviour](https://mlsanity.com/paper/2608.05224/) (2026)
- [Architecture-Sensitive Supervised Fine-Tuning for Screen-Conditioned Action Prediction: A PiSAR Benchmark](https://mlsanity.com/paper/2605.29400/) (2026)
- [Sparks of In Silico Cognitive Science: Theories from Simulated Data Can Generalize to Humans](https://mlsanity.com/paper/2609.08003/) (2026)

## Abstract (arXiv)

Simulators have revolutionized scientific practice across the natural sciences. By generating data that reliably approximate real-world phenomena, they enable scientists to accelerate hypothesis testing and optimize experimental designs. This is perhaps best illustrated by AlphaFold, a Nobel-prize winning simulator in chemistry that predicts protein structures from amino acid sequences, enabling rapid prototyping of molecular interactions, drug targets, and protein functions. In the behavioral sciences, a reliable participant simulator - a system capable of producing human-like behavior across cognitive tasks - would represent a similarly transformative advance. Recently, Binz et al. introduced Centaur, a large language model (LLM) fine-tuned on human data from 160 experiments, proposing its use not only as a model of cognition but also as a participant simulator for "in silico prototyping of experimental studies", e.g., to advance automated cognitive science. Here, we review the core criteria for a participant simulator and assess how well Centaur meets them. Although Centaur demonstrates strong predictive accuracy, its generative behavior - a critical criterion for a participant simulator - systematically diverges from human data. This suggests that, while Centaur is a significant step toward predicting human behavior, it does not yet meet the standards of a reliable participant simulator or an accurate model of cognition.
