Rigidity in LLM Bandits with Implications for Human-AI Dyads
Not on the map. Why?
Abstract (arXiv)
We test whether LLMs show robust decision biases. Treating models as participants in two-arm bandits, we ran 20000 trials per condition across four decoding configurations. Under symmetric rewards, models amplified positional order into stubborn one-arm policies. Under asymmetric rewards, they exploited rigidly yet underperformed an oracle and rarely re-checked. The observed patterns were consistent across manipulations of temperature and top-p, with top-k held at the provider default, indicating that the qualitative behaviours are robust to the two decoding knobs typically available to practitioners. Crucially, moving beyond descriptive metrics to computational modelling, a hierarchical Rescorla-Wagner-softmax fit revealed the underlying strategies: low learning rates and very high inverse temperatures, which together explain both noise-to-bias amplification and rigid exploitation. These results position minimal bandits as a tractable probe of LLM decision tendencies and motivate hypotheses about how such biases could shape human-AI interaction.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 6 of its 24 references that are in the map. First posted on arXiv 8 Mar 2026.
Builds on
6 of 24 references.
References · 6
- 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
- 2024The Effect of Sampling Temperature on Problem Solving in Large Language Modelscited by 170
- 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 150
- 2023Recommender AI Agent: Integrating Large Language Models for Interactive Recommendationscited by 131
- 2018Optimizing Opinions with Stubborn Agentscited by 4
- 2025Adversarial Testing in LLMs: Insights into Decision-Making Vulnerabilitiescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.