"Don't Say It!": Constraints, Compliance, and Communication when Language Models Play Taboo
Not on the map. Why?
Abstract (arXiv)
The game of Taboo requires describing a target word without using a set of forbidden words, so that other players can guess it. This deceptively simple task combines strict lexical constraints with the need for communicatively effective descriptions, making it a compelling playground for examining how LLMs navigate competing demands at inference time. We evaluate two open-weight models under conditions that intervene at progressively deeper levels of the generative process, from prompting to generation-time constraints to internal representations manipulations. We assess their outputs through forbidden word violation detection, LLM-as-a-judge measuring the degree to which generated descriptions successfully evoke the target concept for both human and machine guessers, and examining whether the strategies models adopt under constraint align with those of human players. Our results show that compliance with the rules of the game and communicative effectiveness trade off differently across conditions, and that models remain substantially weaker than humans as guessers, suggesting that lexical grounding under constraint is an open challenge for current language models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
13 of 27 references.
References · 13
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
- 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 293
- 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
- 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
- 2023Efficient Guided Generation for Large Language Modelscited by 192
- 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 175
- 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 90
- 2023COLLIE: Systematic Construction of Constrained Text Generation Taskscited by 69
- 2025Towards eliciting latent knowledge from LLMs with mechanistic interpretabilitycited by 19
- 2024Codenames as a Benchmark for Large Language Modelscited by 8
- 2024NYT-Connections: A Deceptively Simple Text Classification Task that Stumps System-1 Thinkerscited by 4
1 more
Built on by
Not cited yet.