mlsanityData to 7 Oct 2026

"Don't Say It!": Constraints, Compliance, and Communication when Language Models Play Taboo

arXiv 2607.00601 ↗First posted 1 Jul 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The game of Taboo requires describing a target word without using a set of forbidden words, so that other players can guess it. This deceptively simple task combines strict lexical constraints with the need for communicatively effective descriptions, making it a compelling playground for examining how LLMs navigate competing demands at inference time. We evaluate two open-weight models under conditions that intervene at progressively deeper levels of the generative process, from prompting to generation-time constraints to internal representations manipulations. We assess their outputs through forbidden word violation detection, LLM-as-a-judge measuring the degree to which generated descriptions successfully evoke the target concept for both human and machine guessers, and examining whether the strategies models adopt under constraint align with those of human players. Our results show that compliance with the rules of the game and communicative effectiveness trade off differently across conditions, and that models remain substantially weaker than humans as guessers, suggesting that lexical grounding under constraint is an open challenge for current language models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

13 of 27 references.

References · 13

  1. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  2. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
  3. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 293
  4. 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
  5. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
  6. 2023Efficient Guided Generation for Large Language Modelscited by 192
  7. 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 175
  8. 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 90
  9. 2023COLLIE: Systematic Construction of Constrained Text Generation Taskscited by 69
  10. 2025Towards eliciting latent knowledge from LLMs with mechanistic interpretabilitycited by 19
  11. 2024Codenames as a Benchmark for Large Language Modelscited by 8
  12. 2024NYT-Connections: A Deceptively Simple Text Classification Task that Stumps System-1 Thinkerscited by 4
1 more
  1. 2024Non Verbis, Sed Rebus: Large Language Models are Weak Solvers of Italian Rebusescited by 2

Built on by

Not cited yet.