Falsehood and Impossibility Are Different Directions in an AI's Representation of Language
Not on the map. Why?
Abstract (arXiv)
Language can describe states of affairs that are false and states of affairs that could not be the case at all. Whether an AI model internally distinguishes these failures remains unclear. I report an exploratory activation study of the multimodal open-weight model Gemma 3 4B IT using 85 prompts from 17 philosophical families and a topic-matched modality set of 15 topics, each expressed as a truth, contingent falsehood, improbable claim, semantic anomaly, and necessary falsehood. In its answers, the model conflates contingent falsehood with contradiction, labeling 12 of 15 false statements "contradiction." Its activations show a different pattern. A linear truth probe separates impossible from true statements (AUC 0.93) but not impossible from false statements (AUC 0.20). An impossibility probe evaluated on held-out topic families separates necessary from contingent falsehood at AUC 1.00, peaking at layer 15 with balanced accuracy 0.97 (Bonferroni-adjusted P=0.018). The truth and impossibility directions are close to orthogonal, whereas the impossibility direction partially overlaps a semantic anomaly direction while remaining distinguishable from it. Sparse autoencoder features at the same layer repeat this geometry. Features selective for impossibility also fire on anomalous sentences but rarely on contingent falsehoods. In this model's activation space, necessary falsehoods are not extreme cases of contingent falsehood but lie closer to the experimentally defined category of semantic anomaly. This representational proximity does not imply that impossible statements are intrinsically meaningless. These correlational observations from one small model offer an empirical footnote to an old philosophical distinction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 16 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
12 of 16 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2025Gemma 3 Technical Reportcited by 1,686
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2022Toy Models of Superpositioncited by 928
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2019Designing and Interpreting Probes with Control Taskscited by 608
- 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
- 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 105
- 2023AI model GPT-3 (dis)informs us better than humanscited by 75
- 2026Do Sparse Autoencoders Identify Reasoning Features in Language Models?cited by 11
- 2026Linear Probes Detect Task Format, Not Reasoning Mode in Language Model Hidden Statescited by 7
Built on by
Not cited yet.