mlsanityData to 7 Oct 2026

Falsehood and Impossibility Are Different Directions in an AI's Representation of Language

arXiv 2608.12852 ↗First posted 13 Aug 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Language can describe states of affairs that are false and states of affairs that could not be the case at all. Whether an AI model internally distinguishes these failures remains unclear. I report an exploratory activation study of the multimodal open-weight model Gemma 3 4B IT using 85 prompts from 17 philosophical families and a topic-matched modality set of 15 topics, each expressed as a truth, contingent falsehood, improbable claim, semantic anomaly, and necessary falsehood. In its answers, the model conflates contingent falsehood with contradiction, labeling 12 of 15 false statements "contradiction." Its activations show a different pattern. A linear truth probe separates impossible from true statements (AUC 0.93) but not impossible from false statements (AUC 0.20). An impossibility probe evaluated on held-out topic families separates necessary from contingent falsehood at AUC 1.00, peaking at layer 15 with balanced accuracy 0.97 (Bonferroni-adjusted P=0.018). The truth and impossibility directions are close to orthogonal, whereas the impossibility direction partially overlaps a semantic anomaly direction while remaining distinguishable from it. Sparse autoencoder features at the same layer repeat this geometry. Features selective for impossibility also fire on anomalous sentences but rarely on contingent falsehoods. In this model's activation space, necessary falsehoods are not extreme cases of contingent falsehood but lie closer to the experimentally defined category of semantic anomaly. This representational proximity does not imply that impossible statements are intrinsically meaningless. These correlational observations from one small model offer an empirical footnote to an old philosophical distinction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 16 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

12 of 16 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2025Gemma 3 Technical Reportcited by 1,686
  3. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  4. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  5. 2022Toy Models of Superpositioncited by 928
  6. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  7. 2019Designing and Interpreting Probes with Control Taskscited by 608
  8. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
  9. 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 105
  10. 2023AI model GPT-3 (dis)informs us better than humanscited by 75
  11. 2026Do Sparse Autoencoders Identify Reasoning Features in Language Models?cited by 11
  12. 2026Linear Probes Detect Task Format, Not Reasoning Mode in Language Model Hidden Statescited by 7

Built on by

Not cited yet.