Controlling Logical Collapse in LLMs via Algebraic Ontology Projection over F2
Not on the map. Why?
Abstract (arXiv)
Do large language models internally encode ontological relations in a formally verifiable algebraic structure? We introduce Algebraic Ontology Projection (AOP), which projects LLM hidden states into the Galois Field F2 under Liskov Substitution Principle constraints, using only 42 relational pairs as algebraic keys. AOP achieves up to 93.33% zero-shot inclusion accuracy on unseen concept pairs (Gemma-2 Instruct with optimized prompt), with consistent 86.67% accuracy observed across multiple model families -- with no model tuning, but through prompt alone. This algebraic structure is strongly layer-dependent. We introduce Semantic Crystallisation (SC), a metric that quantifies F2 constraint satisfaction relative to a random baseline and predicts zero-shot accuracy without held-out data. System prompts act as algebraic boundary conditions: only their combination with instruction tuning prevents Late-layer Collapse -- a systematic degradation of logical consistency in the final layers, observed in 7 of 10 conditions. These findings reframe forward computation as an iterative process of algebraic organisation, and open a path toward LLMs whose logical structure is not merely approximated, but formally accessible.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
10 of 17 references.
References · 10
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2024Qwen2 Technical Reportcited by 2,120
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2022Toy Models of Superpositioncited by 971
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2021Causal Abstractions of Neural Networkscited by 422
Built on by
Citing papers per year: 2026: 1.
1 paper.