Mechanistic Interpretability of Cognitive Complexity in LLMs via Linear Probing using Bloom's Taxonomy
Not on the map. Why?
Abstract (arXiv)
The black-box nature of Large Language Models necessitates novel evaluation frameworks that transcend surface-level performance metrics. This study investigates the internal neural representations of cognitive complexity using Bloom's Taxonomy as a hierarchical lens. By analyzing high-dimensional activation vectors from different LLMs, we probe whether different cognitive levels, ranging from basic recall (Remember) to abstract synthesis (Create), are linearly separable within the model's residual streams. Our results demonstrate that linear classifiers achieve approximately 95% mean accuracy across all Bloom levels, providing strong evidence that cognitive level is encoded in a linearly accessible subspace of the model's representations. These findings provide evidence that the model resolves the cognitive difficulty of a prompt early in the forward pass, with representations becoming increasingly separable across layers.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 19 Feb 2026.
Builds on
24 of 46 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2019Designing and Interpreting Probes with Control Taskscited by 608
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
- 2024A Practical Review of Mechanistic Interpretability for Transformer-Based Language Modelscited by 113
- 2025A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Modelscited by 73
- 2025Linear Representations of Political Perspective Emerge in Large Language Modelscited by 30
- 2024Towards Uncovering How Large Language Model Works: An Explainability Perspectivecited by 22
12 more
- 2025Towards eliciting latent knowledge from LLMs with mechanistic interpretabilitycited by 19
- 2024How Teachers Can Use Large Language Models and Bloom's Taxonomy to Create Educational Quizzescited by 17
- 2022EduQG: A Multi-format Multiple Choice Dataset for the Educational Domaincited by 11
- 2024Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive Principlescited by 4
- 2025Automated Analysis of Learning Outcomes and Exam Questions Based on Bloom's Taxonomycited by 4
- 2024BloomWise: Enhancing Problem-Solving capabilities of Large Language Models using Bloom's-Taxonomy-Inspired Promptscited by 3
- 2025THiNK: Can Large Language Models Think-aloud?cited by 3
- 2025Mechanistic Interpretability with SAEs: Probing Religion, Violence, and Geography in Large Language Modelscited by 3
- 2025Task complexity shapes internal representations and robustness in neural networkscited by 2
- 2025Analysing Moral Bias in Finetuned LLMs through Mechanistic Interpretabilitycited by 2
- 2025Enhanced Bloom's Educational Taxonomy for Fostering Information Literacy in the Era of Large Language Modelscited by 1
- 2025Beyond Tokens in Language Models: Interpreting Activations through Text Genre Chunkscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.