mlsanityData to 14 Oct 2026

From Execution to Education: A Bloom-Aligned Framework for Measuring Educational Control in LLMs

arXiv 2607.08009 ↗First posted 9 Jul 2026cs.CL cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce a Bloom-aligned framework for measuring educational control in Large Language Models (LLMs): the ability to preserve a task's instructional intent while shifting its cognitive demand toward specified learning objectives. We apply this framework to programming tasks in computer science education to study the gap between solving tasks and adapting them for learners. Using revised Bloom's Taxonomy as an operational scale of cognitive demand, we evaluate two intervention settings: general difficulty control, where models are asked to make tasks harder or easier, and Bloom's control, where models are asked to target higher or lower Bloom's levels. We evaluate a matched Qwen3-Next model pair, comparing Qwen3-Next-80B-A3B-Instruct with Qwen3-Coder-Next across 2,520 tasks from three benchmarks. The framework reveals a robust directional asymmetry: both models reliably increase cognitive demand, but struggle to lower it. We further characterize these outcomes with semantic-delta clustering and layer-wise Fisher's Discriminant Ratio probing. Within this controlled comparison, the general model shows clearer middle-layer separability for both general difficulty and Bloom-control contrasts, whereas the coder model shows weaker separability for general difficulty and a deeper peak for Bloom-control contrasts. These results show that strong execution performance does not automatically entail Bloom-aligned educational control.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 46 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

28 of 46 references.

References · 28

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2021Program Synthesis with Large Language Modelscited by 3,637
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  6. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  7. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  8. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  9. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  10. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  11. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  12. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
16 more
  1. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
  2. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
  3. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
  4. 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 435
  5. 2023Language Models Represent Space and Timecited by 316
  6. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
  7. 2020Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?cited by 151
  8. 2024The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmerscited by 48
  9. 2024The Effects of Generative AI on Computing Students' Help-Seeking Preferencescited by 23
  10. 2024Exploring the Design Space of Cognitive Engagement Techniques with AI-Generated Code for Enhanced Learningcited by 16
  11. 2025How Do LLMs Use Their Depth?cited by 16
  12. 2025BloomAPR: A Bloom's Taxonomy-based Framework for Assessing the Capabilities of LLM-Powered APR Solutionscited by 5
  13. 2025Neuron-Guided Interpretation of Code LLMs: Where, Why, and How?cited by 5
  14. 2024BloomWise: Enhancing Problem-Solving capabilities of Large Language Models using Bloom's-Taxonomy-Inspired Promptscited by 3
  15. 2025From Recall to Reasoning: Automated Question Generation for Deeper Math Learning through Large Language Modelscited by 3
  16. 2026Mechanistic Interpretability of Cognitive Complexity in LLMs via Linear Probing using Bloom's Taxonomycited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023A Preliminary Study of the Intrinsic Relationship between Complexity and Alignment
  2. 2023Dynamics of Instruction Fine-Tuning for Chinese Large Language Models
  3. 2026Human-in-the-Loop Control of Objective Drift in LLM-Assisted Computer Science Education
  4. 2026Operationalising the Superficial Alignment Hypothesis via Task Complexity
  5. 2025What Makes a Good Curriculum? Disentangling the Effects of Data Ordering on LLM Mathematical Reasoning
  6. 2024Diverse and Fine-Grained Instruction-Following Ability Exploration with Synthetic Data
  7. 2023Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learning
  8. 2024Revisiting the Superficial Alignment Hypothesis