Human-in-the-Loop Control of Objective Drift in LLM-Assisted Computer Science Education
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly embedded in computer science education through AI-assisted programming tools, yet such workflows often exhibit objective drift, in which locally plausible outputs diverge from stated task specifications. Existing instructional responses frequently emphasize tool-specific prompting practices, limiting durability as AI platforms evolve. This paper adopts a human-centered stance, treating human-in-the-loop (HITL) control as a stable educational problem rather than a transitional step toward AI autonomy. Drawing on systems engineering and control-theoretic concepts, we frame objectives and world models as operational artifacts that students configure to stabilize AI-assisted work. We propose a pilot undergraduate CS laboratory curriculum that explicitly separates planning from execution and trains students to specify acceptance criteria and architectural constraints prior to code generation. In selected labs, the curriculum also introduces deliberate, concept-aligned drift to support diagnosis and recovery from specification violations. We report a sensitivity power analysis for a three-arm pilot design comparing unstructured AI use, structured planning, and structured planning with injected drift, establishing detectable effect sizes under realistic section-level constraints. The contribution is a theory-driven, methodologically explicit foundation for HITL pedagogy that renders control competencies teachable across evolving AI tools.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 8 of its 13 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
8 of 13 references.
References · 8
- 2023A Survey on Evaluation of Large Language Modelscited by 1,236
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 498
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
- 2024Do Advanced Language Models Eliminate the Need for Prompt Engineering in Software Engineering?cited by 19
- 2025Prompting Science Report 2: The Decreasing Value of Chain of Thought in Promptingcited by 13
- 2025Beyond Exponential Decay: Rethinking Error Accumulation in Large Language Modelscited by 11
- 2025Prompting Science Report 1: Prompt Engineering is Complicated and Contingentcited by 8
- 2025A Survey of LLM-Based Applications in Programming Education: Balancing Automation and Human Oversightcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Execution to Education: A Bloom-Aligned Framework for Measuring Educational Control in LLMs
- 2026CodeGuard: Improving LLM Guardrails in CS Education
- 2025Coding With AI: From a Reflection on Industrial Practices to Future Computer Science and Software Engineering Education
- 2025Partnering with AI: A Pedagogical Feedback System for LLM Integration into Programming Education
- 2023How to Teach Programming in the AI Era? Using LLMs as a Teachable Agent for Debugging
- 2026Educating future engineers about LLMs: A scalable workshop ↗
- 2024Analyzing LLM Usage in an Advanced Computing Class in India
- 2026Relying on LLMs: Student Practices and Instructor Norms are Changing in Computer Science Education ↗