mlsanityData to 14 Oct 2026

From Domain Understanding to Design Readiness: a playbook for GenAI-supported learning in Software Engineering

arXiv 2604.00120 ↗First posted 31 Mar 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Software engineering courses often require rapid upskilling in supporting knowledge areas such as domain understanding and modeling methods. We report an experience from a two-week milestone in a master's course where 29 students used a customized ChatGPT (GPT-3.5) tutor grounded in a curated course knowledge base to learn cryptocurrency-finance basics and Domain-Driven Design (DDD). We logged all interactions and evaluated a 34.5% random sample of prompt-answer pairs (60/~174) with a five-dimension rubric (accuracy, relevance, pedagogical value, cognitive load, supportiveness), and we collected pre/post self-efficacy. Responses were consistently accurate and relevant in this setting: accuracy averaged 98.9% with no factual errors and only 2/60 minor inaccuracies, and relevance averaged 92.2%. Pedagogical value was high (89.4%) with generally appropriate cognitive load (82.78%), but supportiveness was low (37.78%). Students reported large pre-post self-efficacy gains for genAI-assisted domain learning and DDD application. From these observations we distill seventeen concrete teaching practices spanning prompt/configuration and course/workflow design (e.g., setting expected granularity, constraining verbosity, curating guardrail examples, adding small credit with a simple quality rubric). Within this single-course context, results suggest that genAI-supported learning can complement instruction in domain understanding and modeling tasks, while leaving room to improve tone and follow-up structure.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 28 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

6 of 28 references.

References · 6

  1. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  2. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  3. 2024Empowering Personalized Learning through a Conversation-based Tutoring System with Student Modelingcited by 34
  4. 2024Desirable Characteristics for AI Teaching Assistants in Programming Educationcited by 17
  5. 2024AI-Tutoring in Software Engineering Educationcited by 11
  6. 2018Are Computer Science and Engineering Graduates Ready for the Software Industry? Experiences from an Industrial Student Training Programcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Learning to Code with Context: A Study-Based Approach
  2. 2026The Rise of AI-Native Software Engineering: Implications for Practice, Education, and the Future Workforce
  3. 2026Prompt Coach: An Empirical Evaluation of an Agentic Tutor for Learning Prompt Engineering in Software Development
  4. 2025Essence Coach: A Bot for Software Practice Adoption ↗
  5. 2026SYNAPSE: A Multi-LLM Orchestrated AI Tutor for Secure Software Development Education with Neurodivergent-First Design ↗
  6. 2026PRAXIS: Graph-Grounded Tacit Knowledge for Domain Code Generation
  7. 2026Generative AI Expands the Intellectual Reach of Course Based Undergraduate Research Experiences (CUREs)
  8. 2026Shift-Up: A Framework for Software Engineering Guardrails in AI-native Software Development -- Initial Findings