From Domain Understanding to Design Readiness: a playbook for GenAI-supported learning in Software Engineering
Not on the map. Why?
Abstract (arXiv)
Software engineering courses often require rapid upskilling in supporting knowledge areas such as domain understanding and modeling methods. We report an experience from a two-week milestone in a master's course where 29 students used a customized ChatGPT (GPT-3.5) tutor grounded in a curated course knowledge base to learn cryptocurrency-finance basics and Domain-Driven Design (DDD). We logged all interactions and evaluated a 34.5% random sample of prompt-answer pairs (60/~174) with a five-dimension rubric (accuracy, relevance, pedagogical value, cognitive load, supportiveness), and we collected pre/post self-efficacy. Responses were consistently accurate and relevant in this setting: accuracy averaged 98.9% with no factual errors and only 2/60 minor inaccuracies, and relevance averaged 92.2%. Pedagogical value was high (89.4%) with generally appropriate cognitive load (82.78%), but supportiveness was low (37.78%). Students reported large pre-post self-efficacy gains for genAI-assisted domain learning and DDD application. From these observations we distill seventeen concrete teaching practices spanning prompt/configuration and course/workflow design (e.g., setting expected granularity, constraining verbosity, curating guardrail examples, adding small credit with a simple quality rubric). Within this single-course context, results suggest that genAI-supported learning can complement instruction in domain understanding and modeling tasks, while leaving room to improve tone and follow-up structure.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 28 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
6 of 28 references.
References · 6
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2024Empowering Personalized Learning through a Conversation-based Tutoring System with Student Modelingcited by 34
- 2024Desirable Characteristics for AI Teaching Assistants in Programming Educationcited by 17
- 2024AI-Tutoring in Software Engineering Educationcited by 11
- 2018Are Computer Science and Engineering Graduates Ready for the Software Industry? Experiences from an Industrial Student Training Programcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Learning to Code with Context: A Study-Based Approach
- 2026The Rise of AI-Native Software Engineering: Implications for Practice, Education, and the Future Workforce
- 2026Prompt Coach: An Empirical Evaluation of an Agentic Tutor for Learning Prompt Engineering in Software Development
- 2025Essence Coach: A Bot for Software Practice Adoption ↗
- 2026SYNAPSE: A Multi-LLM Orchestrated AI Tutor for Secure Software Development Education with Neurodivergent-First Design ↗
- 2026PRAXIS: Graph-Grounded Tacit Knowledge for Domain Code Generation
- 2026Generative AI Expands the Intellectual Reach of Course Based Undergraduate Research Experiences (CUREs)
- 2026Shift-Up: A Framework for Software Engineering Guardrails in AI-native Software Development -- Initial Findings