mlsanityData to 14 Oct 2026

A Scaffolded GenAI Lab in Early Undergraduate CS: A Mixed-Methods, Multi-Course Evaluation

arXiv 2505.00100 ↗First posted 30 Apr 2025cs.CY cs.AI cs.ETcited by 0

Not on the map. Why?

Abstract (arXiv)

Background and Context. Generative AI (GenAI) tools are increasingly used in programming courses, but we have limited evidence about how brief instruction can foster responsible, learning-oriented use. Objectives. We evaluate "AI-Lab", a scaffolded GenAI literacy intervention, asking how students' self-reported GenAI usage and their openness and comfort using GenAI for conceptual, debugging, and homework tasks change after participation. Methods. Across two semesters in three CS courses and one first-year engineering course at a U.S. university, we deployed the "AI-Lab" (pre-lab orientation, in-class critique of GenAI outputs, and a required homework reflection), collecting paired pre/post surveys (Perception N=831; Usage N=826) and six post-intervention focus groups; primary inferential analyses used the three CS courses (N=778 and 773, respectively). We analyzed survey shifts with paired non-parametric tests and focus groups via thematic analysis. Findings. Openness increased for conceptual questions and homework help, and comfort increased for conceptual, debugging, and homework scenarios; self-reported frequency of GenAI use for homework and projects remained stable, while self-reported use for debugging increased. Focus group participants described adopting more iterative prompting strategies, becoming more skeptical of correctness, and articulating clearer boundaries around integrity and dependence. Implications. A short, structured intervention can shift students' reported comfort with and willingness to use GenAI and influence the strategies they describe for engaging with it without increasing overall self-reported use on graded work. These results motivate future work triangulating surveys with behavioral traces and learning measures.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 32 references that are in the map. First posted on arXiv 30 Apr 2025.

Builds on

7 of 32 references.

References · 7

  1. 2022GitHub Copilot AI pair programmer: Asset or Liability?cited by 152
  2. 2022Programming Is Hard -- Or at Least It Used to Be: Educational Opportunities And Challenges of AI Code Generationcited by 99
  3. 2024CS1-LLM: Integrating LLMs into CS1 Instructioncited by 16
  4. 2024Evaluating Contextually Personalized Programming Exercises Created with Generative AIcited by 13
  5. 2023Generative AI Assistants in Software Development Education: A vision for integrating Generative AI into educational practice, not instinctively defending against itcited by 5
  6. 2024Early Adoption of Generative Artificial Intelligence in Computing Education: Emergent Student Use Cases and Perspectives in 2023cited by 5
  7. 2025AI Literacy in K-12 and Higher Education in the Wake of Generative AI: An Integrative Reviewcited by 4

Built on by

Not cited yet.