mlsanityData to 14 Oct 2026

Assessment in Team Problem-Solving Exercises in Computing Education

arXiv 2607.19209 ↗First posted 21 Jul 2026cs.CY cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

This full paper in the research-to-practice track presents methods for assessing student teams in tabletop exercises (TTXs). TTXs enable learner teams to prepare for workplace tasks and practice crisis responses, such as resolving cybersecurity incidents. While assessment is essential for determining how well teams achieve learning objectives, the complex, open-ended nature of TTXs often leads to delayed or incomplete feedback. TTX learning platforms can record teams' actions and communication; yet, leveraging these data to assess performance is underexplored. To address this gap, we compared two post-TTX team assessment methods -- clustering and large language models (LLMs) -- using an original dataset from 81 participants across two countries. We evaluated these methods against instructor-assigned scores based on standardized rubrics. Clustering grouped teams that approached TTX tasks similarly, enabling instructors to deliver faster, targeted feedback to teams within a cluster. This method was valid and reliable, with low computational requirements. LLMs used the standardized rubrics to assess teams' communication. While GPT-4o frequently disagreed with instructor scores, GPT-5.2 demonstrated considerably lower error. The researched methods have been integrated into INJECT, an open-source TTX learning platform, to support scalability and teaching practice. To encourage community adoption, we publicly share all datasets, software tools, and a full-fledged TTX scenario.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 63 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

9 of 63 references.

References · 9

  1. 2024Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMscited by 38
  2. 2024Can AI grade your essays? A comparative analysis of large language models and teacher ratings in multidimensional essay scoringcited by 20
  3. 2023Heterogenous Network Analytics of Small Group Teamwork: Using Multimodal Data to Uncover Individual Behavioral Engagement Strategiescited by 3
  4. 2024Research and Practice of Delivering Tabletop Exercisescited by 2
  5. 2024From Paper to Platform: Evolution of a Novel Learning Environment for Tabletop Exercisescited by 2
  6. 2024Self-regulated Learning Processes in Secondary Education: A Network Analysis of Trace-based Measurescited by 2
  7. 2025Comparing Few-Shot Prompting of GPT-4 LLMs with BERT Classifiers for Open-Response Assessment in Tutor Equity Trainingcited by 2
  8. 2023Student Assessment in Cybersecurity Training Automated by Pattern Mining and Clusteringcited by 1
  9. 2024Using LLMs for Tabletop Exercises within the Security Domaincited by 1

Built on by

Not cited yet.