# Inappropriate Benefits and Identification of ChatGPT Misuse in Programming Tests: A Controlled Experiment

arXiv: https://arxiv.org/abs/2309.16697 · HTML: https://mlsanity.com/paper/2309.16697/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 2 of its 26 references that are in the map.
- First posted on arXiv 11 Aug 2023.

## Builds on (most cited first, 2 of 2)

- [Collaboration Versus Cheating](https://mlsanity.com/paper/1812.00276/) (2018)
- [KeypartX: Graph-based Perception (Text) Representation](https://mlsanity.com/paper/2209.11844/) (2022)

## Built on by (most cited first, 1 of 1)

- [Evaluating the Semantic-to-Geometric Gap in Adversarial Defenses Against Vision-Language Model-Based Plagiarism](https://mlsanity.com/paper/2609.26733/) (2026)

## Abstract (arXiv)

While ChatGPT may help students to learn to program, it can be misused to do plagiarism, a breach of academic integrity. Students can ask ChatGPT to complete a programming task, generating a solution from other people's work without proper acknowledgment of the source(s). To help address this new kind of plagiarism, we performed a controlled experiment measuring the inappropriate benefits of using ChatGPT in terms of completion time and programming performance. We also reported how to manually identify programs aided with ChatGPT (via student behavior while using ChatGPT) and student perspective of ChatGPT (via a survey). Seventeen students participated in the experiment. They were asked to complete two programming tests. They were divided into two groups per the test: one group should complete the test without help while the other group should complete it with ChatGPT. Our study shows that students with ChatGPT complete programming tests two times faster than those without ChatGPT, though their programming performance is comparable. The generated code is highly efficient and uses complex data structures like lists and dictionaries. Based on the survey results, ChatGPT is recommended to be used as an assistant to complete programming tasks and other general assignments. ChatGPT will be beneficial as a reference as other search engines do. Logical and critical thinking are needed to validate the result presented by ChatGPT.