QACP: An Annotated Question Answering Dataset for Assisting Chinese Python Programming Learners
Not on the map. Why?
Abstract (arXiv)
In online learning platforms, particularly in rapidly growing computer programming courses, addressing the thousands of students' learning queries requires considerable human cost. The creation of intelligent assistant large language models (LLMs) tailored for programming education necessitates distinct data support. However, in real application scenarios, the data resources for training such LLMs are relatively scarce. Therefore, to address the data scarcity in intelligent educational systems for programming, this paper proposes a new Chinese question-and-answer dataset for Python learners. To ensure the authenticity and reliability of the sources of the questions, we collected questions from actual student questions and categorized them according to various dimensions such as the type of questions and the type of learners. This annotation principle is designed to enhance the effectiveness and quality of online programming education, providing a solid data foundation for developing the programming teaching assists (TA). Furthermore, we conducted comprehensive evaluations of various LLMs proficient in processing and generating Chinese content, highlighting the potential limitations of general LLMs as intelligent teaching assistants in computer programming courses.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 20 references that are in the map. First posted on arXiv 30 Jan 2024.
Builds on
15 of 20 references.
References · 15
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2023Large Language Modelscited by 774
- 2023Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programmingcited by 87
- 2023Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code Generationcited by 72
- 2023Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Coursescited by 38
- 2023A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Educationcited by 34
- 2023Exploring the Potential of Large Language Models to Generate Formative Programming Feedbackcited by 28
- 2023AI-TA: Towards an Intelligent Question-Answer Teaching Assistant using Open-Source LLMscited by 21
- 2023Retrieval Augmented Generation and Representative Vector Summarization for large unstructured textual data in Medical Educationcited by 10
- 2023Learning from Teaching Assistants to Program with Subgoals: Exploring the Potential for AI Teaching Assistantscited by 7
3 more
- 2023Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?cited by 6
- 2023Unmasking the giant: A comprehensive evaluation of ChatGPT's proficiency in coding algorithms and data structurescited by 3
- 2023External Knowledge Augmented Polyphone Disambiguation Using Large Language Modelcited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.