The Rise of Artificial Intelligence in Educational Measurement: Opportunities and Ethical Challenges
Not on the map. Why?
Abstract (arXiv)
The integration of artificial intelligence (AI) in educational measurement has revolutionized assessment methods, enabling automated scoring, rapid content analysis, and personalized feedback through machine learning and natural language processing. These advancements provide timely, consistent feedback and valuable insights into student performance, thereby enhancing the assessment experience. However, the deployment of AI in education also raises significant ethical concerns regarding validity, reliability, transparency, fairness, and equity. Issues such as algorithmic bias and the opacity of AI decision-making processes pose risks of perpetuating inequalities and affecting assessment outcomes. Responding to these concerns, various stakeholders, including educators, policymakers, and organizations, have developed guidelines to ensure ethical AI use in education. The National Council of Measurement in Education's Special Interest Group on AI in Measurement and Education (AIME) also focuses on establishing ethical standards and advancing research in this area. In this paper, a diverse group of AIME members examines the ethical implications of AI-powered tools in educational measurement, explores significant challenges such as automation bias and environmental impact, and proposes solutions to ensure AI's responsible and effective use in education.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 21 of its 196 references that are in the map. First posted on arXiv 27 Jun 2024.
Builds on
21 of 196 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
- 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 476
- 2019A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cyclecited by 192
- 2022Pretrained Language Models for Text Generation: A Surveycited by 121
- 2021Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learnerscited by 115
- 2021A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Levelcited by 96
9 more
- 2023Eight Things to Know about Large Language Modelscited by 73
- 2023Democratising AI: Multiple Meanings, Goals, and Methodscited by 29
- 2023ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Reviewcited by 28
- 2022Survey on Automated Short Answer Grading with Deep Learning: from Word Embeddings to Transformerscited by 20
- 2020Better Distractions: Transformer-based Distractor Generation and Multiple Choice Question Filteringcited by 17
- 2021Automated essay scoring using efficient transformer-based language modelscited by 12
- 2022Short-answer scoring with ensembles of pretrained language modelscited by 8
- 2024Automatic Generation and Evaluation of Reading Comprehension Test Items with Large Language Modelscited by 5
- 2023A Review of the Ethics of Artificial Intelligence and its Applications in the United Statescited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.