AERA Chat: An Interactive Platform for Automated Explainable Student Answer Assessment
Not on the map. Why?
Abstract (arXiv)
Explainability in automated student answer scoring systems is critical for building trust and enhancing usability among educators. Yet, generating high-quality assessment rationales remains challenging due to the scarcity of annotated data and the prohibitive cost of manual verification, prompting heavy reliance on rationales produced by large language models (LLMs), which are often noisy and unreliable. To address these limitations, we present AERA Chat, an interactive visualization platform designed for automated explainable student answer assessment. AERA Chat leverages multiple LLMs to concurrently score student answers and generate explanatory rationales, offering innovative visualization features that highlight critical answer components and rationale justifications. The platform also incorporates intuitive annotation and evaluation tools, supporting educators in marking tasks and researchers in evaluating rationale quality from different models. We demonstrate the effectiveness of our platform through evaluations of multiple rationale-generation methods on several datasets, showcasing its capability for facilitating robust rationale evaluation and comparative analysis.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 41 references that are in the map. First posted on arXiv 12 Oct 2024.
Builds on
12 of 41 references.
References · 12
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
- 2024Large Language Models for Education: A Survey and Outlookcited by 185
- 2016Automatic Text Scoring Using Neural Networkscited by 51
- 2024Ruffle&Riley: Insights from Designing and Evaluating a Large Language Model-Based Conversational Tutoring Systemcited by 25
- 2023A large language model-assisted education tool to provide feedback on open-ended responsescited by 21
- 2023Adaptive and Personalized Exercise Generation for Online Language Learningcited by 18
- 2024Calibrating LLMs with Preference Optimization on Thought Trees for Generating Rationale in Science Question Scoringcited by 8
Built on by
Citing papers per year: 2024: 1.
1 paper.