Automated Multiple Mini Interview (MMI) Scoring
Not on the map. Why?
Abstract (arXiv)
Assessing soft skills such as empathy, ethical judgment, and communication is essential in competitive selection processes, yet human scoring is often inconsistent and biased. While Large Language Models (LLMs) have improved Automated Essay Scoring (AES), we show that state-of-the-art rationale-based fine-tuning methods struggle with the abstract, context-dependent nature of Multiple Mini-Interviews (MMIs), missing the implicit signals embedded in candidate narratives. We introduce a multi-agent prompting framework that breaks down the evaluation process into transcript refinement and criterion-specific scoring. Using 3-shot in-context learning with a large instruct-tuned model, our approach outperforms specialised fine-tuned baselines (Avg QWK 0.62 vs 0.32) and achieves reliability comparable to human experts. We further demonstrate the generalisability of our framework on the ASAP benchmark, where it rivals domain-specific state-of-the-art models without additional training. These findings suggest that for complex, subjective reasoning tasks, structured prompt engineering may offer a scalable alternative to data-intensive fine-tuning, altering how LLMs can be applied to automated assessment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
9 of 21 references.
References · 9
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
- 2022Active Example Selection for In-Context Learningcited by 195
- 2022On the Use of BERT for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representationcited by 46
- 2024Can Large Language Models Automatically Score Proficiency of Written Essays?cited by 34
- 2024Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoringcited by 33
- 2024Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMscited by 22
- 2024Are Large Language Models Good Essay Graders?cited by 11
- 2024The Impact of Example Selection in Few-Shot Prompting on Automated Essay Scoring Using GPT Modelscited by 8
Built on by
Not cited yet.