mlsanityData to 7 Oct 2026

REC-CBM: Rubric-Aware Error-Correction Concept Bottleneck Models for Trustworthy Open-Ended Grading

arXiv 2605.27402 ↗First posted 24 Apr 2026cs.CY cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-ended grading is central to equitable and personalized education, yet manual grading remains time-consuming and costly, underscoring the need for automated grading systems. Although recent neural and large language model (LLM) based systems have demonstrated superior performance, they are typically black-box models whose scoring processes and rationales are difficult for educators to verify and trust. Concept bottleneck models (CBMs) have emerged as a promising approach by routing predictions through human-interpretable concepts, providing a mechanistic guarantee of transparency. However, standard CBMs are not tailored to open-ended grading: they do not explicitly model fine-grained rubric dimensions, inadequately capture the ordinal semantics of scoring scales, and neglect inherent reliability issues in human concept annotations. To address these limitations, we propose REC-CBM, a rubric-aware error-correction concept bottleneck model for trustworthy open-ended grading. REC-CBM introduces a rubric-aware concept encoder that learns concept-specific representations over responses and an ordinal pairwise calibration objective that preserves ranking structure among rubric dimensions. It further incorporates a latent concept error-correction module that denoises concept predictions before final grade prediction while preserving interpretability. Comprehensive experiments on publicly available datasets show that REC-CBM consistently improves grading performance and produces more faithful concept-level reasoning than both state-of-the-art baselines. Further analyses validate the contribution of each component and demonstrate the applicability in realistic educational settings. Overall, this work provides a practical, interpretable grading solution that enables educators to inspect, intervene in, and trust automated decisions, advancing more transparent and trustworthy education.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 35 references that are in the map. First posted on arXiv 24 Apr 2026.

Builds on

16 of 35 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2024GPT-4o System Cardcited by 4,467
  7. 2020Concept Bottleneck Modelscited by 1,022
  8. 2022On the Use of BERT for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representationcited by 46
  9. 2020MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metricscited by 42
  10. 2025Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lenscited by 42
  11. 2023Interpreting Pretrained Language Models via Concept Bottleneckscited by 33
  12. 2024Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMscited by 22
4 more
  1. 2024Concept Bottleneck Language Models For protein designcited by 15
  2. 2024Ontology-Aware RAG for Improved Question-Answering in Cybersecurity Educationcited by 9
  3. 2024Beyond Agreement: Diagnosing the Rationale Alignment of Automated Essay Scoring Methods based on Linguistically-informed Counterfactualscited by 8
  4. 2025SCALE: Towards Collaborative Content Analysis in Social Science with Large Language Model Agents and Human Interventioncited by 7

Built on by

Not cited yet.