mlsanityData to 14 Oct 2026

EDIT: Evidence-Diagnosed Intervention Training for Rule-Faithful LLM Grading

arXiv 2606.06350 ↗First posted 4 Jun 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Reliable rubric grading requires more than accurate score prediction. Each judgement must be grounded in the mark scheme and evidence from the student answer. Existing credit-assignment and intervention methods, primarily designed for self-contained reasoning tasks such as mathematics reasoning, struggle in this setting because they do not identify where grading reasoning goes wrong or how the model's belief about the final mark changes during reasoning. We propose Evidence-Diagnosed Intervention Training (EDIT), a two-phase framework for training more rubric-faithful LLM graders. First, EDIT-SFT locates problematic reasoning steps using internal model signals: posterior belief over the final mark and input-grounding scores. It then revises only these local steps with help from a rubric checklist. Second, EDIT-RL calibrates the grader with belief-guided reward shaping, penalising large harmful belief drifts while still allowing helpful exploration. Experiments on two real-world, multi-subject grading benchmarks demonstrate that EDIT consistently outperforms strong supervised fine-tuning and reinforcement learning baselines on both in-domain and out-of-domain splits, with ablation studies confirming that internal-state diagnostics drive these gains. Under deterministic rubric-edit interventions, EDIT-SFT is the most rule-responsive of all evaluated systems, and EDIT-RL largely retains this responsiveness while improving accuracy.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

10 of 21 references.

References · 10

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  3. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
  4. 2024Large Language Models for Education: A Survey and Outlookcited by 188
  5. 2023A Survey of Temporal Credit Assignment in Deep Reinforcement Learningcited by 59
  6. 2023Distilling ChatGPT for Explainable Automated Student Answer Assessmentcited by 14
  7. 2026InT: Self-Proposed Interventions Enable Credit Assignment in LLM Reasoningcited by 14
  8. 2024Calibrating LLMs with Preference Optimization on Thought Trees for Generating Rationale in Science Question Scoringcited by 8
  9. 2025Two Heads Are Better Than One: Dual-Model Verbal Reflection at Inference-Timecited by 8
  10. 2026DGPO: Distribution Guided Policy Optimization for Fine Grained Credit Assignmentcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Curing Miracle Steps in LLM Mathematical Reasoning with Rubric Rewards
  2. 2025Online Rubrics Elicitation from Pairwise Comparisons
  3. 2026AMARIS: A Memory-Augmented Rubric Improvement System for Rubric-Based Reinforcement Learning
  4. 2026Rubric-Guided Self-Distillation: Post-Training Without Rubric Verifiers
  5. 2026Mitigating Rubric Interference in LLM Judges via On-Policy Self-Distillation
  6. 2025Harnessing Negative Signals: Reinforcement Distillation from Teacher Data for LLM Reasoning
  7. 2026Think-with-Rubrics: From External Evaluator to Internal Reasoning Guidance
  8. 2026Radioactive Feedback: Tracing Models Trained by Label-Only LLM Supervision