mlsanityData to 7 Oct 2026

LaTA: A Drop-in, FERPA-Compliant Local-LLM Autograder for Upper-Division STEM Coursework

arXiv 2605.05410 ↗First posted 6 May 2026cs.AI cs.HC physics.ed-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Large-language-model (LLM) graders promise to relieve the grading burden of upper-division STEM courses, but most deployments to date send student work to third-party APIs, violating FERPA and exposing institutions to data risk while requiring substantial assignment modification. We present LaTA (textitLaTeX Teaching Assistant), a drop-in, open-source autograder that runs entirely on commodity on-premises hardware and assumes a LaTeX-native workflow already adopted by many engineering and physics courses. LaTA implements a four-stage pipeline (ingest, segment, grade, report) using a locally hosted open-weight chain-of-thought LLM grader (gpt-oss:120b) that compares student work to an instructor-authored reference solution and applies a YAML rubric with binary per-item scoring. We deployed LaTA in Winter~2026 in ME 373 (Mechanical Engineering Methods) at Oregon State University, grading every weekly assignment for approximately 200 students on a single Mac Studio at 0 marginal cost per assignment and 1--3 minutes of wall-clock time per submission, enabling regrading of corrected assignments and greatly expanded TA office hour offerings. The instructor-confirmed grading-error rate held at roughly 0.02--0.04% per rubric line item across the term. Relative to the same instructor's previous traditionally-graded cohort, the LaTA-graded cohort outperformed by approximately 11% on the midterm exam and 8% on the final exam, and reported large gains in self-assessed confidence on every stated learning objective (N = 159 survey responses, Delta ≥ +1.49 Likert points, p < 10-27 on every comparison). We release the code under AGPLv3.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 34 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

5 of 34 references.

References · 5

  1. 2023Applying Large Language Models and Chain-of-Thought for Automatic Scoringcited by 68
  2. 2023Fine-tuning ChatGPT for Automatic Scoringcited by 50
  3. 2023Automatic assessment of text-based responses in post-secondary education: A systematic reviewcited by 6
  4. 2025Human-in-the-Loop Systems for Adaptive Learning Using Generative AIcited by 2
  5. 2026Auditing Student-AI Collaboration: A Case Study of Online Graduate CS Studentscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Grade Like a Human: Rethinking Automated Assessment with Large Language Models
  2. 2025Small Models, Big Support: A Local LLM Framework for Educator-Centric Content Creation and Assessment with RAG and CAG
  3. 2025SteLLA: A Structured Grading System Using LLMs with RAG
  4. 2026ARIA: Adaptive Retrieval Intelligence Assistant -- A Multimodal RAG Framework for Domain-Specific Engineering Education
  5. 2025CodEv: An Automated Grading Framework Leveraging Large Language Models for Consistent and Constructive Feedback
  6. 2026Grading Handwritten Engineering Exams with Multimodal Large Language Models
  7. 2025StepGrade: Grading Programming Assignments with Context-Aware LLMs
  8. 2026Beyond Grading Accuracy: Exploring Alignment of TAs and LLMs ↗