Pair2Score: Pairwise-to-Absolute Transfer for LLM-Based Essay Scoring
Not on the map. Why?
Abstract (arXiv)
Many scoring applications require absolute predictions, while pairwise comparisons can provide a simpler learning objective. We present Pair2Score, a two-stage learning framework that transfers pairwise comparisons into absolute scoring with parameter-efficient LLaMA adaptation. Stage 1 trains a directional Siamese ranker on pairwise comparisons derived from absolute trait labels; Stage 2 trains an absolute predictor using configurable transfer strategies (warm-start and embedding-fusion variants). We evaluate on rubric-aligned Automated Essay Scoring (AES) traits (grammar, vocabulary, syntax) under a five-fold protocol that co-rotates held-out fold and random seed. At the trait level, the best-performing transfer variant improves quadratic weighted kappa (QWK) over an absolute-only baseline for all three traits. However, not all transfer configurations help: a one-epoch pairwise stage transfers more reliably than extended pairwise training, and transfer configuration -- not just the inclusion of a pairwise stage -- determines whether downstream scoring benefits.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 19 references that are in the map. First posted on arXiv 3 May 2026.
Builds on
5 of 19 references.
References · 5
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
- 2024Exploring LLM Prompting Strategies for Joint Essay Scoring and Feedback Generationcited by 63
- 2021Robust Transfer Learning with Pretrained Language Models through Adapterscited by 35
- 2023Prefer to Classify: Improving Text Classifiers via Auxiliary Preference Learningcited by 2
Built on by
Not cited yet.