Many Hands Make Light Work: Using Essay Traits to Automatically Score Essays
Not on the map. Why?
Abstract (arXiv)
Most research in the area of automatic essay grading (AEG) is geared towards scoring the essay holistically while there has also been some work done on scoring individual essay traits. In this paper, we describe a way to score essays holistically using a multi-task learning (MTL) approach, where scoring the essay holistically is the primary task, and scoring the essay traits is the auxiliary task. We compare our results with a single-task learning (STL) approach, using both LSTMs and BiLSTMs. We also compare our results of the auxiliary task with such tasks done in other AEG systems. To find out which traits work best for different types of essays, we conduct ablation tests for each of the essay traits. We also report the runtime and number of training parameters for each system. We find that MTL-based BiLSTM system gives the best results for scoring the essay holistically, as well as performing well on scoring the essay traits.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 9 of its 46 references that are in the map. First posted on arXiv 1 Feb 2021.
Builds on
9 of 46 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2015Equilibrated adaptive learning rates for non-convex optimizationcited by 42
- 2018Automated essay scoring with string kernels and word embeddingscited by 31
- 2017SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoringcited by 22
- 2019Co-Attention Based Neural Network for Source-Dependent Essay Scoringcited by 11
- 2018Eyes are the Windows to the Soul: Predicting the Rating of Text Quality Using Gaze Behaviourcited by 9
- 2020Happy Are Those Who Grade without Seeing: A Multi-Task Learning Approach to Grade Essays Using Gaze Behaviourcited by 9
- 2020Automated Topical Component Extraction Using Neural Network Attention Scores from Source-based Essay Scoringcited by 3
Built on by
Citing papers per year: 2023: 3; 2024: 8; 2025: 3; 2026: 11.
25 papers.
Sort:
By area:
- 2024Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoringcited by 33
- 2023Prompt- and Trait Relation-aware Cross-prompt Essay Trait Scoringcited by 24
- 2024Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMscited by 22
- 2023Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Makingcited by 11
- 2024Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewardscited by 11
- 2024Automated Long Answer Grading with RiceChem Datasetcited by 10
- 2024Autoregressive Score Generation for Multi-trait Essay Scoringcited by 8
- 2024DREsS: Dataset for Rubric-based Essay Scoring on EFL Writingcited by 7
- 2025Teach-to-Reason with Scoring: Self-Explainable Rationale-Driven Multi-Trait Essay Scoringcited by 6
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
- 2023WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipediacited by 2
- 2026LLMs Do Not Grade Essays Like Humanscited by 2
13 more
- 2026PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedbackcited by 2
- 2026Enhancing Automated Essay Scoring With Three Techniques: Two-Stage Fine-Tuning, Score Alignment, and Self-Trainingcited by 1
- 2026Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoringcited by 1
- 2024RDBE: Reasoning Distillation-Based Evaluation Enhances Automatic Essay Scoringcited by 0
- 2025Euskarazko lehen C1 ebaluatzaile automatikoacited by 0
- 2025CLEAR: A Comprehensive Linguistic Evaluation of Argument Rewriting by Large Language Modelscited by 0
- 2026Qayyem: A Real-time Platform for Scoring Proficiency of Arabic Essayscited by 0
- 2026Decision-Level Ordinal Modeling for Multimodal Essay Scoring with Large Language Modelscited by 0
- 2026MAPLE: A Meta-learning Framework for Cross-Prompt Essay Scoringcited by 0
- 2026Towards Self-Referential Analytic Assessment: A Profile-Based Approach to L2 Writing Evaluation with LLMscited by 0
- 2026MADRAG: Multi-Agent Debate with Retrieval-Augmented Generation for Training-Free Analytic Essay Scoringcited by 0
- 2026ICLE++: Modeling Fine-Grained Traits for Holistic Essay Scoringcited by 0
- 2026A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoringcited by 0
- 2026A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring28 Aug 2026
- 2026ICLE++: Modeling Fine-Grained Traits for Holistic Essay Scoring30 Jul 2026
- 2026PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback18 Jun 2026
- 2026MADRAG: Multi-Agent Debate with Retrieval-Augmented Generation for Training-Free Analytic Essay Scoring4 Jun 2026
- 2026Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring25 May 2026
- 2026Towards Self-Referential Analytic Assessment: A Profile-Based Approach to L2 Writing Evaluation with LLMs5 May 2026
- 2026MAPLE: A Meta-learning Framework for Cross-Prompt Essay Scoring19 Apr 2026
- 2026LLMs Do Not Grade Essays Like Humans24 Mar 2026
- 2026Decision-Level Ordinal Modeling for Multimodal Essay Scoring with Large Language Models16 Mar 2026
- 2026Qayyem: A Real-time Platform for Scoring Proficiency of Arabic Essays1 Mar 2026
- 2026Enhancing Automated Essay Scoring With Three Techniques: Two-Stage Fine-Tuning, Score Alignment, and Self-Training2 Feb 2026
- 2025CLEAR: A Comprehensive Linguistic Evaluation of Argument Rewriting by Large Language Models18 Sep 2025
13 more
- 2025Teach-to-Reason with Scoring: Self-Explainable Rationale-Driven Multi-Trait Essay Scoring28 Feb 2025
- 2025Euskarazko lehen C1 ebaluatzaile automatikoa18 Feb 2025
- 2024Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMs18 Oct 2024
- 2024Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewards26 Sep 2024
- 2024RDBE: Reasoning Distillation-Based Evaluation Enhances Automatic Essay Scoring3 Jul 2024
- 2024Automated Long Answer Grading with RiceChem Dataset22 Apr 2024
- 2024Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoring7 Apr 2024
- 2024Autoregressive Score Generation for Multi-trait Essay Scoring13 Mar 2024
- 2024DREsS: Dataset for Rubric-based Essay Scoring on EFL Writing21 Feb 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2023Prompt- and Trait Relation-aware Cross-prompt Essay Trait Scoring26 May 2023
- 2023WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipedia10 May 2023
- 2023Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Making17 Feb 2023
- 2024Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoringcited by 33
- 2023Prompt- and Trait Relation-aware Cross-prompt Essay Trait Scoringcited by 24
- 2024Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMscited by 22
- 2023Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Makingcited by 11
- 2024Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewardscited by 11
- 2024Automated Long Answer Grading with RiceChem Datasetcited by 10
- 2024Autoregressive Score Generation for Multi-trait Essay Scoringcited by 8
- 2024DREsS: Dataset for Rubric-based Essay Scoring on EFL Writingcited by 7
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
- 2023WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipediacited by 2
- 2026LLMs Do Not Grade Essays Like Humanscited by 2
- 2026PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedbackcited by 2
12 most cited of 22 All 22 (JSON)
- 2026A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring28 Aug 2026
- 2026ICLE++: Modeling Fine-Grained Traits for Holistic Essay Scoring30 Jul 2026
- 2026PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback18 Jun 2026
- 2026Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring25 May 2026
- 2026Towards Self-Referential Analytic Assessment: A Profile-Based Approach to L2 Writing Evaluation with LLMs5 May 2026
- 2026MAPLE: A Meta-learning Framework for Cross-Prompt Essay Scoring19 Apr 2026
- 2026LLMs Do Not Grade Essays Like Humans24 Mar 2026
- 2026Decision-Level Ordinal Modeling for Multimodal Essay Scoring with Large Language Models16 Mar 2026
- 2026Qayyem: A Real-time Platform for Scoring Proficiency of Arabic Essays1 Mar 2026
- 2026Enhancing Automated Essay Scoring With Three Techniques: Two-Stage Fine-Tuning, Score Alignment, and Self-Training2 Feb 2026
- 2025CLEAR: A Comprehensive Linguistic Evaluation of Argument Rewriting by Large Language Models18 Sep 2025
- 2025Euskarazko lehen C1 ebaluatzaile automatikoa18 Feb 2025
12 newest of 22 All 22 (JSON)