mlsanityData to 7 Oct 2026

Data Augmentation for Automated Essay Scoring using Transformer Models

arXiv 2210.12809 ↗First posted 23 Oct 2022cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Automated essay scoring is one of the most important problem in Natural Language Processing. It has been explored for a number of years, and it remains partially solved. In addition to its economic and educational usefulness, it presents research problems. Transfer learning has proved to be beneficial in NLP. Data augmentation techniques have also helped build state-of-the-art models for automated essay scoring. Many works in the past have attempted to solve this problem by using RNNs, LSTMs, etc. This work examines the transformer models like BERT, RoBERTa, etc. We empirically demonstrate the effectiveness of transformer models and data augmentation for automated essay grading across many topics using a single model.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 11 of its 27 references that are in the map. First posted on arXiv 23 Oct 2022.

Builds on

11 of 27 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  8. 2022On the Use of BERT for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representationcited by 46
  9. 2021Automated Essay Scoring Using Transformer Modelscited by 14
  10. 2021Automated essay scoring using efficient transformer-based language modelscited by 12
  11. 2022Improving Performance of Automated Essay Scoring by using back-translation essays and adjusted scorescited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 0; 2026: 1.

3 papers.

  1. 2023When Automated Assessment Meets Automated Content Generation: Examining Text Quality in the Era of GPTscited by 13
  2. 2024Phrase-Level Adversarial Training for Mitigating Bias in Neural Network-based Automatic Essay Scoringcited by 0
  3. 2026Calibrating Generative AI to Produce Realistic Essays for Data Augmentationcited by 0