mlsanityData to 14 Oct 2026

Exploration of Summarization by Generative Language Models for Automated Scoring of Long Essays

arXiv 2510.22830 ↗First posted 26 Oct 2025cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

BERT and its variants are extensively explored for automated scoring. However, a limit of 512 tokens for these encoder-based models showed the deficiency in automated scoring of long essays. Thus, this research explores generative language models for automated scoring of long essays via summarization and prompting. The results revealed great improvement of scoring accuracy with QWK increased from 0.822 to 0.8878 for the Learning Agency Lab Automated Essay Scoring 2.0 dataset.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 37 references that are in the map. First posted on arXiv 26 Oct 2025.

Builds on

15 of 37 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  6. 2023Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessmentcited by 230
  7. 2019HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarizationcited by 121
  8. 2022Long Document Summarization with Top-down and Bottom-up Inferencecited by 42
  9. 2022Automated Scoring for Reading Comprehension via In-context BERT Tuningcited by 15
  10. 2022On Efficient Approximate Queries over Machine Learning Modelscited by 7
  11. 2022Quantized Training of Gradient Boosting Decision Treescited by 6
  12. 2023Tackling Fake News in Bengali: Unraveling the Impact of Summarization vs. Augmentation on Pre-trained Language Modelscited by 2
3 more
  1. 2024Investigating Text Shortening Strategy in BERT: Truncation vs Summarizationcited by 2
  2. 2024A BERT-Based Summarization approach for depression detectioncited by 1
  3. 2025Comparison of Scoring Rationales Between Large Language Models and Human Raterscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

  1. 2026Empirical Comparison of Encoder-Based Language Models and Feature-Based Supervised Machine Learning Approaches to Automated Scoring of Long Essayscited by 0
  2. 2026Cost-efficient generative AI summarization for scalable automated essay scoring in educational assessmentcited by 0