mlsanityData to 14 Oct 2026

Leveraging Small LLMs for Argument Mining in Education: Argument Component Identification, Classification, and Assessment

arXiv 2502.14389 ↗First posted 20 Feb 2025cs.CL cs.HCcited by 4

Not on the map. Why?

Abstract (arXiv)

Argument mining algorithms analyze the argumentative structure of essays, making them a valuable tool for enhancing education by providing targeted feedback on the students' argumentation skills. While current methods often use encoder or encoder-decoder deep learning architectures, decoder-only models remain largely unexplored, offering a promising research direction. This paper proposes leveraging open-source, small Large Language Models (LLMs) for argument mining through few-shot prompting and fine-tuning. These models' small size and open-source nature ensure accessibility, privacy, and computational efficiency, enabling schools and educators to adopt and deploy them locally. Specifically, we perform three tasks: segmentation of student essays into arguments, classification of the arguments by type, and assessment of their quality. We empirically evaluate the models on the Feedback Prize - Predicting Effective Arguments dataset of grade 6-12 students essays and demonstrate how fine-tuned small LLMs outperform baseline methods in segmenting the essays and determining the argument types while few-shot prompting yields comparable performance to that of the baselines in assessing quality. This work highlights the educational potential of small, open-source LLMs to provide real-time, personalized feedback, enhancing independent learning and writing skills while ensuring low computational cost and privacy.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 17 of its 39 references that are in the map. First posted on arXiv 20 Feb 2025.

Builds on

17 of 39 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  8. 2024Qwen2.5 Technical Reportcited by 4,942
  9. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  10. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  11. 2020Longformer: The Long-Document Transformercited by 3,413
  12. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
5 more
  1. 2024Can Large Language Models perform Relation-based Argument Mining?cited by 23
  2. 2020Transformer-Based Models for Automatic Identification of Argument Relations: A Cross-Domain Evaluationcited by 20
  3. 2021DisCoDisCo at the DISRPT2021 Shared Task: A System for Discourse Segmentation, Classification, and Connective Detectioncited by 15
  4. 2023Contextualizing Argument Quality Assessment with Relevant Knowledgecited by 4
  5. 2023AutoAM: An End-To-End Neural Model for Automatic and Universal Argument Miningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.