mlsanityData to 14 Oct 2026

Streamlining Admission with LOR Insights: AI-Based Leadership Assessment in Online Master's Program

arXiv 2508.05513 ↗First posted 7 Aug 2025cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Letters of recommendation (LORs) provide valuable insights into candidates' capabilities and experiences beyond standardized test scores. However, reviewing these text-heavy materials is time-consuming and labor-intensive. To address this challenge and support the admission committee in providing feedback for students' professional growth, our study introduces LORI: LOR Insights, a novel AI-based detection tool for assessing leadership skills in LORs submitted by online master's program applicants. By employing natural language processing and leveraging large language models using RoBERTa and LLAMA, we seek to identify leadership attributes such as teamwork, communication, and innovation. Our latest RoBERTa model achieves a weighted F1 score of 91.6%, a precision of 92.4%, and a recall of 91.6%, showing a strong level of consistency in our test data. With the growing importance of leadership skills in the STEM sector, integrating LORI into the graduate admissions process is crucial for accurately assessing applicants' leadership capabilities. This approach not only streamlines the admissions process but also automates and ensures a more comprehensive evaluation of candidates' capabilities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 111 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

22 of 111 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  7. 2020A Primer in BERTology: What we know about how BERT workscited by 815
  8. 2018A Tutorial on Bayesian Optimizationcited by 744
  9. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
  10. 2017Snorkel: Rapid Training Data Creation with Weak Supervisioncited by 372
  11. 2022Reasoning with Language Model Prompting: A Surveycited by 252
  12. 2022Efficient Few-Shot Learning Without Promptscited by 137
10 more
  1. 2018Synthetic Data Augmentation using GAN for Improved Liver Lesion Classificationcited by 136
  2. 2024Can Large Language Models Reason and Plan?cited by 82
  3. 2017Bayesian Optimization with Gradientscited by 59
  4. 2017Learning the Structure of Generative Models without Labeled Datacited by 50
  5. 2023An Empirical Comparison of Pre-Trained Models of Source Codecited by 25
  6. 2021Explanation of Machine Learning Models Using Shapley Additive Explanation and Application for Real Data in Hospitalcited by 17
  7. 2023A Large Language Model Approach to Educational Survey Feedback Analysiscited by 14
  8. 2023Weaker Than You Think: A Critical Look at Weakly Supervised Learningcited by 8
  9. 2018How Developers Iterate on Machine Learning Workflows -- A Survey of the Applied Machine Learning Literaturecited by 6
  10. 2021Using word clouds for fast identification of papers' subject domain and reviewers' competencescited by 2

Built on by

Not cited yet.