mlsanityData to 14 Oct 2026

A Durability and Cross-Language Transfer Benchmark for a Validated Teaching-Feedback Classification Protocol

arXiv 2607.11873 ↗First posted 13 Jul 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Institutions collect far more open-ended teaching-evaluation feedback than they read. A prior study introduced a validated protocol for classifying such comments by thematic category and sentiment, built from a documented annotation guide, an intra-annotator reliability measurement, stratified cross-validation, and a held-out evaluation on a Spanish institutional corpus with a frozen-encoder design. Two questions limit its reuse: whether a protocol fixed to 2019-era frozen embeddings stays competitive as representation methods advance, and whether it transfers to a second language. We re-run it on the original Spanish data across three representation generations, sparse lexical features, frozen transformer embeddings, and prompted large language models, and transfer its sentiment task to English with a balanced 45,000-comment corpus checked against an aspect-labeled education dataset. Treating paired comparisons as descriptive, we find the protocol durable: a 2026 frontier model posts the highest thematic F1 on the hardest Spanish task, yet shows no sentiment advantage over a cheap model and no descriptive separation from it on English, so model choice is a deployment decision, not a property of the method.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 38 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

15 of 38 references.

References · 15

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  6. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
  7. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
  8. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  9. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 372
  10. 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 268
  11. 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
  12. 2023A Review of the Trends and Challenges in Adopting Natural Language Processing Methods for Education Feedback Analysiscited by 12
3 more
  1. 2021pysentimiento: A Python Toolkit for Opinion Mining and Social NLP taskscited by 9
  2. 2023SIGHT: A Large Annotated Dataset on Student Insights Gathered from Higher Education Transcriptscited by 8
  3. 2025EduRABSA: An Education Review Dataset for Aspect-based Sentiment Analysis Taskscited by 5

Built on by

Not cited yet.