A Durability and Cross-Language Transfer Benchmark for a Validated Teaching-Feedback Classification Protocol
Not on the map. Why?
Abstract (arXiv)
Institutions collect far more open-ended teaching-evaluation feedback than they read. A prior study introduced a validated protocol for classifying such comments by thematic category and sentiment, built from a documented annotation guide, an intra-annotator reliability measurement, stratified cross-validation, and a held-out evaluation on a Spanish institutional corpus with a frozen-encoder design. Two questions limit its reuse: whether a protocol fixed to 2019-era frozen embeddings stays competitive as representation methods advance, and whether it transfers to a second language. We re-run it on the original Spanish data across three representation generations, sparse lexical features, frozen transformer embeddings, and prompted large language models, and transfer its sentiment task to English with a balanced 45,000-comment corpus checked against an aspect-labeled education dataset. Treating paired comparisons as descriptive, we find the protocol durable: a 2026 frontier model posts the highest thematic F1 on the hardest Spanish task, yet shows no sentiment advantage over a cheap model and no descriptive separation from it on English, so model choice is a deployment decision, not a property of the method.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 38 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
15 of 38 references.
References · 15
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
- 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 372
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 268
- 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
- 2023A Review of the Trends and Challenges in Adopting Natural Language Processing Methods for Education Feedback Analysiscited by 12
Built on by
Not cited yet.