mlsanityData to 7 Oct 2026

REFeREE: A REference-FREE Model-Based Metric for Text Simplification

arXiv 2403.17640 ↗First posted 26 Mar 2024cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Text simplification lacks a universal standard of quality, and annotated reference simplifications are scarce and costly. We propose to alleviate such limitations by introducing REFeREE, a reference-free model-based metric with a 3-stage curriculum. REFeREE leverages an arbitrarily scalable pretraining stage and can be applied to any quality standard as long as a small number of human annotations are available. Our experiments show that our metric outperforms existing reference-based metrics in predicting overall ratings and reaches competitive and consistent performance in predicting specific ratings while requiring no reference simplifications at inference time.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 37 of its 68 references that are in the map. First posted on arXiv 26 Mar 2024.

Builds on

37 of 68 references.

References · 37

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  9. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  10. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  11. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  12. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
25 more
  1. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  2. 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 241
  3. 2020Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasingcited by 114
  4. 2017Sentence Simplification with Deep Reinforcement Learningcited by 107
  5. 2020ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformationscited by 101
  6. 2021Learning Compact Metrics for MTcited by 93
  7. 2019Answers Unite! Unsupervised Metrics for Reinforced Summarization Modelscited by 92
  8. 2020Fill in the BLANC: Human-free quality estimation of document summariescited by 80
  9. 2018BLEU is Not Suitable for the Evaluation of Text Simplificationcited by 78
  10. 2019EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editingcited by 63
  11. 2020Felix: Flexible Text Editing Through Tagging and Insertioncited by 58
  12. 2022LENS: A Learnable Evaluation Metric for Text Simplificationcited by 54
  13. 2022On the Limitations of Reference-Free Evaluations of Generated Textcited by 52
  14. 2019EASSE: Easier Automatic Sentence Simplification Evaluationcited by 50
  15. 2020On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluationcited by 36
  16. 2018Semantic Structural Evaluation for Text Simplificationcited by 30
  17. 2020Elaborative Simplification: Content Addition and Explanation Generation in Text Simplificationcited by 27
  18. 2021Document-Level Text Simplification: Dataset, Criteria and Baselinecited by 27
  19. 2021An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformerscited by 18
  20. 2021Rethinking Automatic Evaluation in Sentence Simplificationcited by 17
  21. 2022USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translationcited by 15
  22. 2023Simplicity Level Estimate (SLE): A Learned Reference-Less Metric for Sentence Simplificationcited by 14
  23. 2019Reference-less Quality Estimation of Text Simplification Systemscited by 10
  24. 2023RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbationcited by 6
  25. 2020Simple-QE: Better Automatic Quality Estimation for Text Simplificationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

  1. 2025Evaluation Under Imperfect Benchmarks and Ratings: A Case Study in Text Simplificationcited by 4
  2. 2025Policy-based Sentence Simplification: Replacing Parallel Corpora with LLM-as-a-Judgecited by 1
  3. 2026Profiling German Text Simplification with Interpretable Model-Fingerprintscited by 0