GLEU Without Tuning
Not on the map. Why?
Abstract (arXiv)
The GLEU metric was proposed for evaluating grammatical error corrections using n-gram overlap with a set of reference sentences, as opposed to precision/recall of specific annotated errors (Napoles et al., 2015). This paper describes improvements made to the GLEU metric that address problems that arise when using an increasing number of reference sets. Unlike the originally presented metric, the modified metric does not require tuning. We recommend that this version be used instead of the original version.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 4; 2024: 3; 2025: 7; 2026: 5.
24 papers.
Sort:
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Taskscited by 100
- 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluationcited by 97
- 2022Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyondcited by 20
- 2023Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generationcited by 14
- 2024mEdIT: Multilingual Text Editing via Instruction Tuningcited by 13
- 2021Comparison of Grammatical Error Correction Using Back-Translation Modelscited by 9
- 2021CrowdSpeech and VoxDIY: Benchmark Datasets for Crowdsourced Audio Transcriptioncited by 9
- 2025Reference-free Evaluation Metrics for Text Generation: A Surveycited by 9
- 2025gec-metrics: A Unified Library for Grammatical Error Correction Evaluationcited by 9
- 2023Byte-Level Grammatical Error Correction Using Synthetic and Curated Corporacited by 7
- 2025Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human?cited by 7
- 2021Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflowcited by 4
12 more
- 2024Revisiting Meta-evaluation for Grammatical Error Correctioncited by 3
- 2025Introducing OmniGEC: A Silver Multilingual Dataset for Grammatical Error Correctioncited by 3
- 2023Beyond Hard Samples: Robust and Effective Grammatical Error Correction with Cycle Self-Augmentingcited by 2
- 2024Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correctioncited by 2
- 2026Multi-Dimensional Evaluation of LLMs for Grammatical Error Correctioncited by 1
- 2026Edit-level Majority Voting Mitigates Over-Correction in LLM-based Grammatical Error Correctioncited by 1
- 2025Time Is Effort: Estimating Human Post-Editing Time for Grammar Error Correction Tool Evaluationcited by 0
- 2025A Formal Framework for Fluency-based Multi-Reference Evaluation in Grammatical Error Correctioncited by 0
- 2025Minimal-Edit Instruction Tuning for Low-Resource Indic GECcited by 0
- 2026Grammatical Error Correction Evaluation by Optimally Transporting Edit Representationcited by 0
- 2026Refining Word-Based Grammatical Error Annotation for L2 Koreancited by 0
- 2026WrAFT: a Modularized Automated Writing Evaluation System for Argumentative Essayscited by 0
- 2026WrAFT: a Modularized Automated Writing Evaluation System for Argumentative Essays16 Jul 2026
- 2026Refining Word-Based Grammatical Error Annotation for L2 Korean28 May 2026
- 2026Edit-level Majority Voting Mitigates Over-Correction in LLM-based Grammatical Error Correction13 May 2026
- 2026Multi-Dimensional Evaluation of LLMs for Grammatical Error Correction8 May 2026
- 2026Grammatical Error Correction Evaluation by Optimally Transporting Edit Representation5 Feb 2026
- 2025Minimal-Edit Instruction Tuning for Low-Resource Indic GEC28 Nov 2025
- 2025A Formal Framework for Fluency-based Multi-Reference Evaluation in Grammatical Error Correction8 Oct 2025
- 2025Time Is Effort: Estimating Human Post-Editing Time for Grammar Error Correction Tool Evaluation5 Oct 2025
- 2025Introducing OmniGEC: A Silver Multilingual Dataset for Grammatical Error Correction18 Sep 2025
- 2025gec-metrics: A Unified Library for Grammatical Error Correction Evaluation26 May 2025
- 2025Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human?13 Feb 2025
- 2025Reference-free Evaluation Metrics for Text Generation: A Survey21 Jan 2025
12 more
- 2024Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction26 Mar 2024
- 2024Revisiting Meta-evaluation for Grammatical Error Correction5 Mar 2024
- 2024mEdIT: Multilingual Text Editing via Instruction Tuning26 Feb 2024
- 2023Beyond Hard Samples: Robust and Effective Grammatical Error Correction with Cycle Self-Augmenting20 Oct 2023
- 2023Byte-Level Grammatical Error Correction Using Synthetic and Curated Corpora29 May 2023
- 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluation4 Apr 2023
- 2023Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generation12 Jan 2023
- 2022Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyond23 May 2022
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks15 Jul 2021
- 2021CrowdSpeech and VoxDIY: Benchmark Datasets for Crowdsourced Audio Transcription2 Jul 2021
- 2021Comparison of Grammatical Error Correction Using Back-Translation Models16 Apr 2021
- 2021Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflow1 Feb 2021
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Taskscited by 100
- 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluationcited by 97
- 2022Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyondcited by 20
- 2023Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generationcited by 14
- 2024mEdIT: Multilingual Text Editing via Instruction Tuningcited by 13
- 2021Comparison of Grammatical Error Correction Using Back-Translation Modelscited by 9
- 2021CrowdSpeech and VoxDIY: Benchmark Datasets for Crowdsourced Audio Transcriptioncited by 9
- 2025Reference-free Evaluation Metrics for Text Generation: A Surveycited by 9
- 2025gec-metrics: A Unified Library for Grammatical Error Correction Evaluationcited by 9
- 2023Byte-Level Grammatical Error Correction Using Synthetic and Curated Corporacited by 7
- 2025Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human?cited by 7
- 2021Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflowcited by 4
12 most cited of 24 All 24 (JSON)
- 2026WrAFT: a Modularized Automated Writing Evaluation System for Argumentative Essays16 Jul 2026
- 2026Refining Word-Based Grammatical Error Annotation for L2 Korean28 May 2026
- 2026Edit-level Majority Voting Mitigates Over-Correction in LLM-based Grammatical Error Correction13 May 2026
- 2026Multi-Dimensional Evaluation of LLMs for Grammatical Error Correction8 May 2026
- 2026Grammatical Error Correction Evaluation by Optimally Transporting Edit Representation5 Feb 2026
- 2025Minimal-Edit Instruction Tuning for Low-Resource Indic GEC28 Nov 2025
- 2025A Formal Framework for Fluency-based Multi-Reference Evaluation in Grammatical Error Correction8 Oct 2025
- 2025Time Is Effort: Estimating Human Post-Editing Time for Grammar Error Correction Tool Evaluation5 Oct 2025
- 2025Introducing OmniGEC: A Silver Multilingual Dataset for Grammatical Error Correction18 Sep 2025
- 2025gec-metrics: A Unified Library for Grammatical Error Correction Evaluation26 May 2025
- 2025Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human?13 Feb 2025
- 2025Reference-free Evaluation Metrics for Text Generation: A Survey21 Jan 2025
12 newest of 24 All 24 (JSON)