{"total":67,"rows":[{"id":"2310.10482","title":"xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection","created":"2023-10-16","cited_by_count":265,"area":null},{"id":"2202.06935","title":"Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text","created":"2022-02-14","cited_by_count":155,"area":null},{"id":"2211.09102","title":"Prompting PaLM for Translation: Assessing Strategies and Performance","created":"2022-11-16","cited_by_count":145,"area":null},{"id":"2212.07981","title":"Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation","created":"2022-12-15","cited_by_count":142,"area":null},{"id":"2111.09388","title":"High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metrics","created":"2021-11-17","cited_by_count":104,"area":null},{"id":"2301.13298","title":"LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization","created":"2023-01-30","cited_by_count":96,"area":null},{"id":"2106.16163","title":"The MultiBERTs: BERT Reproductions for Robustness Analysis","created":"2021-06-30","cited_by_count":92,"area":null},{"id":"2303.13809","title":"Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models","created":"2023-03-24","cited_by_count":87,"area":null},{"id":"2210.13210","title":"Mutual Information Alleviates Hallucinations in Abstractive Summarization","created":"2022-10-24","cited_by_count":68,"area":null},{"id":"2305.09860","title":"Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation","created":"2023-05-17","cited_by_count":58,"area":null},{"id":"2209.13654","title":"Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric Into a Document-Level Metric","created":"2022-09-27","cited_by_count":56,"area":null},{"id":"2212.09739","title":"LENS: A Learnable Evaluation Metric for Text Simplification","created":"2022-12-19","cited_by_count":54,"area":null},{"id":"2210.12563","title":"On the Limitations of Reference-Free Evaluations of Generated Text","created":"2022-10-22","cited_by_count":52,"area":null},{"id":"2305.14889","title":"Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory","created":"2023-05-24","cited_by_count":43,"area":null},{"id":"2108.12463","title":"Automatic Text Evaluation through the Lens of Wasserstein Barycenters","created":"2021-08-27","cited_by_count":38,"area":null},{"id":"2204.10216","title":"Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics","created":"2022-04-21","cited_by_count":38,"area":null},{"id":"2410.03775","title":"Beyond correlation: The Impact of Human Uncertainty in Measuring the Effectiveness of Automatic Evaluation and LLM-as-a-Judge","created":"2024-10-03","cited_by_count":31,"area":null},{"id":"2409.09598","title":"Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy","created":"2024-09-15","cited_by_count":25,"area":null},{"id":"2311.09828","title":"AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages","created":"2023-11-16","cited_by_count":24,"area":null},{"id":"2310.19792","title":"The Eval4NLP 2023 Shared Task on Prompting Large Language Models as Explainable Metrics","created":"2023-10-30","cited_by_count":23,"area":null},{"id":"2501.18251","title":"How to Select Datapoints for Efficient Human Evaluation of NLG Models?","created":"2025-01-30","cited_by_count":23,"area":null},{"id":"2409.14335","title":"MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation Evaluators","created":"2024-09-22","cited_by_count":22,"area":null},{"id":"2408.13831","title":"Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In!","created":"2024-08-25","cited_by_count":21,"area":null},{"id":"2409.18472","title":"URIEL+: Enhancing Linguistic Inclusion and Usability in a Typological and Multilingual Knowledge Base","created":"2024-09-27","cited_by_count":21,"area":null},{"id":"2501.15595","title":"SedarEval: Automated Evaluation using Self-Adaptive Rubrics","created":"2025-01-26","cited_by_count":19,"area":null},{"id":"2401.06568","title":"Lost in the Source Language: How Large Language Models Evaluate the Quality of Machine Translation","created":"2024-01-12","cited_by_count":16,"area":null},{"id":"2406.18528","title":"PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluation","created":"2024-06-26","cited_by_count":16,"area":null},{"id":"2305.11806","title":"The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics","created":"2023-05-19","cited_by_count":15,"area":null},{"id":"2506.19571","title":"Has Machine Translation Evaluation Achieved Human Parity? The Human Reference and the Limits of Progress","created":"2025-06-24","cited_by_count":10,"area":null},{"id":"2410.09644","title":"Adapters for Altering LLM Vocabularies: What Languages Benefit the Most?","created":"2024-10-12","cited_by_count":9,"area":null},{"id":"2402.10979","title":"SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs","created":"2024-02-15","cited_by_count":8,"area":null},{"id":"2412.07096","title":"QAPyramid: Fine-grained Evaluation of Content Selection for Text Summarization","created":"2024-12-10","cited_by_count":8,"area":null},{"id":"2204.13692","title":"NMTScore: A Multilingual Analysis of Translation-based Text Similarity Measures","created":"2022-04-28","cited_by_count":6,"area":null},{"id":"2205.01416","title":"Exact Paired-Permutation Testing for Structured Test Statistics","created":"2022-05-03","cited_by_count":6,"area":null},{"id":"2211.12118","title":"HaRiM$^+$: Evaluating Summary Quality with Hallucination Risk","created":"2022-11-22","cited_by_count":6,"area":null},{"id":"2305.14548","title":"Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarization","created":"2023-05-23","cited_by_count":6,"area":null},{"id":"2404.19007","title":"How Did We Get Here? Summarizing Conversation Dynamics","created":"2024-04-29","cited_by_count":6,"area":null},{"id":"2508.10175","title":"Estimating Machine Translation Difficulty","created":"2025-08-13","cited_by_count":6,"area":null},{"id":"2510.13494","title":"LiteraryQA: Towards Effective Evaluation of Long-document Narrative QA","created":"2025-10-15","cited_by_count":6,"area":null},{"id":"2209.06517","title":"How to Find Strong Summary Coherence Measures? A Toolbox and a Comparative Study for Summary Coherence Measure Evaluation","created":"2022-09-14","cited_by_count":4,"area":null},{"id":"2303.15422","title":"KPEval: Towards Fine-Grained Semantic-Based Keyphrase Evaluation","created":"2023-03-27","cited_by_count":4,"area":null},{"id":"2305.13309","title":"Evaluating Factual Consistency of Texts with Semantic Role Labeling","created":"2023-05-22","cited_by_count":4,"area":null},{"id":"2410.16834","title":"Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation","created":"2024-10-22","cited_by_count":4,"area":null},{"id":"2311.02069","title":"Grounded Intuition of GPT-Vision's Abilities with Scientific Images","created":"2023-11-03","cited_by_count":3,"area":null},{"id":"2403.02674","title":"Revisiting Meta-evaluation for Grammatical Error Correction","created":"2024-03-05","cited_by_count":3,"area":null},{"id":"2204.10206","title":"Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics","created":"2022-04-21","cited_by_count":2,"area":null},{"id":"2402.06973","title":"Event-Keyed Summarization","created":"2024-02-10","cited_by_count":2,"area":null},{"id":"2409.19507","title":"A Critical Look at Meta-evaluating Summarisation Evaluation Metrics","created":"2024-09-29","cited_by_count":2,"area":null},{"id":"2412.02968","title":"How Many Ratings per Item are Necessary for Reliable Significance Testing?","created":"2024-12-04","cited_by_count":2,"area":null},{"id":"2502.18282","title":"Better Aligned with Survey Respondents or Training Data? Unveiling Political Leanings of LLMs on U.S. Supreme Court Cases","created":"2025-02-25","cited_by_count":2,"area":null},{"id":"2109.08129","title":"Does Summary Evaluation Survive Translation to Other Languages?","created":"2021-09-16","cited_by_count":1,"area":null},{"id":"2301.07095","title":"On the State of German (Abstractive) Text Summarization","created":"2023-01-17","cited_by_count":1,"area":null},{"id":"2508.13816","title":"The illusion of a perfect metric: Why evaluating AI's words is harder than it looks","created":"2025-08-19","cited_by_count":1,"area":null},{"id":"2512.07540","title":"Minimum Bayes Risk Decoding for Error Span Detection in Reference-Free Automatic Machine Translation Evaluation","created":"2025-12-08","cited_by_count":1,"area":null},{"id":"2601.18006","title":"PEAR: Pairwise Evaluation for Automatic Relative Scoring in Machine Translation","created":"2026-01-25","cited_by_count":1,"area":null},{"id":"2608.26638","title":"Which Metrics Save the Most Human Annotation? Prediction-Powered Evaluation and Meta-Evaluation","created":"2026-08-27","cited_by_count":1,"area":null},{"id":"2212.10469","title":"BMX: Boosting Natural Language Generation Metrics with Explainability","created":"2022-12-20","cited_by_count":0,"area":null},{"id":"2305.02300","title":"Evaluating the Efficacy of Length-Controllable Machine Translation","created":"2023-05-03","cited_by_count":0,"area":null},{"id":"2312.00536","title":"Trained MT Metrics Learn to Cope with Machine-translated References","created":"2023-12-01","cited_by_count":0,"area":null},{"id":"2505.19392","title":"Simple and Effective Baselines for Code Summarisation Evaluation","created":"2025-05-26","cited_by_count":0,"area":null},{"id":"2510.20508","title":"Assessing the Political Fairness of Multilingual LLMs: A Case Study based on a 21-way Multiparallel EuroParl Dataset","created":"2025-10-23","cited_by_count":0,"area":null},{"id":"2603.12983","title":"Is Human Annotation Necessary? Iterative MBR Distillation for Error Span Detection in Machine Translation","created":"2026-03-13","cited_by_count":0,"area":null},{"id":"2607.07302","title":"Evaluating RAG Metrics in Applied Contexts: An Experiment, Its Findings and Its Limitations","created":"2026-07-08","cited_by_count":0,"area":null},{"id":"2608.03340","title":"Benchmarking the Benchmarks: Testing the Predictive Validity of Commonsense Benchmarks","created":"2026-08-04","cited_by_count":0,"area":null},{"id":"2609.05296","title":"LexFlip: A Dissociation Diagnostic for Legal Meaning Preservation Metrics","created":"2026-09-04","cited_by_count":0,"area":null},{"id":"2609.27787","title":"Ask Which, Not How Good: Sizing Benchmarks Scored by an LLM","created":"2026-08-17","cited_by_count":0,"area":null},{"id":"2610.19166","title":"Fantastic Metrics and How to Find Them: Meta-Evaluating Metrics for Multi-lingual Style-Personalized Generation","created":"2026-10-13","cited_by_count":0,"area":null}],"next_cursor":null}