{"list":"other","total":68,"rows":[{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"2303.16634","title":"G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment","created":"2023-03-29","cited_by_count":2276},{"id":"2411.15594","title":"A Survey on LLM-as-a-Judge","created":"2024-11-23","cited_by_count":1423},{"id":"2312.06674","title":"Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations","created":"2023-12-07","cited_by_count":1207},{"id":"2305.17926","title":"Large Language Models are not Fair Evaluators","created":"2023-05-29","cited_by_count":1085},{"id":"1810.03993","title":"Model Cards for Model Reporting","created":"2018-10-05","cited_by_count":1080},{"id":"2302.00093","title":"Large Language Models Can Be Easily Distracted by Irrelevant Context","created":"2023-01-31","cited_by_count":841},{"id":"2305.01937","title":"Can Large Language Models Be an Alternative to Human Evaluations?","created":"2023-05-03","cited_by_count":734},{"id":"2404.13076","title":"LLM Evaluators Recognize and Favor Their Own Generations","created":"2024-04-15","cited_by_count":686},{"id":"2309.00267","title":"RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedback","created":"2023-09-01","cited_by_count":625},{"id":"2309.03882","title":"Large Language Models Are Not Robust Multiple Choice Selectors","created":"2023-09-07","cited_by_count":486},{"id":"2412.05579","title":"LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods","created":"2024-12-07","cited_by_count":465},{"id":"2303.04048","title":"Is ChatGPT a Good NLG Evaluator? A Preliminary Study","created":"2023-03-07","cited_by_count":422},{"id":"2410.02736","title":"Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge","created":"2024-10-03","cited_by_count":368},{"id":"2302.04166","title":"GPTScore: Evaluate as You Desire","created":"2023-02-08","cited_by_count":361},{"id":"2402.10669","title":"Humans or LLMs as the Judge? A Study on Judgement Biases","created":"2024-02-16","cited_by_count":323},{"id":"2003.12206","title":"Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)","created":"2020-03-27","cited_by_count":322},{"id":"1912.05511","title":"Measurement and Fairness","created":"2019-12-11","cited_by_count":308},{"id":"2107.00061","title":"All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text","created":"2021-06-30","cited_by_count":287},{"id":"2406.14598","title":"SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal","created":"2024-06-20","cited_by_count":240},{"id":"2302.07736","title":"Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speech","created":"2023-02-11","cited_by_count":166},{"id":"2309.17012","title":"Benchmarking Cognitive Biases in Large Language Models as Evaluators","created":"2023-09-29","cited_by_count":150},{"id":"2404.16019","title":"The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models","created":"2024-04-24","cited_by_count":144},{"id":"2110.05699","title":"On Releasing Annotator-Level Labels and Information in Datasets","created":"2021-10-12","cited_by_count":126},{"id":"2402.14016","title":"Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessment","created":"2024-02-21","cited_by_count":126},{"id":"2502.01534","title":"Preference Leakage: A Contamination Problem in LLM-as-a-judge","created":"2025-02-03","cited_by_count":125},{"id":"2507.02825","title":"Establishing Best Practices for Building Rigorous Agentic Benchmarks","created":"2025-07-03","cited_by_count":102},{"id":"2305.06626","title":"When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Tasks","created":"2023-05-11","cited_by_count":90},{"id":"2311.09766","title":"LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores","created":"2023-11-16","cited_by_count":90},{"id":"2108.04308","title":"Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development","created":"2021-08-09","cited_by_count":85},{"id":"2407.00908","title":"FineSurE: Fine-grained Summarization Evaluation using LLMs","created":"2024-07-01","cited_by_count":83},{"id":"1808.08858","title":"Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervised","created":"2018-08-27","cited_by_count":75},{"id":"2310.01432","title":"Split and Merge: Aligning Position Biases in LLM-based Evaluators","created":"2023-09-29","cited_by_count":72},{"id":"2307.07889","title":"LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models","created":"2023-07-15","cited_by_count":71},{"id":"2303.15078","title":"Large Language Models are Diverse Role-Players for Summarization Evaluation","created":"2023-03-27","cited_by_count":62},{"id":"2206.08931","title":"CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotation","created":"2022-06-09","cited_by_count":59},{"id":"2310.05910","title":"SALMON: Self-Alignment with Instructable Reward Models","created":"2023-10-09","cited_by_count":55},{"id":"2310.12558","title":"Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrong","created":"2023-10-19","cited_by_count":51},{"id":"2509.08825","title":"Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotation","created":"2025-09-10","cited_by_count":50},{"id":"2305.14889","title":"Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory","created":"2023-05-24","cited_by_count":43},{"id":"2307.08153","title":"Analyzing Dataset Annotation Quality Management in the Wild","created":"2023-07-16","cited_by_count":41},{"id":"2508.18076","title":"Neither Valid nor Reliable? Investigating the Use of LLMs as Judges","created":"2025-08-25","cited_by_count":39},{"id":"2506.09443","title":"LLMs Cannot Reliably Judge (Yet?): A Comprehensive Assessment on the Robustness of LLM-as-a-Judge","created":"2025-06-11","cited_by_count":37},{"id":"2402.05129","title":"Best Practices for Text Annotation with Large Language Models","created":"2024-02-05","cited_by_count":36},{"id":"2402.12055","title":"Are LLM-based Evaluators Confusing NLG Quality Criteria?","created":"2024-02-19","cited_by_count":36},{"id":"2409.15268","title":"Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking","created":"2024-09-23","cited_by_count":35},{"id":"2410.15393","title":"CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-Judges","created":"2024-10-20","cited_by_count":34},{"id":"2305.04417","title":"Unlocking Practical Applications in Legal Domain: Evaluation of GPT for Zero-Shot Semantic Annotation of Legal Texts","created":"2023-05-08","cited_by_count":33},{"id":"2205.06828","title":"Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications","created":"2022-05-13","cited_by_count":32},{"id":"2503.10084","title":"Why Prompt Design Matters and Works: A Complexity Analysis of Prompt Search Space in LLMs","created":"2025-03-13","cited_by_count":31},{"id":"2406.08723","title":"ECBD: Evidence-Centered Benchmark Design for NLP","created":"2024-06-13","cited_by_count":28},{"id":"2007.15620","title":"Neural Modeling for Named Entities and Morphology (NEMO^2)","created":"2020-07-30","cited_by_count":26},{"id":"2503.05965","title":"Validating LLM-as-a-Judge Systems under Rating Indeterminacy","created":"2025-03-07","cited_by_count":25},{"id":"2512.16041","title":"Are We on the Right Way to Assessing LLM-as-a-Judge?","created":"2025-12-17","cited_by_count":24},{"id":"2411.10939","title":"Evaluating Generative AI Systems is a Social Science Measurement Challenge","created":"2024-11-17","cited_by_count":23},{"id":"2311.06237","title":"Summon a Demon and Bind it: A Grounded Theory of LLM Red Teaming","created":"2023-11-10","cited_by_count":21},{"id":"2306.09562","title":"Reproducibility in NLP: What Have We Learned from the Checklist?","created":"2023-06-16","cited_by_count":18},{"id":"2405.02703","title":"Machine Learning Data Practices through a Data Curation Lens: An Evaluation Framework","created":"2024-05-04","cited_by_count":18},{"id":"2403.13213","title":"From Representational Harms to Quality-of-Service Harms: A Case Study on Llama 2 Safety Safeguards","created":"2024-03-20","cited_by_count":17},{"id":"2406.00020","title":"Harmful Speech Detection by Language Models Exhibits Gender-Queer Dialect Bias","created":"2024-05-23","cited_by_count":16},{"id":"2504.19076","title":"LLM-Evaluation Tropes: Perspectives on the Validity of LLM-Evaluations","created":"2025-04-27","cited_by_count":15},{"id":"2203.07031","title":"Model Positionality and Computational Reflexivity: Promoting Reflexivity in Data Science","created":"2022-03-08","cited_by_count":13},{"id":"2503.01742","title":"Building Safe GenAI Applications: An End-to-End Overview of Red Teaming for Large Language Models","created":"2025-03-03","cited_by_count":11},{"id":"2411.08243","title":"Beyond the Safety Bundle: Auditing the Helpful and Harmless Dataset","created":"2024-11-12","cited_by_count":8},{"id":"2507.05538","title":"Red Teaming AI Red Teaming","created":"2025-07-07","cited_by_count":3},{"id":"2507.06774","title":"Checklist Engineering Empowers Multilingual LLM Judges","created":"2025-07-09","cited_by_count":3},{"id":"2506.05376","title":"A Red Teaming Roadmap Towards System-Level Safety","created":"2025-05-30","cited_by_count":2}],"next_cursor":null}