{"list":"other","total":84,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"2306.05685","title":"Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena","created":"2023-06-09","cited_by_count":8626},{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"2303.16634","title":"G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment","created":"2023-03-29","cited_by_count":2276},{"id":"2402.04249","title":"HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal","created":"2024-02-06","cited_by_count":1429},{"id":"2312.06674","title":"Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations","created":"2023-12-07","cited_by_count":1207},{"id":"2403.04132","title":"Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference","created":"2024-03-07","cited_by_count":1184},{"id":"2305.11206","title":"LIMA: Less Is More for Alignment","created":"2023-05-18","cited_by_count":1100},{"id":"2305.17926","title":"Large Language Models are not Fair Evaluators","created":"2023-05-29","cited_by_count":1085},{"id":"2202.03286","title":"Red Teaming Language Models with Language Models","created":"2022-02-07","cited_by_count":1026},{"id":"2303.15056","title":"ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks","created":"2023-03-27","cited_by_count":870},{"id":"2305.01937","title":"Can Large Language Models Be an Alternative to Human Evaluations?","created":"2023-05-03","cited_by_count":734},{"id":"2404.13076","title":"LLM Evaluators Recognize and Favor Their Own Generations","created":"2024-04-15","cited_by_count":686},{"id":"2007.12626","title":"SummEval: Re-evaluating Summarization Evaluation","created":"2020-07-24","cited_by_count":674},{"id":"2309.00770","title":"Bias and Fairness in Large Language Models: A Survey","created":"2023-09-02","cited_by_count":639},{"id":"2308.01263","title":"XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models","created":"2023-08-02","cited_by_count":505},{"id":"2406.11939","title":"From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline","created":"2024-06-17","cited_by_count":500},{"id":"2406.18495","title":"WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs","created":"2024-06-26","cited_by_count":496},{"id":"2411.16594","title":"From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge","created":"2024-11-25","cited_by_count":494},{"id":"2309.03882","title":"Large Language Models Are Not Robust Multiple Choice Selectors","created":"2023-09-07","cited_by_count":486},{"id":"2412.05579","title":"LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods","created":"2024-12-07","cited_by_count":465},{"id":"2303.04048","title":"Is ChatGPT a Good NLG Evaluator? A Preliminary Study","created":"2023-03-07","cited_by_count":422},{"id":"2410.02736","title":"Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge","created":"2024-10-03","cited_by_count":368},{"id":"2404.18796","title":"Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models","created":"2024-04-29","cited_by_count":326},{"id":"2402.10669","title":"Humans or LLMs as the Judge? A Study on Judgement Biases","created":"2024-02-16","cited_by_count":323},{"id":"2305.03047","title":"Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision","created":"2023-05-04","cited_by_count":318},{"id":"2305.08845","title":"Large Language Models are Zero-Shot Rankers for Recommender Systems","created":"2023-05-15","cited_by_count":309},{"id":"1912.05511","title":"Measurement and Fairness","created":"2019-12-11","cited_by_count":308},{"id":"2107.00061","title":"All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text","created":"2021-06-30","cited_by_count":287},{"id":"2312.01552","title":"The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning","created":"2023-12-04","cited_by_count":257},{"id":"2406.18403","title":"LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks","created":"2024-06-26","cited_by_count":243},{"id":"2407.21772","title":"ShieldGemma: Generative AI Content Moderation Based on Gemma","created":"2024-07-31","cited_by_count":243},{"id":"2402.05044","title":"SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models","created":"2024-02-07","cited_by_count":228},{"id":"2105.04054","title":"Societal Biases in Language Generation: Progress and Challenges","created":"2021-05-10","cited_by_count":202},{"id":"2005.00456","title":"USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation","created":"2020-05-01","cited_by_count":188},{"id":"2308.08493","title":"Time Travel in LLMs: Tracing Data Contamination in Large Language Models","created":"2023-08-16","cited_by_count":177},{"id":"2303.16854","title":"AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators","created":"2023-03-29","cited_by_count":172},{"id":"2310.03003","title":"From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference","created":"2023-10-04","cited_by_count":170},{"id":"2310.05470","title":"Generative Judge for Evaluating Alignment","created":"2023-10-09","cited_by_count":169},{"id":"2302.07736","title":"Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speech","created":"2023-02-11","cited_by_count":166},{"id":"2309.17012","title":"Benchmarking Cognitive Biases in Large Language Models as Evaluators","created":"2023-09-29","cited_by_count":150},{"id":"2010.07100","title":"Re-evaluating Evaluation in Text Summarization","created":"2020-10-14","cited_by_count":145},{"id":"2403.17710","title":"Optimization-based Prompt Injection Attack to LLM-as-a-Judge","created":"2024-03-26","cited_by_count":143},{"id":"2311.09783","title":"Investigating Data Contamination in Modern Benchmarks for Large Language Models","created":"2023-11-16","cited_by_count":138},{"id":"2402.01781","title":"When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards","created":"2024-02-01","cited_by_count":137},{"id":"2501.09004","title":"Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrails","created":"2025-01-15","cited_by_count":132},{"id":"2402.14016","title":"Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessment","created":"2024-02-21","cited_by_count":126},{"id":"2502.01534","title":"Preference Leakage: A Contamination Problem in LLM-as-a-judge","created":"2025-02-03","cited_by_count":125},{"id":"2402.15938","title":"Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models","created":"2024-02-24","cited_by_count":122},{"id":"2402.04614","title":"Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Models","created":"2024-02-07","cited_by_count":105},{"id":"2305.06626","title":"When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Tasks","created":"2023-05-11","cited_by_count":90},{"id":"2311.09766","title":"LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores","created":"2023-11-16","cited_by_count":90},{"id":"2304.10145","title":"Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Tasks","created":"2023-04-20","cited_by_count":89},{"id":"2310.01432","title":"Split and Merge: Aligning Position Biases in LLM-based Evaluators","created":"2023-09-29","cited_by_count":72},{"id":"2307.07889","title":"LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models","created":"2023-07-15","cited_by_count":71},{"id":"2205.00501","title":"Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation","created":"2022-05-01","cited_by_count":69},{"id":"2311.18702","title":"CritiqueLLM: Towards an Informative Critique Generation Model for Evaluation of Large Language Model Generation","created":"2023-11-30","cited_by_count":66},{"id":"2504.20879","title":"The Leaderboard Illusion","created":"2025-04-29","cited_by_count":66},{"id":"2310.05910","title":"SALMON: Self-Alignment with Instructable Reward Models","created":"2023-10-09","cited_by_count":55},{"id":"2310.12558","title":"Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrong","created":"2023-10-19","cited_by_count":51},{"id":"2210.07626","title":"BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation","created":"2022-10-14","cited_by_count":48},{"id":"2007.04792","title":"Targeting the Benchmark: On Methodology in Current Natural Language Processing Research","created":"2020-07-07","cited_by_count":45},{"id":"2410.07137","title":"Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates","created":"2024-10-09","cited_by_count":45},{"id":"2305.14889","title":"Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory","created":"2023-05-24","cited_by_count":43},{"id":"2402.16795","title":"If in a Crowdsourced Data Annotation Pipeline, a GPT-4","created":"2024-02-26","cited_by_count":38},{"id":"2402.12055","title":"Are LLM-based Evaluators Confusing NLG Quality Criteria?","created":"2024-02-19","cited_by_count":36},{"id":"2409.15268","title":"Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking","created":"2024-09-23","cited_by_count":35},{"id":"2410.15393","title":"CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-Judges","created":"2024-10-20","cited_by_count":34},{"id":"2205.06828","title":"Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications","created":"2022-05-13","cited_by_count":32},{"id":"2410.03775","title":"Beyond correlation: The Impact of Human Uncertainty in Measuring the Effectiveness of Automatic Evaluation and LLM-as-a-Judge","created":"2024-10-03","cited_by_count":31},{"id":"2407.08188","title":"Position: Measure Dataset Diversity, Don't Just Claim It","created":"2024-07-11","cited_by_count":26},{"id":"2503.09347","title":"Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to Artifacts","created":"2025-03-12","cited_by_count":26},{"id":"2503.04474","title":"Know Thy Judge: On the Robustness Meta-Evaluation of LLM Safety Judges","created":"2025-03-06","cited_by_count":24},{"id":"2411.10939","title":"Evaluating Generative AI Systems is a Social Science Measurement Challenge","created":"2024-11-17","cited_by_count":23},{"id":"2402.11296","title":"Dissecting Human and LLM Preferences","created":"2024-02-17","cited_by_count":17},{"id":"2403.13213","title":"From Representational Harms to Quality-of-Service Harms: A Case Study on Llama 2 Safety Safeguards","created":"2024-03-20","cited_by_count":17},{"id":"2408.14141","title":"Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?","created":"2024-08-26","cited_by_count":13},{"id":"2309.01288","title":"How Crowd Worker Factors Influence Subjective Annotations: A Study of Tagging Misogynistic Hate Speech in Tweets","created":"2023-09-03","cited_by_count":10},{"id":"2407.16318","title":"PrimeGuard: Safe and Helpful LLMs through Tuning-Free Routing","created":"2024-07-23","cited_by_count":10},{"id":"2411.08243","title":"Beyond the Safety Bundle: Auditing the Helpful and Harmless Dataset","created":"2024-11-12","cited_by_count":8},{"id":"2503.16458","title":"Users Favor LLM-Generated Content -- Until They Know It's AI","created":"2025-02-23","cited_by_count":4}],"next_cursor":null}