{"list":"other","total":76,"rows":[{"id":"2403.04132","title":"Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference","created":"2024-03-07","cited_by_count":1184},{"id":"2212.09251","title":"Discovering Language Model Behaviors with Model-Written Evaluations","created":"2022-12-19","cited_by_count":836},{"id":"2302.09664","title":"Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation","created":"2023-02-19","cited_by_count":819},{"id":"2310.11324","title":"Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting","created":"2023-10-17","cited_by_count":817},{"id":"2404.13076","title":"LLM Evaluators Recognize and Favor Their Own Generations","created":"2024-04-15","cited_by_count":686},{"id":"2402.07927","title":"A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications","created":"2024-02-05","cited_by_count":431},{"id":"2305.00050","title":"Causal Reasoning and Large Language Models: Opening a New Frontier for Causality","created":"2023-04-28","cited_by_count":353},{"id":"2111.15366","title":"AI and the Everything in the Whole Wide World Benchmark","created":"2021-11-26","cited_by_count":349},{"id":"2310.18018","title":"NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark","created":"2023-10-27","cited_by_count":348},{"id":"2308.11462","title":"LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models","created":"2023-08-20","cited_by_count":336},{"id":"2309.10691","title":"MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback","created":"2023-09-19","cited_by_count":297},{"id":"2402.06782","title":"Debating with More Persuasive LLMs Leads to More Truthful Answers","created":"2024-02-09","cited_by_count":266},{"id":"2303.05398","title":"MathPrompter: Mathematical Reasoning using Large Language Models","created":"2023-03-04","cited_by_count":236},{"id":"2311.01964","title":"Don't Make Your LLM an Evaluation Benchmark Cheater","created":"2023-11-03","cited_by_count":194},{"id":"2501.17399","title":"MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs","created":"2025-01-29","cited_by_count":180},{"id":"2405.14782","title":"Lessons from the Trenches on Reproducible Evaluation of Language Models","created":"2024-05-23","cited_by_count":179},{"id":"2305.15324","title":"Model evaluation for extreme risks","created":"2023-05-24","cited_by_count":177},{"id":"2306.04181","title":"Benchmarking Foundation Models with Language-Model-as-an-Examiner","created":"2023-06-07","cited_by_count":172},{"id":"2310.11986","title":"Sociotechnical Safety Evaluation of Generative AI Systems","created":"2023-10-18","cited_by_count":157},{"id":"2202.06935","title":"Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text","created":"2022-02-14","cited_by_count":155},{"id":"2411.00640","title":"Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations","created":"2024-11-01","cited_by_count":148},{"id":"2306.05836","title":"Can Large Language Models Infer Causation from Correlation?","created":"2023-06-09","cited_by_count":146},{"id":"2305.10160","title":"Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks","created":"2023-05-17","cited_by_count":142},{"id":"2302.08500","title":"Auditing large language models: a three-layered approach","created":"2023-02-16","cited_by_count":137},{"id":"2401.14446","title":"Black-Box Access is Insufficient for Rigorous AI Audits","created":"2024-01-25","cited_by_count":126},{"id":"2402.15938","title":"Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models","created":"2024-02-24","cited_by_count":122},{"id":"2411.12990","title":"BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices","created":"2024-11-20","cited_by_count":114},{"id":"2312.04350","title":"CLadder: Assessing Causal Reasoning in Language Models","created":"2023-12-07","cited_by_count":107},{"id":"2307.16513","title":"Deception Abilities Emerged in Large Language Models","created":"2023-07-31","cited_by_count":101},{"id":"2402.19464","title":"Curiosity-driven Red-teaming for Large Language Models","created":"2024-02-29","cited_by_count":88},{"id":"2407.04069","title":"A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations","created":"2024-07-04","cited_by_count":85},{"id":"2405.12205","title":"Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solving","created":"2024-05-20","cited_by_count":84},{"id":"2402.01383","title":"LLM-based NLG Evaluation: Current Status and Challenges","created":"2024-02-02","cited_by_count":73},{"id":"2402.18041","title":"Datasets for Large Language Models: A Comprehensive Survey","created":"2024-02-28","cited_by_count":71},{"id":"2402.09880","title":"Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence","created":"2024-02-15","cited_by_count":68},{"id":"1901.08644","title":"Ablation Studies in Artificial Neural Networks","created":"2019-01-24","cited_by_count":60},{"id":"2502.06559","title":"Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation","created":"2025-02-10","cited_by_count":60},{"id":"2404.00629","title":"Against The Achilles' Heel: A Survey on Red Teaming for Generative Models","created":"2024-03-31","cited_by_count":59},{"id":"2106.00840","title":"Comparing Test Sets with Item Response Theory","created":"2021-06-01","cited_by_count":57},{"id":"2306.03100","title":"Rethinking Model Evaluation as Narrowing the Socio-Technical Gap","created":"2023-06-01","cited_by_count":56},{"id":"2405.18540","title":"Learning diverse attacks on large language models for robust red-teaming and safety tuning","created":"2024-05-28","cited_by_count":54},{"id":"2210.12563","title":"On the Limitations of Reference-Free Evaluations of Generated Text","created":"2022-10-22","cited_by_count":52},{"id":"2007.04792","title":"Targeting the Benchmark: On Methodology in Current Natural Language Processing Research","created":"2020-07-07","cited_by_count":45},{"id":"2503.05336","title":"Toward an Evaluation Science for Generative AI Systems","created":"2025-03-07","cited_by_count":45},{"id":"2401.07103","title":"Leveraging Large Language Models for NLG Evaluation: Advances and Challenges","created":"2024-01-13","cited_by_count":37},{"id":"2502.06215","title":"LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks","created":"2025-02-10","cited_by_count":37},{"id":"2402.09177","title":"Leveraging the Context through Multi-Round Interactions for Jailbreaking Attacks","created":"2024-02-14","cited_by_count":36},{"id":"2205.06828","title":"Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications","created":"2022-05-13","cited_by_count":32},{"id":"2302.14035","title":"The ROOTS Search Tool: Data Transparency for LLMs","created":"2023-02-27","cited_by_count":31},{"id":"2312.07398","title":"LLMEval: A Preliminary Study on How to Evaluate Large Language Models","created":"2023-12-12","cited_by_count":23},{"id":"2406.11044","title":"Evaluating the Performance of Large Language Models via Debates","created":"2024-06-16","cited_by_count":19},{"id":"2501.07458","title":"Understanding and Benchmarking Artificial Intelligence: OpenAI's o3 Is Not AGI","created":"2025-01-13","cited_by_count":19},{"id":"2108.00308","title":"Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers","created":"2021-07-31","cited_by_count":18},{"id":"2404.09135","title":"Unveiling LLM Evaluation Focused on Metrics: Challenges and Solutions","created":"2024-04-14","cited_by_count":18},{"id":"2404.01343","title":"CHOPS: CHat with custOmer Profile Systems for Customer Service with LLMs","created":"2024-03-31","cited_by_count":17},{"id":"2410.08385","title":"Language model developers should report train-test overlap","created":"2024-10-10","cited_by_count":16},{"id":"2305.10236","title":"A quantitative study of NLP approaches to question difficulty estimation","created":"2023-05-17","cited_by_count":13},{"id":"2404.12349","title":"Evaluating AI for Law: Bridging the Gap with Open-Source Solutions","created":"2024-04-18","cited_by_count":11},{"id":"2407.09221","title":"Evaluating AI Evaluation: Perils and Prospects","created":"2024-07-12","cited_by_count":11},{"id":"2502.15620","title":"Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture","created":"2025-02-21","cited_by_count":11},{"id":"2404.01023","title":"Large Language Model Evaluation Via Multi AI Agents: Preliminary results","created":"2024-04-01","cited_by_count":10},{"id":"2405.08989","title":"What is it for a Machine Learning Model to Have a Capability?","created":"2024-05-14","cited_by_count":10},{"id":"2501.10711","title":"Code Benchmarks Should Prioritize Rigor, Reliability, and Reproducibility","created":"2025-01-18","cited_by_count":10},{"id":"2504.13839","title":"Audit Cards: Contextualizing AI Evaluations","created":"2025-04-18","cited_by_count":10},{"id":"2501.12011","title":"Reference-free Evaluation Metrics for Text Generation: A Survey","created":"2025-01-21","cited_by_count":9},{"id":"2404.05388","title":"An AI System Evaluation Framework for Advancing AI Safety: Terminology, Taxonomy, Lifecycle Mapping","created":"2024-04-08","cited_by_count":8},{"id":"2407.07786","title":"The Human Factor in AI Red Teaming: Perspectives from Social and Collaborative Computing","created":"2024-07-10","cited_by_count":8},{"id":"2505.21808","title":"AI Agent Governance: A Field Guide","created":"2025-05-27","cited_by_count":8},{"id":"2404.00021","title":"Evaluatology: The Science and Engineering of Evaluation","created":"2024-03-19","cited_by_count":6},{"id":"2403.15250","title":"Comprehensive Reassessment of Large-Scale Evaluation Outcomes in LLMs: A Multifaceted Statistical Approach","created":"2024-03-22","cited_by_count":5},{"id":"2406.07967","title":"Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling","created":"2024-06-12","cited_by_count":4},{"id":"2411.12820","title":"Declare and Justify: Explicit assumptions in AI evaluations are necessary for effective regulation","created":"2024-11-19","cited_by_count":4},{"id":"2506.08800","title":"Measuring Data Science Automation: A Survey of Evaluation Tools for AI Assistants and Agents","created":"2025-06-10","cited_by_count":4},{"id":"2408.10239","title":"A Conceptual Framework for Ethical Evaluation of Machine Learning Systems","created":"2024-08-05","cited_by_count":2},{"id":"2411.13808","title":"GPAI Evaluations Standards Taskforce: Towards Effective AI Governance","created":"2024-11-21","cited_by_count":2},{"id":"2411.12709","title":"Dimensions of Generative AI Evaluation Design","created":"2024-11-19","cited_by_count":1}],"next_cursor":null}