{"list":"other","total":64,"rows":[{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2505.09388","title":"Qwen3 Technical Report","created":"2025-05-14","cited_by_count":8820},{"id":"2306.05685","title":"Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena","created":"2023-06-09","cited_by_count":8626},{"id":"2009.03300","title":"Measuring Massive Multitask Language Understanding","created":"2020-09-07","cited_by_count":7963},{"id":"1803.05457","title":"Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge","created":"2018-03-14","cited_by_count":4886},{"id":"1905.07830","title":"HellaSwag: Can a Machine Really Finish Your Sentence?","created":"2019-05-19","cited_by_count":4100},{"id":"2109.07958","title":"TruthfulQA: Measuring How Models Mimic Human Falsehoods","created":"2021-09-08","cited_by_count":2975},{"id":"1911.11641","title":"PIQA: Reasoning about Physical Commonsense in Natural Language","created":"2019-11-26","cited_by_count":2883},{"id":"2311.12022","title":"GPQA: A Graduate-Level Google-Proof Q&A Benchmark","created":"2023-11-20","cited_by_count":2879},{"id":"1809.02789","title":"Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering","created":"2018-09-08","cited_by_count":2164},{"id":"2406.01574","title":"MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark","created":"2024-06-03","cited_by_count":1848},{"id":"2503.19786","title":"Gemma 3 Technical Report","created":"2025-03-25","cited_by_count":1824},{"id":"1811.00937","title":"CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge","created":"2018-11-02","cited_by_count":1822},{"id":"1903.00161","title":"DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs","created":"2019-03-01","cited_by_count":903},{"id":"2304.06364","title":"AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models","created":"2023-04-13","cited_by_count":716},{"id":"2402.00159","title":"Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research","created":"2024-01-31","cited_by_count":483},{"id":"2306.09212","title":"CMMLU: Measuring massive multitask language understanding in Chinese","created":"2023-06-15","cited_by_count":449},{"id":"2405.01535","title":"Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models","created":"2024-05-02","cited_by_count":446},{"id":"2310.18018","title":"NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark","created":"2023-10-27","cited_by_count":348},{"id":"2402.14992","title":"tinyBenchmarks: evaluating LLMs with fewer examples","created":"2024-02-22","cited_by_count":310},{"id":"2401.03065","title":"CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution","created":"2024-01-05","cited_by_count":300},{"id":"1805.01042","title":"Hypothesis Only Baselines in Natural Language Inference","created":"2018-05-02","cited_by_count":295},{"id":"2406.11695","title":"Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs","created":"2024-06-17","cited_by_count":291},{"id":"1910.11473","title":"QASC: A Dataset for Question Answering via Sentence Composition","created":"2019-10-25","cited_by_count":252},{"id":"2406.18403","title":"LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks","created":"2024-06-26","cited_by_count":243},{"id":"2402.03927","title":"Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs","created":"2024-02-06","cited_by_count":229},{"id":"2210.12353","title":"Leveraging Large Language Models for Multiple Choice Question Answering","created":"2022-10-22","cited_by_count":203},{"id":"2412.03304","title":"Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation","created":"2024-12-04","cited_by_count":191},{"id":"2401.17377","title":"Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens","created":"2024-01-30","cited_by_count":153},{"id":"2402.01781","title":"When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards","created":"2024-02-01","cited_by_count":137},{"id":"2310.20707","title":"What's In My Big Data?","created":"2023-10-31","cited_by_count":129},{"id":"2402.11548","title":"KMMLU: Measuring Massive Multitask Language Understanding in Korean","created":"2024-02-18","cited_by_count":91},{"id":"2402.12483","title":"Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?","created":"2024-02-19","cited_by_count":71},{"id":"2106.00840","title":"Comparing Test Sets with Item Response Theory","created":"2021-06-01","cited_by_count":57},{"id":"2510.21652","title":"AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite","created":"2025-10-24","cited_by_count":53},{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52},{"id":"2306.10512","title":"Position: AI Evaluation Should Learn from How We Test Humans","created":"2023-06-18","cited_by_count":36},{"id":"2407.16711","title":"Benchmarks as Microscopes: A Call for Model Metrology","created":"2024-07-22","cited_by_count":35},{"id":"2503.14996","title":"Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering","created":"2025-03-19","cited_by_count":28},{"id":"2407.13696","title":"Do These LLM Benchmarks Agree? Fixing Benchmark Evaluation with BenchBench","created":"2024-07-18","cited_by_count":27},{"id":"2410.18966","title":"Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions","created":"2024-10-24","cited_by_count":26},{"id":"2307.08161","title":"Assessing the Quality of Multiple-Choice Questions Using GPT-4 and Rule-Based Methods","created":"2023-07-16","cited_by_count":24},{"id":"2308.03234","title":"Automated Distractor and Feedback Generation for Math Multiple-choice Questions via In-context Learning","created":"2023-08-07","cited_by_count":24},{"id":"2209.11830","title":"Multiple-Choice Question Generation: Towards an Automated Assessment Framework","created":"2022-09-23","cited_by_count":23},{"id":"2501.18251","title":"How to Select Datapoints for Efficient Human Evaluation of NLG Models?","created":"2025-01-30","cited_by_count":23},{"id":"2410.20245","title":"Improving Model Evaluation using SMART Filtering of Benchmark Datasets","created":"2024-10-26","cited_by_count":21},{"id":"2410.18889","title":"Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model Performance","created":"2024-10-24","cited_by_count":20},{"id":"1912.13337","title":"What Does My QA Model Know? Devising Controlled Probes using Expert Knowledge","created":"2019-12-31","cited_by_count":19},{"id":"2506.12229","title":"Infini-gram mini: Exact n-gram Search at the Internet Scale with FM-Index","created":"2025-06-13","cited_by_count":14},{"id":"2410.10854","title":"Plausibly Problematic Questions in Multiple-Choice Benchmarks for Commonsense Reasoning","created":"2024-10-06","cited_by_count":13},{"id":"2410.15512","title":"Reverse Question Answering: Can an LLM Write a Question so Hard (or Bad) that it Can't Answer?","created":"2024-10-20","cited_by_count":13},{"id":"2311.07532","title":"It's Not Easy Being Wrong: Large Language Models Struggle with Process of Elimination Reasoning","created":"2023-11-13","cited_by_count":12},{"id":"2407.01992","title":"Is Your Large Language Model Knowledgeable or a Choices-Only Cheater?","created":"2024-07-02","cited_by_count":12},{"id":"2502.18316","title":"WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging","created":"2025-02-25","cited_by_count":11},{"id":"2504.07825","title":"Who Benchmarks the Benchmarks? Towards Comprehensive Evaluation of Commonsense Reasoning Benchmarks","created":"2025-04-10","cited_by_count":11},{"id":"2405.20529","title":"An Automatic Question Usability Evaluation Toolkit","created":"2024-05-30","cited_by_count":10},{"id":"2501.13125","title":"Generating Plausible Distractors for Multiple-Choice Questions via Student Choice Prediction","created":"2025-01-21","cited_by_count":8},{"id":"2406.16342","title":"Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness","created":"2024-06-24","cited_by_count":7},{"id":"2505.01903","title":"LookAlike: Consistent Distractor Generation in Math MCQs","created":"2025-05-03","cited_by_count":7},{"id":"2311.18353","title":"Evaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehension","created":"2023-11-30","cited_by_count":6},{"id":"2309.12546","title":"Automatic Answerability Evaluation for Question Generation","created":"2023-09-22","cited_by_count":5},{"id":"2402.10554","title":"Disordered-DABS: A Benchmark for Dynamic Aspect-Based Summarization in Disordered Texts","created":"2024-02-16","cited_by_count":5},{"id":"2510.07761","title":"Test-Time Reasoners Are Strategic Multiple-Choice Test-Takers","created":"2025-10-09","cited_by_count":3},{"id":"1411.1629","title":"The Limitations of Standardized Science Tests as Benchmarks for Artificial Intelligence Research: Position Paper","created":"2014-11-06","cited_by_count":1}],"next_cursor":null}