{"total":57,"rows":[{"id":"2402.14992","title":"tinyBenchmarks: evaluating LLMs with fewer examples","created":"2024-02-22","cited_by_count":310,"area":null},{"id":"2107.07002","title":"The Benchmark Lottery","created":"2021-07-14","cited_by_count":136,"area":null},{"id":"2405.17202","title":"Efficient multi-prompt evaluation of LLMs","created":"2024-05-27","cited_by_count":73,"area":null},{"id":"2406.10229","title":"Quantifying Variance in Evaluation Benchmarks","created":"2024-06-14","cited_by_count":54,"area":null},{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52,"area":null},{"id":"2306.10512","title":"Position: AI Evaluation Should Learn from How We Test Humans","created":"2023-06-18","cited_by_count":36,"area":null},{"id":"2509.11106","title":"Fluid Language Model Benchmarking","created":"2025-09-14","cited_by_count":35,"area":null},{"id":"2112.09062","title":"Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants","created":"2021-12-16","cited_by_count":31,"area":null},{"id":"2503.13335","title":"Reliable and Efficient Amortized Model-based Evaluation","created":"2025-03-17","cited_by_count":31,"area":"lr"},{"id":"2410.20245","title":"Improving Model Evaluation using SMART Filtering of Benchmark Datasets","created":"2024-10-26","cited_by_count":21,"area":null},{"id":"2203.01282","title":"py-irt: A Scalable Item Response Theory Library for Python","created":"2022-03-02","cited_by_count":19,"area":null},{"id":"2402.07891","title":"Label-Efficient Model Selection for Text Generation","created":"2024-02-12","cited_by_count":19,"area":null},{"id":"2203.03073","title":"ILDAE: Instance-Level Difficulty Analysis of Evaluation Data","created":"2022-03-07","cited_by_count":17,"area":null},{"id":"2406.14230","title":"Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing","created":"2024-06-20","cited_by_count":17,"area":null},{"id":"2111.08181","title":"Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair","created":"2021-11-16","cited_by_count":12,"area":null},{"id":"2502.10436","title":"MERGE$^3$: Efficient Evolutionary Merging on Consumer-grade GPUs","created":"2025-02-09","cited_by_count":10,"area":null},{"id":"2510.08730","title":"How Reliable is Language Model Micro-Benchmarking?","created":"2025-10-09","cited_by_count":9,"area":null},{"id":"2406.16342","title":"Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness","created":"2024-06-24","cited_by_count":7,"area":null},{"id":"2502.14445","title":"PredictaBoard: Benchmarking LLM Score Predictability","created":"2025-02-20","cited_by_count":7,"area":null},{"id":"2205.06203","title":"Predicting Human Psychometric Properties Using Computational Language Models","created":"2022-05-12","cited_by_count":5,"area":null},{"id":"2601.13885","title":"Confident Rankings with Fewer Items: Adaptive LLM Evaluation with Continuous Scores","created":"2026-01-20","cited_by_count":5,"area":null},{"id":"2602.06221","title":"BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks","created":"2026-02-05","cited_by_count":5,"area":null},{"id":"2202.12801","title":"On the data requirements of probing","created":"2022-02-25","cited_by_count":4,"area":null},{"id":"2407.01878","title":"Compare without Despair: Reliable Preference Evaluation with Generation Separability","created":"2024-07-02","cited_by_count":4,"area":null},{"id":"2505.21389","title":"AutoJudger: An Agent-Driven Framework for Efficient Benchmarking of MLLMs","created":"2025-05-27","cited_by_count":4,"area":"mllm"},{"id":"2607.15190","title":"Can We Trust Item Response Theory for AI Evaluation?","created":"2026-07-16","cited_by_count":4,"area":null},{"id":"2407.21227","title":"TaskEval: Assessing Difficulty of Code Generation Tasks for Large Language Models","created":"2024-07-30","cited_by_count":3,"area":null},{"id":"2605.25272","title":"AI Cartography: Mapping the Latent Landscape of AI Benchmark Ecosystems","created":"2026-05-24","cited_by_count":3,"area":null},{"id":"2605.30504","title":"Auditing LLM Benchmarks with Item Response Theory","created":"2026-05-28","cited_by_count":3,"area":null},{"id":"2304.06337","title":"Computational modeling of semantic change","created":"2023-04-13","cited_by_count":2,"area":null},{"id":"2309.00215","title":"Towards Addressing the Misalignment of Object Proposal Evaluation for Vision-Language Tasks via Semantic Grounding","created":"2023-09-01","cited_by_count":2,"area":null},{"id":"2409.00202","title":"The creative psychometric item generator: a framework for item generation and validation using large language models","created":"2024-08-30","cited_by_count":2,"area":null},{"id":"2511.14531","title":"LiveRAG: A diverse Q&A dataset with varying difficulty level for RAG evaluation","created":"2025-11-18","cited_by_count":2,"area":"rag"},{"id":"2603.02588","title":"ExpGuard: LLM Content Moderation in Specialized Domains","created":"2026-03-03","cited_by_count":2,"area":"safety"},{"id":"2604.01418","title":"Cost-Efficient Estimation of General Abilities Across Benchmarks","created":"2026-04-01","cited_by_count":2,"area":null},{"id":"2606.17541","title":"Offline Preference-Based Trajectory Evaluation","created":"2026-06-16","cited_by_count":2,"area":"agents"},{"id":"2209.11035","title":"MonoByte: A Pool of Monolingual Byte-level Language Models","created":"2022-09-22","cited_by_count":1,"area":null},{"id":"2305.15130","title":"On Degrees of Freedom in Defining and Testing Natural Language Understanding","created":"2023-05-24","cited_by_count":1,"area":null},{"id":"2404.01799","title":"PATCH! {P}sychometrics-{A}ssis{T}ed Ben{CH}marking of Large Language Models against Human Populations: A Case Study of Proficiency in 8th Grade Mathematics","created":"2024-04-02","cited_by_count":1,"area":null},{"id":"2505.22157","title":"LASER: Stratified Selective Sampling for Instruction Tuning with Dedicated Scoring Strategy","created":"2025-05-28","cited_by_count":1,"area":null},{"id":"2511.04120","title":"RIDE: Difficulty Evolving Perturbation with Item Response Theory for Mathematical Reasoning","created":"2025-11-06","cited_by_count":1,"area":"lr"},{"id":"2605.18663","title":"GIM: Evaluating models via tasks that integrate multiple cognitive domains","created":"2026-05-18","cited_by_count":1,"area":null},{"id":"2608.02966","title":"Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarks","created":"2026-08-03","cited_by_count":1,"area":null},{"id":"2608.27463","title":"Rating the Raters: Rasch Measurement Theory for LLM Evaluation","created":"2026-07-14","cited_by_count":1,"area":null},{"id":"2609.00482","title":"Are Near-Tied LLM Rankings Robust to Family-DIF-Guided Benchmark Recomposition?","created":"2026-08-31","cited_by_count":1,"area":null},{"id":"2409.04041","title":"On Evaluation of Vision Datasets and Models using Human Competency Frameworks","created":"2024-09-06","cited_by_count":0,"area":null},{"id":"2506.18213","title":"A Conceptual Framework for AI Capability Evaluations","created":"2025-06-23","cited_by_count":0,"area":null},{"id":"2602.02898","title":"Aligning Language Model Benchmarks with Pairwise Preferences","created":"2026-02-02","cited_by_count":0,"area":"alignment"},{"id":"2606.17005","title":"Bayesian Inference and Decision Audits for Public Archives of Frontier AI Evaluations","created":"2026-06-15","cited_by_count":0,"area":null},{"id":"2607.27420","title":"Dimensionality and Measurement Precision in HLE's Multiple-Choice Subset","created":"2026-07-29","cited_by_count":0,"area":null},{"id":"2608.04397","title":"NOLLI: A Difficulty-Calibrated Puzzle Benchmark for Diagnosing the English-Korean Performance Gap","created":"2026-08-05","cited_by_count":0,"area":null},{"id":"2608.21382","title":"There Is No Neutral Harness: Modern LLM Leaderboards Are Manufactured by Config-Fragile Items","created":"2026-07-17","cited_by_count":0,"area":null},{"id":"2608.29843","title":"The Price of Intelligence: A Quality-Adjusted Price Index for AI Services","created":"2026-08-30","cited_by_count":0,"area":null},{"id":"2608.30322","title":"Ignorance or Incompetence? Constructing Knowledge-Gated, Verifiable Tasks for LLM Agents","created":"2026-08-31","cited_by_count":0,"area":"agents"},{"id":"2609.09372","title":"What Does MMLU Actually Measure? A Psychometric Audit of Difficulty Structure in Aggregate Benchmark Scores","created":"2026-09-08","cited_by_count":0,"area":"lr"},{"id":"2609.17956","title":"TACTICS: Taxonomy-Aware Intelligent Corpus Sampling for Machine Translation","created":"2026-09-16","cited_by_count":0,"area":null},{"id":"2610.05682","title":"Knowing the Rules, Applying the Rules: Evaluating Language Models on Traditional Chinese Bazi","created":"2026-10-05","cited_by_count":0,"area":null}],"next_cursor":null}