{"total":25,"rows":[{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52,"area":null},{"id":"2503.05336","title":"Toward an Evaluation Science for Generative AI Systems","created":"2025-03-07","cited_by_count":45,"area":null},{"id":"2509.11106","title":"Fluid Language Model Benchmarking","created":"2025-09-14","cited_by_count":35,"area":null},{"id":"2602.16763","title":"When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation","created":"2026-02-18","cited_by_count":33,"area":null},{"id":"2503.08893","title":"EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees","created":"2025-03-11","cited_by_count":27,"area":null},{"id":"2502.08395","title":"IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistance","created":"2025-02-12","cited_by_count":26,"area":null},{"id":"2410.20245","title":"Improving Model Evaluation using SMART Filtering of Benchmark Datasets","created":"2024-10-26","cited_by_count":21,"area":null},{"id":"2412.06745","title":"ONEBench to Test Them All: Sample-Level Benchmarking Over Open-Ended Capabilities","created":"2024-12-09","cited_by_count":15,"area":null},{"id":"2510.08730","title":"How Reliable is Language Model Micro-Benchmarking?","created":"2025-10-09","cited_by_count":9,"area":null},{"id":"2602.06221","title":"BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks","created":"2026-02-05","cited_by_count":5,"area":null},{"id":"2603.29020","title":"Emergence WebVoyager: Toward Consistent and Transparent Evaluation of (Web) Agents in The Wild","created":"2026-03-30","cited_by_count":5,"area":null},{"id":"2504.06549","title":"Societal Impacts Research Requires Benchmarks for Creative Composition Tasks","created":"2025-04-09","cited_by_count":3,"area":null},{"id":"2506.00482","title":"Benchmarks Are Not Atomic: Composition-Aware LLM Evaluation using BenchHub","created":"2025-05-31","cited_by_count":3,"area":null},{"id":"2410.23331","title":"Can Models Help Us Create Better Models? Evaluating LLMs as Data Scientists","created":"2024-10-30","cited_by_count":2,"area":null},{"id":"2603.16120","title":"Language Models Don't Know What You Want: Evaluating Personalization in Deep Research Needs Real Users","created":"2026-03-17","cited_by_count":2,"area":null},{"id":"2504.03716","title":"Evaluating Large Language Models for Fair and Reliable Organ Allocation","created":"2025-03-29","cited_by_count":1,"area":null},{"id":"2509.00248","title":"The Differential Meaning of Models: A Framework for Analyzing the Structural Consequences of Semantic Modeling Decisions","created":"2025-08-29","cited_by_count":0,"area":null},{"id":"2511.05501","title":"Towards Real-World Validity in Generative AI Benchmarks: Understanding and Designing Domain-Centered Evaluations for Journalism Practitioners","created":"2025-09-30","cited_by_count":0,"area":null},{"id":"2605.24818","title":"Correcting test set contamination by spiking the training data","created":"2026-05-24","cited_by_count":0,"area":null},{"id":"2606.28524","title":"Developmental Trajectories of Situation Modeling and Mentalizing in Transformer Language Models","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2606.30219","title":"EvalSafetyGap: A Hybrid Survey and Conceptual Framework for LLM Evaluation-Safety Failures","created":"2026-06-29","cited_by_count":0,"area":null},{"id":"2607.11977","title":"Optimization Is Not All You Need","created":"2026-07-13","cited_by_count":0,"area":null},{"id":"2608.29887","title":"Check The Scoreboard: An Analysis of Scoring Schemes on Multiple-Choice Evaluation","created":"2026-08-30","cited_by_count":0,"area":null},{"id":"2609.08861","title":"API Benchmark Scores Do Not Reliably Transfer to Chatbot Interfaces","created":"2026-09-08","cited_by_count":0,"area":null},{"id":"2610.17703","title":"Pushback in a Haystack: Language Models Respond to Factual Errors Ambiguously and Ineffectively","created":"2026-10-13","cited_by_count":0,"area":null}],"next_cursor":null}