{"total":31,"rows":[{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52,"area":null},{"id":"2412.15194","title":"MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmark","created":"2024-12-19","cited_by_count":41,"area":null},{"id":"2407.09141","title":"Accuracy is Not All You Need","created":"2024-07-12","cited_by_count":31,"area":null},{"id":"2410.20245","title":"Improving Model Evaluation using SMART Filtering of Benchmark Datasets","created":"2024-10-26","cited_by_count":21,"area":null},{"id":"2503.01622","title":"DOVE: A Large-Scale Multi-Dimensional Predictions Dataset Towards Meaningful LLM Evaluation","created":"2025-03-03","cited_by_count":21,"area":null},{"id":"2603.13285","title":"Brittlebench: Quantifying LLM robustness via prompt sensitivity","created":"2026-02-27","cited_by_count":21,"area":null},{"id":"2504.01833","title":"YourBench: Easy Custom Evaluation Sets for Everyone","created":"2025-04-02","cited_by_count":20,"area":null},{"id":"2409.18857","title":"Mitigating Selection Bias with Node Pruning and Auxiliary Options","created":"2024-09-27","cited_by_count":12,"area":null},{"id":"2411.13757","title":"GenBFA: An Evolutionary Optimization Approach to Bit-Flip Attacks on LLMs","created":"2024-11-21","cited_by_count":10,"area":null},{"id":"2506.00643","title":"SATA-BENCH: Select All That Apply Benchmark for Multiple Choice Questions","created":"2025-05-31","cited_by_count":9,"area":null},{"id":"2510.11905","title":"LLM Knowledge is Brittle: Truthfulness Representations Rely on Superficial Resemblance","created":"2025-10-13","cited_by_count":9,"area":null},{"id":"2503.12440","title":"HKCanto-Eval: A Benchmark for Evaluating Cantonese Language Understanding and Cultural Comprehension in LLMs","created":"2025-03-16","cited_by_count":8,"area":null},{"id":"2507.23009","title":"Position: Stop Evaluating AI with Human Tests, Develop Principled, AI-specific Tests instead","created":"2025-07-30","cited_by_count":7,"area":null},{"id":"2407.16604","title":"Shared Imagination: LLMs Hallucinate Alike","created":"2024-07-23","cited_by_count":5,"area":null},{"id":"2506.18710","title":"Benchmarking the Pedagogical Knowledge of Large Language Models","created":"2025-06-23","cited_by_count":5,"area":null},{"id":"2507.03285","title":"Memory Mosaics at scale","created":"2025-07-04","cited_by_count":5,"area":null},{"id":"2407.12220","title":"Questionable practices in machine learning","created":"2024-07-17","cited_by_count":4,"area":null},{"id":"2502.12459","title":"Large Language Models Badly Generalize across Option Length, Problem Types, and Irrelevant Noun Replacements","created":"2025-02-18","cited_by_count":4,"area":null},{"id":"2502.08662","title":"RoToR: Towards More Reliable Responses for Order-Invariant Inputs","created":"2025-02-10","cited_by_count":3,"area":null},{"id":"2412.10558","title":"Too Big to Fool: Resisting Deception in Language Models","created":"2024-12-13","cited_by_count":2,"area":null},{"id":"2508.01203","title":"Importance Sampling is All You Need: Predict LLM's performance on new benchmark by reusing existing benchmark","created":"2025-08-02","cited_by_count":2,"area":null},{"id":"2410.02343","title":"Listening to the Wise Few: Query-Key Alignment Unlocks Latent Correct Answers in Large Language Models","created":"2024-10-03","cited_by_count":1,"area":null},{"id":"2412.04277","title":"Arabic Stable LM: Adapting Stable LM 2 1.6B to Arabic","created":"2024-12-05","cited_by_count":1,"area":null},{"id":"2506.07658","title":"From Raw Corpora to Domain Benchmarks: Automated Evaluation of LLM Domain Expertise","created":"2025-06-09","cited_by_count":1,"area":null},{"id":"2605.07268","title":"From 0-Order Selection to 2-Order Judgment: Combinatorial Hardening Exposes Compositional Failures in Frontier LLMs","created":"2026-05-08","cited_by_count":1,"area":null},{"id":"2605.15607","title":"Syntax Without Semantics: Teaching Large Language Models to Code in an Unseen Language","created":"2026-05-15","cited_by_count":1,"area":null},{"id":"2507.15581","title":"Metric assessment protocol in the context of answer fluctuation on MCQ tasks","created":"2025-07-21","cited_by_count":0,"area":null},{"id":"2512.05461","title":"Knowing Your Uncertainty -- On the application of LLM in social sciences","created":"2025-12-05","cited_by_count":0,"area":null},{"id":"2601.10926","title":"Selecting Language Models for Social Science: Start Small, Start Open, and Validate","created":"2026-01-16","cited_by_count":0,"area":null},{"id":"2608.18726","title":"Execution-grounded evaluation reveals hidden failures in language-model calculations for environmental science","created":"2026-08-19","cited_by_count":0,"area":null},{"id":"2609.30454","title":"Auditing System-1 Models on Biosecurity-Relevant Benchmarks: Calibration, Selective Prediction, and Permutation Instability in a Non-Generative Model","created":"2026-09-24","cited_by_count":0,"area":null}],"next_cursor":null}