{"total":132,"rows":[{"id":"2511.04703","title":"Measuring what Matters: Construct Validity in Large Language Model Benchmarks","created":"2025-11-03","cited_by_count":119,"area":null},{"id":"2507.14843","title":"The Invisible Leash: Why RLVR May or May Not Escape Its Origin","created":"2025-07-20","cited_by_count":97,"area":null},{"id":"2512.00193","title":"A Rosetta Stone for AI Benchmarks","created":"2025-11-28","cited_by_count":36,"area":null},{"id":"2602.16763","title":"When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation","created":"2026-02-18","cited_by_count":33,"area":null},{"id":"2510.18471","title":"CodeRL+: Improving Code Generation via Reinforcement with Execution Semantics Alignment","created":"2025-10-21","cited_by_count":24,"area":null},{"id":"2504.13128","title":"FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents","created":"2025-04-17","cited_by_count":15,"area":null},{"id":"2412.06748","title":"Refusal Tokens: A Simple Way to Calibrate Refusals in Large Language Models","created":"2024-12-09","cited_by_count":14,"area":null},{"id":"2412.14140","title":"GLIDER: Grading LLM Interactions and Decisions using Explainable Ranking","created":"2024-12-18","cited_by_count":14,"area":null},{"id":"2506.21614","title":"LastingBench: Defend Benchmarks Against Knowledge Leakage","created":"2025-06-21","cited_by_count":14,"area":null},{"id":"2606.05080","title":"AutoLab: Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks?","created":"2026-06-03","cited_by_count":13,"area":null},{"id":"2511.00162","title":"ARC-GEN: A Mimetic Procedural Benchmark Generator for the Abstraction and Reasoning Corpus","created":"2025-10-31","cited_by_count":10,"area":null},{"id":"2602.12966","title":"ProbeLLM: Automating Principled Diagnosis of LLM Failures","created":"2026-02-13","cited_by_count":9,"area":null},{"id":"2510.07575","title":"Benchmarking is Broken -- Don't Let AI be its Own Judge","created":"2025-10-08","cited_by_count":8,"area":null},{"id":"2505.18102","title":"CapBencher: Give Your LLM Benchmark a Built-in Alarm for Test-Set Overfitting","created":"2025-05-23","cited_by_count":7,"area":null},{"id":"2509.14221","title":"GEM-Bench: A Benchmark for Ad-Injected Response Generation within Generative Engine Marketing","created":"2025-09-17","cited_by_count":7,"area":null},{"id":"2601.07606","title":"Proof of Time: A Benchmark for Evaluating Scientific Idea Judgments","created":"2026-01-12","cited_by_count":7,"area":null},{"id":"2507.08924","title":"From KMMLU-Redux to KMMLU-Pro: A Professional Korean Benchmark Suite for LLM Evaluation","created":"2025-07-11","cited_by_count":6,"area":null},{"id":"2606.14502","title":"From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI","created":"2026-06-12","cited_by_count":6,"area":null},{"id":"2603.20807","title":"BenchBench: Benchmarking Automated Benchmark Generation","created":"2026-03-21","cited_by_count":5,"area":null},{"id":"2605.02209","title":"Submodular Benchmark Selection","created":"2026-05-04","cited_by_count":5,"area":null},{"id":"2504.04372","title":"Assessing the Impact of Code Changes on the Fault Localizability of Large Language Models","created":"2025-04-06","cited_by_count":4,"area":null},{"id":"2512.20823","title":"NotSoTiny: A Large, Living Benchmark for RTL Code Generation","created":"2025-12-23","cited_by_count":4,"area":null},{"id":"2602.16747","title":"LiveClin: A Live Clinical Benchmark without Leakage","created":"2026-02-18","cited_by_count":4,"area":null},{"id":"2605.24812","title":"CoRe-Code: Collaborative Reinforcement Learning for Code Generation","created":"2026-05-24","cited_by_count":4,"area":null},{"id":"2510.21513","title":"Wisdom and Delusion of LLM Ensembles for Code Generation and Repair","created":"2025-10-24","cited_by_count":3,"area":null},{"id":"2601.09876","title":"Patient-Similarity Cohort Reasoning in Clinical Text-to-SQL","created":"2026-01-14","cited_by_count":3,"area":null},{"id":"2601.17312","title":"Meta-Judging with Large Language Models: Concepts, Methods, and Challenges","created":"2026-01-24","cited_by_count":3,"area":null},{"id":"2603.15699","title":"This Is Taking Too Long -- Investigating Time as a Proxy for Energy Consumption of LLMs","created":"2026-03-16","cited_by_count":3,"area":null},{"id":"2604.03244","title":"AI Evaluation Should Require Standardized Item-Level Data Releases","created":"2026-02-27","cited_by_count":3,"area":null},{"id":"2605.09826","title":"EnactToM: An Evolving Benchmark for Functional Theory of Mind in Embodied Agents","created":"2026-05-11","cited_by_count":3,"area":null},{"id":"2605.17829","title":"Interactive Evaluation Requires a Design Science","created":"2026-05-18","cited_by_count":3,"area":null},{"id":"2606.17574","title":"DeepInsight: A Unified Evaluation Infrastructure Across the Physical AI Stack","created":"2026-06-16","cited_by_count":3,"area":null},{"id":"2606.24020","title":"You Don't Need to Run Every Eval","created":"2026-06-22","cited_by_count":3,"area":null},{"id":"2411.09492","title":"MM-Eval: A Hierarchical Benchmark for Modern Mongolian Evaluation in LLMs","created":"2024-11-14","cited_by_count":2,"area":null},{"id":"2505.03678","title":"Graph Drawing for LLMs: An Empirical Evaluation","created":"2025-05-06","cited_by_count":2,"area":null},{"id":"2510.08569","title":"ArenaBencher: Automatic Benchmark Evolution via Multi-Model Competitive Evaluation","created":"2025-10-09","cited_by_count":2,"area":null},{"id":"2510.17013","title":"DiscoTrack: A Multilingual LLM Benchmark for Discourse Tracking","created":"2025-10-19","cited_by_count":2,"area":null},{"id":"2511.10691","title":"Evaluating from Benign to Dynamic Adversarial: A Squid Game for Large Language Models","created":"2025-11-12","cited_by_count":2,"area":null},{"id":"2511.14774","title":"LiveCLKTBench: Towards Reliable Evaluation of Cross-Lingual Knowledge Transfer in Multilingual LLMs","created":"2025-11-03","cited_by_count":2,"area":null},{"id":"2604.04815","title":"LiveFact: A Dynamic, Time-Aware Benchmark for LLM-Driven Fake News Detection","created":"2026-04-06","cited_by_count":2,"area":null},{"id":"2605.19999","title":"LLM Benchmark Datasets Should Be Contamination-Resistant","created":"2026-05-19","cited_by_count":2,"area":null},{"id":"2606.03650","title":"CoEval: Ranking Language Models for Custom Tasks Without Labeled Data or Trustworthy Benchmarks","created":"2026-06-02","cited_by_count":2,"area":null},{"id":"2606.30814","title":"When Calibration Rankings Reverse: Accuracy-Controlled Evaluation for Fair Comparison of LLMs","created":"2026-06-29","cited_by_count":2,"area":null},{"id":"2608.02985","title":"Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores","created":"2026-08-04","cited_by_count":2,"area":null},{"id":"2608.03764","title":"GDPevo: Evaluating Agent Self-Evolution on Real Business Tasks","created":"2026-08-04","cited_by_count":2,"area":null},{"id":"2608.28113","title":"H-Scale: Hessian-Guided Scale Refinement for NVFP4 Sub-Byte LLM Inference","created":"2026-08-28","cited_by_count":2,"area":null},{"id":"2609.31473","title":"Game Arena: Strategic LLM Evaluation in Competitive Environments","created":"2026-09-25","cited_by_count":2,"area":null},{"id":"2505.13990","title":"DecIF: Improving Instruction-Following through Meta-Decomposition","created":"2025-05-20","cited_by_count":1,"area":null},{"id":"2507.06056","title":"Data Compressibility Quantifies LLM Memorization","created":"2025-07-08","cited_by_count":1,"area":null},{"id":"2509.12171","title":"Preservation of Language Understanding Capabilities in Speech-aware Large Language Models","created":"2025-09-15","cited_by_count":1,"area":null},{"id":"2510.22593","title":"AutoBench: Automating LLM Evaluation through Reciprocal Peer Assessment","created":"2025-10-26","cited_by_count":1,"area":null},{"id":"2510.24450","title":"Charting the European LLM Benchmarking Landscape: A New Taxonomy and a Set of Best Practices","created":"2025-10-28","cited_by_count":1,"area":null},{"id":"2511.19872","title":"Simulated Self-Assessment in Large Language Models: A Psychometric Approach to AI Self-Efficacy","created":"2025-11-25","cited_by_count":1,"area":null},{"id":"2511.20613","title":"Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planning","created":"2025-11-25","cited_by_count":1,"area":null},{"id":"2601.06953","title":"X-Coder: Advancing Competitive Programming with Synthetic Tasks, Solutions, and Tests","created":"2026-01-11","cited_by_count":1,"area":null},{"id":"2601.16354","title":"NOIR: Privacy-Preserving Generation of Code with Open-Source LLMs","created":"2026-01-22","cited_by_count":1,"area":null},{"id":"2602.15327","title":"Prescriptive Scaling Reveals the Evolution of Language Model Capabilities","created":"2026-02-17","cited_by_count":1,"area":null},{"id":"2603.03322","title":"Can Large Language Models Derive New Knowledge? A Dynamic Benchmark for Biological Knowledge Discovery","created":"2026-02-10","cited_by_count":1,"area":null},{"id":"2605.02028","title":"Language models fail at extended rule following","created":"2026-05-03","cited_by_count":1,"area":null},{"id":"2605.06832","title":"IntentGrasp: A Comprehensive Benchmark for Intent Understanding","created":"2026-05-07","cited_by_count":1,"area":null},{"id":"2605.18663","title":"GIM: Evaluating models via tasks that integrate multiple cognitive domains","created":"2026-05-18","cited_by_count":1,"area":null},{"id":"2605.22878","title":"SciAtlas: A Computable Atlas of Science for Knowledge-Grounded AI Research","created":"2026-05-20","cited_by_count":1,"area":null},{"id":"2606.19605","title":"FAPO: Fully Automated Prompt Optimization of Multi-Step LLM Pipelines","created":"2026-06-17","cited_by_count":1,"area":null},{"id":"2607.01740","title":"Meta-Benchmarks for Financial-Services LLM Evaluation","created":"2026-07-02","cited_by_count":1,"area":null},{"id":"2607.18985","title":"Athena-Brain Technical Report: An Efficient Robot Brain for General Intelligence and Embodied Interaction","created":"2026-07-21","cited_by_count":1,"area":null},{"id":"2607.24054","title":"Success Is Not Self-Explanatory: Auditing Success Provenance in Agent Evaluation","created":"2026-07-27","cited_by_count":1,"area":null},{"id":"2607.24573","title":"LLM-SoccerArena: Benchmarking LLMs on Real-World Predictions in Sports","created":"2026-07-27","cited_by_count":1,"area":null},{"id":"2607.24780","title":"LivingArena: Do LLMs Know What Other LLMs Don't? Peer-Probing as Scalable Evaluation","created":"2026-06-19","cited_by_count":1,"area":null},{"id":"2608.17183","title":"Benchmarking the Benchmarks: Evaluating Automated Safety Benchmarks for Small Language Models","created":"2026-08-17","cited_by_count":1,"area":null},{"id":"2608.22295","title":"LLM Evaluation on Unseen Questions: Contextual Multidimensional IRT Model","created":"2026-08-23","cited_by_count":1,"area":null},{"id":"2608.30110","title":"Can LLMs Take the Pulse of the Economy? A Real-Time Evaluation of LLM Nowcasts on Macroeconomic Indicators","created":"2026-08-31","cited_by_count":1,"area":null},{"id":"2609.18366","title":"Bad Genius: Counterfactual-Guided Harness Evolution Beyond Task-Specific Shortcuts","created":"2026-09-16","cited_by_count":1,"area":null},{"id":"2506.11067","title":"A Large Language Model Based Pipeline for Review of Systems Entity Recognition from Clinical Notes","created":"2025-05-31","cited_by_count":0,"area":null},{"id":"2509.25922","title":"DeepJSONEval: Benchmarking Complex Nested JSON Data Mining for Large Language Models","created":"2025-09-30","cited_by_count":0,"area":null},{"id":"2510.27565","title":"CodeAlignBench: Assessing Code Generation Models on Developer-Preferred Code Adjustments","created":"2025-10-31","cited_by_count":0,"area":null},{"id":"2512.17902","title":"Adversarial Robustness of Vision in Open Foundation Models","created":"2025-12-19","cited_by_count":0,"area":null},{"id":"2602.00911","title":"Synapse: Federated Tool Routing via Typed Compendium Artifacts","created":"2026-01-31","cited_by_count":0,"area":null},{"id":"2602.13217","title":"VeRA: Renewing Reasoning Benchmarks with Executable Specifications","created":"2026-01-23","cited_by_count":0,"area":null},{"id":"2604.03742","title":"Structured Multi-Criteria Evaluation of Large Language Models with Fuzzy Analytic Hierarchy Process and DualJudge","created":"2026-04-04","cited_by_count":0,"area":null},{"id":"2604.23990","title":"Failure-Centered Runtime Evaluation for Deployed Trilingual Public-Space Agents","created":"2026-04-27","cited_by_count":0,"area":null},{"id":"2605.10810","title":"Likelihood scoring for continuations of mathematical text: a self-supervised benchmark with tests for shortcut vulnerabilities","created":"2026-05-11","cited_by_count":0,"area":null},{"id":"2605.10851","title":"Generalizing the Turing Test to Interactive Agents","created":"2026-05-11","cited_by_count":0,"area":null},{"id":"2605.11680","title":"ShapeCodeBench: A Renewable Benchmark for Perception-to-Program Reconstruction of Synthetic Shape Scenes","created":"2026-05-12","cited_by_count":0,"area":null},{"id":"2605.14084","title":"CRANE: Constrained Reasoning Injection for Code Agents via Nullspace Editing","created":"2026-05-13","cited_by_count":0,"area":null},{"id":"2605.17273","title":"Position: State-of-the-Art Claims Require State-of-the-Art Evidence","created":"2026-05-17","cited_by_count":0,"area":null},{"id":"2605.18824","title":"Fine-Grained Benchmark Generation for Comprehensive Evaluation of Foundation Models","created":"2026-05-12","cited_by_count":0,"area":null},{"id":"2605.21543","title":"Provable Joint Decontamination for Benchmarking Multiple Large Language Models","created":"2026-05-20","cited_by_count":0,"area":null},{"id":"2606.09878","title":"FailureScope: Cross-Regime Behavioral Diagnosis of Language Model Weaknesses","created":"2026-06-03","cited_by_count":0,"area":null},{"id":"2606.17005","title":"Bayesian Inference and Decision Audits for Public Archives of Frontier AI Evaluations","created":"2026-06-15","cited_by_count":0,"area":null},{"id":"2606.20736","title":"REKEY: Metadata-Grounded Visual-Key Regeneration for Contamination-Resilient VQA Evaluation","created":"2026-06-17","cited_by_count":0,"area":null},{"id":"2606.30219","title":"EvalSafetyGap: A Hybrid Survey and Conceptual Framework for LLM Evaluation-Safety Failures","created":"2026-06-29","cited_by_count":0,"area":null},{"id":"2607.07040","title":"Measuring Intelligence Beyond Human Scale","created":"2026-07-08","cited_by_count":0,"area":null},{"id":"2607.18642","title":"Spaghetti Architect: A Contamination-Resistant, By-Construction-Labelled, Multi-Language Code Dataset Generator","created":"2026-07-21","cited_by_count":0,"area":null},{"id":"2607.23425","title":"TLA+-Bench: An Execution-Grounded Benchmark and Dataset for Natural-Language to TLA Specification Generation","created":"2026-07-26","cited_by_count":0,"area":null},{"id":"2607.24889","title":"One Analyst Is Not Ground Truth: Grading Agent-Built Financial Models Against Observed Professional Practice","created":"2026-07-27","cited_by_count":0,"area":null},{"id":"2608.04008","title":"WorldCup Arena: Prospective, Leakage-Free Evaluation of Frontier LLMs on a Live Tournament","created":"2026-08-04","cited_by_count":0,"area":null},{"id":"2608.04336","title":"COMPAS: Difficulty-Aware Joint Search for Optimizing Code Generation","created":"2026-08-05","cited_by_count":0,"area":null},{"id":"2608.06262","title":"Hypothesis Testing with Conditional Queries: Learnability and the Value of Interaction","created":"2026-08-06","cited_by_count":0,"area":null},{"id":"2608.06898","title":"How Should I Pick a Foundation Model for My Robot? In Favor of a Community Evaluation Framework for Social Robots","created":"2026-08-07","cited_by_count":0,"area":null},{"id":"2608.12325","title":"Position: Reasoning is a Learnable Rule-Based Process","created":"2026-05-29","cited_by_count":0,"area":null}],"next_cursor":"100"}