{"total":110,"rows":[{"id":"2501.14249","title":"Humanity's Last Exam","created":"2025-01-24","cited_by_count":491,"area":null},{"id":"2605.00674","title":"Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMs","created":"2026-05-01","cited_by_count":137,"area":null},{"id":"2512.00193","title":"A Rosetta Stone for AI Benchmarks","created":"2025-11-28","cited_by_count":36,"area":null},{"id":"2602.16763","title":"When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation","created":"2026-02-18","cited_by_count":33,"area":null},{"id":"2506.21621","title":"The Open Proof Corpus: A Large-Scale Study of LLM-Generated Mathematical Proofs","created":"2025-06-23","cited_by_count":30,"area":null},{"id":"2504.18838","title":"Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks","created":"2025-04-26","cited_by_count":28,"area":null},{"id":"2507.15887","title":"AlgoTune: Can Language Models Speed Up General-Purpose Numerical Programs?","created":"2025-07-19","cited_by_count":27,"area":null},{"id":"2510.04721","title":"BrokenMath: A Benchmark for Sycophancy in Theorem Proving with LLMs","created":"2025-10-06","cited_by_count":27,"area":null},{"id":"2511.02872","title":"FATE: A Formal Benchmark Series for Frontier Algebra of Multiple Difficulty Levels","created":"2025-11-04","cited_by_count":27,"area":null},{"id":"2503.01747","title":"Position: Don't Use the CLT in LLM Evals With Fewer Than a Few Hundred Datapoints","created":"2025-03-03","cited_by_count":23,"area":null},{"id":"2512.15699","title":"FrontierCS: Evolving Challenges for Evolving Intelligence","created":"2025-12-17","cited_by_count":23,"area":null},{"id":"2510.26787","title":"Remote Labor Index: Measuring AI Automation of Remote Work","created":"2025-10-30","cited_by_count":20,"area":null},{"id":"2510.05318","title":"BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactions","created":"2025-10-06","cited_by_count":19,"area":null},{"id":"2503.01811","title":"AutoAdvExBench: Benchmarking autonomous exploitation of adversarial example defenses","created":"2025-03-03","cited_by_count":15,"area":null},{"id":"2509.26076","title":"IMProofBench: Benchmarking AI on Research-Level Mathematical Proof Generation","created":"2025-09-30","cited_by_count":13,"area":null},{"id":"2604.24021","title":"QED: An Open-Source Multi-Agent System for Generating Mathematical Proofs on Open Problems","created":"2026-04-27","cited_by_count":13,"area":null},{"id":"2504.21202","title":"Automatic Legal Writing Evaluation of LLMs","created":"2025-04-29","cited_by_count":12,"area":null},{"id":"2606.05400","title":"LeanMarathon: Toward Reliable AI Co-Mathematicians through Long-Horizon Lean Autoformalization","created":"2026-06-03","cited_by_count":12,"area":null},{"id":"2412.15184","title":"Data for Mathematical Copilots: Better Ways of Presenting Proofs for Machine Learning","created":"2024-12-19","cited_by_count":11,"area":null},{"id":"2510.02663","title":"TutorBench: A Benchmark To Assess Tutoring Capabilities Of Large Language Models","created":"2025-10-03","cited_by_count":11,"area":null},{"id":"2601.19532","title":"Benchmarks Saturate When The Model Gets Smarter Than The Judge","created":"2026-01-27","cited_by_count":11,"area":null},{"id":"2511.00162","title":"ARC-GEN: A Mimetic Procedural Benchmark Generator for the Abstraction and Reasoning Corpus","created":"2025-10-31","cited_by_count":10,"area":null},{"id":"2602.24173","title":"LemmaBench: A Live, Research-Level Benchmark to Evaluate LLM Capabilities in Mathematics","created":"2026-02-27","cited_by_count":10,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2505.06108","title":"LLMs Outperform Experts on Challenging Biology Benchmarks","created":"2025-05-09","cited_by_count":9,"area":null},{"id":"2505.00612","title":"Position: AI Competitions Provide the Gold Standard for Empirical Rigor in GenAI Evaluation","created":"2025-05-01","cited_by_count":8,"area":null},{"id":"2604.06802","title":"Riemann-Bench: A Benchmark for Moonshot Mathematics","created":"2026-04-08","cited_by_count":8,"area":null},{"id":"2502.01683","title":"LLM-Powered Benchmark Factory: Reliable, Generic, and Efficient","created":"2025-02-02","cited_by_count":7,"area":null},{"id":"2505.18102","title":"CapBencher: Give Your LLM Benchmark a Built-in Alarm for Test-Set Overfitting","created":"2025-05-23","cited_by_count":7,"area":null},{"id":"2506.14652","title":"Rigor in AI: Doing Rigorous AI Work Requires a Broader, Responsible AI-Informed Conception of Rigor","created":"2025-06-17","cited_by_count":7,"area":null},{"id":"2606.17930","title":"How Inference Compute Shapes Frontier LLM Evaluation","created":"2026-06-16","cited_by_count":7,"area":null},{"id":"2502.17259","title":"Detecting Benchmark Contamination Through Watermarking","created":"2025-02-24","cited_by_count":6,"area":null},{"id":"2606.14502","title":"From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI","created":"2026-06-12","cited_by_count":6,"area":null},{"id":"2502.20309","title":"EAIRA: Establishing a Methodology for Evaluating AI Models as Scientific Research Assistants","created":"2025-02-27","cited_by_count":5,"area":null},{"id":"2505.08744","title":"DeepMath-Creative: A Benchmark for Evaluating Mathematical Creativity of Large Language Models","created":"2025-05-13","cited_by_count":5,"area":null},{"id":"2505.11774","title":"HARDMath2: A Benchmark for Applied Mathematics Built by Students as Part of a Graduate Class","created":"2025-05-17","cited_by_count":5,"area":null},{"id":"2505.20738","title":"Silencer: From Discovery to Mitigation of Self-Bias in LLM-as-Benchmark-Generator","created":"2025-05-27","cited_by_count":5,"area":null},{"id":"2505.23851","title":"ASyMOB: Algebraic Symbolic Mathematical Operations Benchmark","created":"2025-05-28","cited_by_count":5,"area":null},{"id":"2509.20374","title":"CFDLLMBench: A Benchmark Suite for Evaluating Large Language Models in Computational Fluid Dynamics","created":"2025-09-19","cited_by_count":5,"area":null},{"id":"2511.11500","title":"Honesty over Accuracy: Trustworthy Language Models through Reinforced Hesitation","created":"2025-11-14","cited_by_count":5,"area":null},{"id":"2503.04840","title":"Framing the Game: How Context Shapes LLM Decision-Making","created":"2025-03-05","cited_by_count":4,"area":null},{"id":"2505.19973","title":"DFIR-Metric: A Benchmark Dataset for Evaluating Large Language Models in Digital Forensics and Incident Response","created":"2025-05-26","cited_by_count":4,"area":null},{"id":"2510.05228","title":"CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers","created":"2025-10-06","cited_by_count":4,"area":null},{"id":"2512.14220","title":"Estimating problem difficulty without ground truth using Large Language Model comparisons","created":"2025-12-16","cited_by_count":4,"area":null},{"id":"2602.00070","title":"FoundationalASSIST: An Educational Dataset for Foundational Knowledge Tracing and Pedagogical Grounding of LLMs","created":"2026-01-20","cited_by_count":4,"area":null},{"id":"2604.06107","title":"Artificial Intelligence and the Structure of Mathematics","created":"2026-04-07","cited_by_count":4,"area":null},{"id":"2606.12683","title":"From AGI to ASI","created":"2026-06-10","cited_by_count":4,"area":null},{"id":"2607.08186","title":"Hidden Decoding at Scale: Latent Computation Scaling for Large Language Models","created":"2026-07-09","cited_by_count":4,"area":null},{"id":"2609.19134","title":"ScienceIDE: Turning World's Scientific Codebase into Agent Learnable Environments","created":"2026-09-16","cited_by_count":4,"area":null},{"id":"2503.07631","title":"OWLViz: An Open-World Benchmark for Visual Question Answering","created":"2025-03-04","cited_by_count":3,"area":null},{"id":"2506.23924","title":"Performance of LLMs on Stochastic Modeling Operations Research Problems: From Theory to Practice","created":"2025-06-30","cited_by_count":3,"area":null},{"id":"2507.13337","title":"FormulaOne: Measuring the Depth of Algorithmic Reasoning Beyond Competitive Programming","created":"2025-07-17","cited_by_count":3,"area":null},{"id":"2512.11588","title":"AI Benchmark Democratization and Carpentry","created":"2025-12-12","cited_by_count":3,"area":null},{"id":"2602.11175","title":"Barriers to Discrete Reasoning with Transformers: A Survey Across Depth, Exactness, and Bandwidth","created":"2026-01-19","cited_by_count":3,"area":null},{"id":"2603.08371","title":"Leaderboard Incentives: Model Rankings under Strategic Post-Training","created":"2026-03-09","cited_by_count":3,"area":null},{"id":"2604.04898","title":"QED-Nano: Teaching a Tiny Model to Prove Hard Theorems","created":"2026-04-06","cited_by_count":3,"area":null},{"id":"2505.04528","title":"Beyond Theorem Proving: Formulation, Framework and Benchmark for Formal Problem-Solving","created":"2025-05-07","cited_by_count":2,"area":null},{"id":"2508.20236","title":"The Mathematician's Assistant: Integrating AI into Research Practice","created":"2025-08-27","cited_by_count":2,"area":null},{"id":"2509.24827","title":"Putnam-like dataset summary: LLMs as mathematical competition contestants","created":"2025-09-29","cited_by_count":2,"area":null},{"id":"2511.05614","title":"An MLCommons Scientific Benchmarks Ontology","created":"2025-11-06","cited_by_count":2,"area":null},{"id":"2604.02368","title":"Xpertbench: Expert Level Tasks with Rubrics-Based Evaluation","created":"2026-03-27","cited_by_count":2,"area":null},{"id":"2605.16358","title":"LEAF: A Living Benchmark for Event-Augmented Forecasting","created":"2026-05-09","cited_by_count":2,"area":null},{"id":"2608.16977","title":"The Problem Is the Problem: Towards Scalable Mathematical Discovery","created":"2026-08-17","cited_by_count":2,"area":null},{"id":"2609.06396","title":"MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselves","created":"2026-09-06","cited_by_count":2,"area":null},{"id":"2508.18646","title":"Beyond Benchmarks: LLM Evaluation with an Anthropomorphic and Lifecycle-oriented Roadmap","created":"2025-08-26","cited_by_count":1,"area":null},{"id":"2510.03515","title":"RAPID: An Efficient Reinforcement Learning Algorithm for Small Language Models","created":"2025-10-03","cited_by_count":1,"area":null},{"id":"2512.20162","title":"Concept Generalization in Humans and Large Language Models: Insights from the Number Game","created":"2025-12-23","cited_by_count":1,"area":null},{"id":"2602.14307","title":"Benchmarking at the Edge of Comprehension","created":"2026-02-15","cited_by_count":1,"area":null},{"id":"2603.05225","title":"AI+HW 2035: Shaping the Next Decade","created":"2026-03-05","cited_by_count":1,"area":null},{"id":"2605.27483","title":"Debate Helps Weak Judges Reward Stronger Models","created":"2026-05-26","cited_by_count":1,"area":null},{"id":"2606.21891","title":"Learning the ARTS of Search for Automated Discovery","created":"2026-06-20","cited_by_count":1,"area":null},{"id":"2607.07779","title":"From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier","created":"2026-07-08","cited_by_count":1,"area":null},{"id":"2608.11341","title":"Apodex Discovery: Reality Benchmarks and Environments for Evaluating and Building Discoverative Artificial Intelligence","created":"2026-08-11","cited_by_count":1,"area":null},{"id":"2608.29530","title":"The Emergent Symbolic Structure of Artificial Neural Networks","created":"2026-08-30","cited_by_count":1,"area":null},{"id":"2504.13360","title":"In between myth and reality: AI for math -- a case study in category theory","created":"2025-04-17","cited_by_count":0,"area":null},{"id":"2510.08797","title":"TAPAS: Datasets for Learning the Learning with Errors Problem","created":"2025-10-09","cited_by_count":0,"area":null},{"id":"2510.21087","title":"Designing and Evaluating Chain-of-Hints for Scientific Question Answering","created":"2025-10-24","cited_by_count":0,"area":null},{"id":"2512.11183","title":"Progress over Points: Reframing LM Benchmarks Around Scientific Objectives","created":"2025-12-12","cited_by_count":0,"area":null},{"id":"2604.04386","title":"Automatically Generating Hard Math Problems from Hypothesis-Driven Error Analysis","created":"2026-04-06","cited_by_count":0,"area":null},{"id":"2604.07240","title":"$k$-server-bench: Automating Potential Discovery for the $k$-Server Conjecture","created":"2026-04-08","cited_by_count":0,"area":null},{"id":"2605.14040","title":"Physics-R1: An Audited Olympiad Corpus and Released Verifiers for Visual Physics Reasoning","created":"2026-05-13","cited_by_count":0,"area":null},{"id":"2605.23007","title":"MadEvolve: Evolutionary Optimization of Trading Systems with Large Language Models","created":"2026-05-21","cited_by_count":0,"area":null},{"id":"2606.01008","title":"FVSpec: Real-World Property-Based Tests as Lean Challenges","created":"2026-05-31","cited_by_count":0,"area":null},{"id":"2606.02588","title":"Lean-GAP: A Dataset of Formalized Graduate Algebra Problems","created":"2026-05-20","cited_by_count":0,"area":null},{"id":"2606.05729","title":"Automated Proving of Shannon-Type Entropy Inequalities via Fine-Tuned Language Models and Guided Tree Search","created":"2026-06-04","cited_by_count":0,"area":null},{"id":"2606.05818","title":"Benchmarks in Leipzig","created":"2026-06-04","cited_by_count":0,"area":null},{"id":"2606.07722","title":"Some hypotheses on how chatbots work in problem-solution-driven conversations: Large Language Models as confirmation of the Innovation Illusion","created":"2026-06-05","cited_by_count":0,"area":null},{"id":"2606.15258","title":"Mask-Proof: An LLM-based Automated Data Curation Pipeline on Mathematical Proofs","created":"2026-06-13","cited_by_count":0,"area":null},{"id":"2606.28471","title":"Data and Evaluation Closed-Loop for Model Capability Enhancement","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2607.02934","title":"MatPhaseBench: A Semantics-Guided Benchmark for Materials Phase Diagrams Understanding","created":"2026-07-03","cited_by_count":0,"area":null},{"id":"2607.07040","title":"Measuring Intelligence Beyond Human Scale","created":"2026-07-08","cited_by_count":0,"area":null},{"id":"2607.09721","title":"The Ramanujan Challenge For AI","created":"2026-06-27","cited_by_count":0,"area":null},{"id":"2607.11849","title":"AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification","created":"2026-07-13","cited_by_count":0,"area":null},{"id":"2607.17388","title":"Mathematical Discovery in the Wild: AI-Guided Proofs in Banach Space Theory","created":"2026-07-19","cited_by_count":0,"area":null},{"id":"2607.25648","title":"Why Public Service AI Governance Frameworks Risk Failing in the Age of General-Purpose AI: Lessons from Policing","created":"2026-07-28","cited_by_count":0,"area":null},{"id":"2608.07762","title":"Who Verifies the Benchmark? Decentralizing Trust in Large Language Model Evaluation","created":"2026-08-07","cited_by_count":0,"area":null},{"id":"2608.15979","title":"ALPS: Measuring Valid Creativity in Large Language Models with Mathematical Construction","created":"2026-08-17","cited_by_count":0,"area":null},{"id":"2608.28591","title":"Expert-validated STEM QA","created":"2026-06-06","cited_by_count":0,"area":null},{"id":"2609.07784","title":"xDailyBench: Benchmarking LLMs on Professional Consultation for Real-Life Problems","created":"2026-09-07","cited_by_count":0,"area":null},{"id":"2609.22150","title":"ECP-Bench: Benchmarking and Learning Entertainment Content Promotion with Foundation Models","created":"2026-08-26","cited_by_count":0,"area":null}],"next_cursor":"100"}