{"total":310,"rows":[{"id":"2406.11717","title":"Refusal in Language Models Is Mediated by a Single Direction","created":"2024-06-17","cited_by_count":1032,"area":"safety"},{"id":"2407.12772","title":"LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models","created":"2024-07-17","cited_by_count":353,"area":"mllm"},{"id":"2506.02153","title":"Small Language Models are the Future of Agentic AI","created":"2025-06-02","cited_by_count":270,"area":"agents"},{"id":"2407.15711","title":"AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?","created":"2024-07-22","cited_by_count":158,"area":"agents"},{"id":"2405.10938","title":"Observational Scaling Laws and the Predictability of Language Model Performance","created":"2024-05-17","cited_by_count":130,"area":null},{"id":"2511.04703","title":"Measuring what Matters: Construct Validity in Large Language Model Benchmarks","created":"2025-11-03","cited_by_count":119,"area":null},{"id":"2506.01062","title":"SealQA: Raising the Bar for Reasoning in Search-Augmented Language Models","created":"2025-06-01","cited_by_count":75,"area":"lr"},{"id":"2405.17202","title":"Efficient multi-prompt evaluation of LLMs","created":"2024-05-27","cited_by_count":73,"area":null},{"id":"2406.10229","title":"Quantifying Variance in Evaluation Benchmarks","created":"2024-06-14","cited_by_count":54,"area":null},{"id":"2510.26243","title":"Angular Steering: Behavior Control via Rotation in Activation Space","created":"2025-10-30","cited_by_count":53,"area":null},{"id":"2409.07440","title":"SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories","created":"2024-09-11","cited_by_count":52,"area":"agents"},{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52,"area":null},{"id":"2407.12861","title":"CiteME: Can Language Models Accurately Cite Scientific Claims?","created":"2024-07-10","cited_by_count":48,"area":null},{"id":"2407.08351","title":"AutoBencher: Towards Declarative Benchmark Construction","created":"2024-07-11","cited_by_count":44,"area":null},{"id":"2406.10248","title":"On the Worst Prompt Performance of Large Language Models","created":"2024-06-08","cited_by_count":38,"area":null},{"id":"2412.12497","title":"NLSR: Neuron-Level Safety Realignment of Large Language Models Against Harmful Fine-Tuning","created":"2024-12-17","cited_by_count":37,"area":"alignment"},{"id":"2512.00193","title":"A Rosetta Stone for AI Benchmarks","created":"2025-11-28","cited_by_count":36,"area":null},{"id":"2602.04837","title":"Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharing","created":"2026-02-04","cited_by_count":36,"area":"synth"},{"id":"2407.16711","title":"Benchmarks as Microscopes: A Call for Model Metrology","created":"2024-07-22","cited_by_count":35,"area":null},{"id":"2410.05952","title":"Active Evaluation Acquisition for Efficient LLM Benchmarking","created":"2024-10-08","cited_by_count":35,"area":null},{"id":"2410.12949","title":"Mechanistic Unlearning: Robust Knowledge Unlearning and Editing via Mechanistic Localization","created":"2024-10-16","cited_by_count":35,"area":"safety"},{"id":"2412.02980","title":"Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models","created":"2024-12-04","cited_by_count":35,"area":"synth"},{"id":"2509.11106","title":"Fluid Language Model Benchmarking","created":"2025-09-14","cited_by_count":35,"area":null},{"id":"2404.01475","title":"Are large language models superhuman chemists?","created":"2024-04-01","cited_by_count":34,"area":null},{"id":"2404.16966","title":"Examining the robustness of LLM evaluation to the distributional assumptions of benchmarks","created":"2024-04-25","cited_by_count":31,"area":null},{"id":"2503.13335","title":"Reliable and Efficient Amortized Model-based Evaluation","created":"2025-03-17","cited_by_count":31,"area":"lr"},{"id":"2506.07673","title":"How Benchmark Prediction from Fewer Data Misses the Mark","created":"2025-06-09","cited_by_count":28,"area":null},{"id":"2511.04689","title":"Adaptive Testing for LLM Evaluation: A Psychometric Alternative to Static Benchmarks","created":"2025-10-26","cited_by_count":28,"area":null},{"id":"2407.13696","title":"Do These LLM Benchmarks Agree? Fixing Benchmark Evaluation with BenchBench","created":"2024-07-18","cited_by_count":27,"area":null},{"id":"2406.05882","title":"Distributional Preference Alignment of LLMs via Optimal Transport","created":"2024-06-09","cited_by_count":26,"area":"alignment"},{"id":"2508.13144","title":"Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation","created":"2025-08-18","cited_by_count":26,"area":null},{"id":"2409.03563","title":"100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instances","created":"2024-09-05","cited_by_count":24,"area":null},{"id":"2412.01784","title":"Noise Injection Reveals Hidden Capabilities of Sandbagging Language Models","created":"2024-12-02","cited_by_count":24,"area":null},{"id":"2412.06540","title":"Sloth: scaling laws for LLM skills to predict multi-benchmark performance across families","created":"2024-12-09","cited_by_count":24,"area":null},{"id":"2501.18251","title":"How to Select Datapoints for Efficient Human Evaluation of NLG Models?","created":"2025-01-30","cited_by_count":23,"area":null},{"id":"2511.05408","title":"Steering Language Models with Weight Arithmetic","created":"2025-11-07","cited_by_count":20,"area":null},{"id":"2503.02574","title":"LLM-Safety Evaluations Lack Robustness","created":"2025-03-04","cited_by_count":18,"area":"alignment"},{"id":"2601.20251","title":"Efficient Evaluation of LLM Performance with Statistical Guarantees","created":"2026-01-28","cited_by_count":18,"area":null},{"id":"2406.14230","title":"Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing","created":"2024-06-20","cited_by_count":17,"area":null},{"id":"2410.10783","title":"LiveXiv -- A Multi-Modal Live Benchmark Based on Arxiv Papers Content","created":"2024-10-14","cited_by_count":17,"area":null},{"id":"2509.19727","title":"Personality Vector: Modulating Personality of Large Language Models by Model Merging","created":"2025-09-24","cited_by_count":17,"area":null},{"id":"2412.06745","title":"ONEBench to Test Them All: Sample-Level Benchmarking Over Open-Ended Capabilities","created":"2024-12-09","cited_by_count":15,"area":null},{"id":"2510.04309","title":"Activation Steering with a Feedback Controller","created":"2025-10-05","cited_by_count":15,"area":"alignment"},{"id":"2405.16236","title":"A transfer learning framework for weak-to-strong generalization","created":"2024-05-25","cited_by_count":14,"area":null},{"id":"2502.07760","title":"Scalable Fingerprinting of Large Language Models","created":"2025-02-11","cited_by_count":14,"area":null},{"id":"2508.09093","title":"Scaling Up Active Testing to Large Language Models","created":"2025-08-12","cited_by_count":13,"area":null},{"id":"2405.17423","title":"Privacy-Aware Visual Language Models","created":"2024-05-27","cited_by_count":12,"area":"mllm"},{"id":"2406.15527","title":"Data Efficient Evaluation of Large Language Models and Text-to-Image Models via Adaptive Sampling","created":"2024-06-21","cited_by_count":12,"area":null},{"id":"2407.01376","title":"Badllama 3: removing safety finetuning from Llama 3 in minutes","created":"2024-07-01","cited_by_count":11,"area":"safety"},{"id":"2502.15620","title":"Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture","created":"2025-02-21","cited_by_count":11,"area":null},{"id":"2504.17480","title":"Unified attacks to large language model watermarks: spoofing and scrubbing in unauthorized knowledge distillation","created":"2025-04-24","cited_by_count":11,"area":"safety"},{"id":"2505.03814","title":"Cer-Eval: Certifiable and Cost-Efficient Evaluation Framework for LLMs","created":"2025-05-02","cited_by_count":11,"area":null},{"id":"2510.26384","title":"Scales++: Compute Efficient Evaluation Subset Selection with Cognitive Scales Embeddings","created":"2025-10-30","cited_by_count":11,"area":null},{"id":"2512.03042","title":"PPTArena: A Benchmark for PowerPoint Editing","created":"2025-12-02","cited_by_count":11,"area":null},{"id":"2604.00594","title":"Agent psychometrics: Task-level performance prediction in agentic coding benchmarks","created":"2026-04-01","cited_by_count":11,"area":"agents"},{"id":"2402.19472","title":"Efficient Lifelong Model Evaluation in an Era of Rapid Progress","created":"2024-02-29","cited_by_count":10,"area":null},{"id":"2501.15147","title":"A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models","created":"2025-01-25","cited_by_count":10,"area":"lr"},{"id":"2502.10436","title":"MERGE$^3$: Efficient Evolutionary Merging on Consumer-grade GPUs","created":"2025-02-09","cited_by_count":10,"area":null},{"id":"2510.00844","title":"Learning Compact Representations of LLM Abilities via Item Response Theory","created":"2025-10-01","cited_by_count":10,"area":"moe"},{"id":"2601.02316","title":"DatBench: Discriminative, Faithful, and Efficient VLM Evaluations","created":"2026-01-05","cited_by_count":10,"area":null},{"id":"2603.23749","title":"Efficient Benchmarking of AI Agents","created":"2026-03-24","cited_by_count":10,"area":"agents"},{"id":"2604.11581","title":"Hidden Measurement Error in LLM Pipelines Distorts Annotation, Evaluation, and Benchmarking","created":"2026-04-13","cited_by_count":10,"area":null},{"id":"2407.01300","title":"Collaborative Performance Prediction for Large Language Models","created":"2024-07-01","cited_by_count":9,"area":null},{"id":"2410.05357","title":"Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild","created":"2024-10-07","cited_by_count":9,"area":null},{"id":"2411.01281","title":"Arena-Lite: Efficient and Reliable Large Language Model Evaluation via Tournament-Based Direct Comparisons","created":"2024-11-02","cited_by_count":9,"area":null},{"id":"2510.08730","title":"How Reliable is Language Model Micro-Benchmarking?","created":"2025-10-09","cited_by_count":9,"area":null},{"id":"2502.08020","title":"Speculate, then Collaborate: Fusing Knowledge of Language Models during Decoding","created":"2025-02-11","cited_by_count":8,"area":null},{"id":"2504.10724","title":"HELIOS: Adaptive Model And Early-Exit Selection for Efficient LLM Inference Serving","created":"2025-04-14","cited_by_count":8,"area":"inference"},{"id":"2504.21303","title":"Confidence in Large Language Model Evaluation: A Bayesian Approach to Limited-Sample Challenges","created":"2025-04-30","cited_by_count":8,"area":null},{"id":"2505.03475","title":"am-ELO: A Stable Framework for Arena-based LLM Evaluation","created":"2025-05-06","cited_by_count":8,"area":null},{"id":"2505.19959","title":"MiniLongBench: The Low-cost Long Context Understanding Benchmark for Large Language Models","created":"2025-05-26","cited_by_count":8,"area":null},{"id":"2510.10457","title":"Rethinking LLM Evaluation: Can We Evaluate LLMs with 200x Less Data?","created":"2025-10-12","cited_by_count":8,"area":null},{"id":"2602.07909","title":"SparseEval: Efficient Evaluation of Large Language Models by Sparse Optimization","created":"2026-02-08","cited_by_count":8,"area":null},{"id":"2605.28873","title":"Pre-Registering the Detectable Effect: A Paired-MDE Budget for 4-bit Quantization Benchmarks, with a Pilot Audit","created":"2026-05-25","cited_by_count":8,"area":null},{"id":"2606.12344","title":"Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks","created":"2026-06-10","cited_by_count":8,"area":null},{"id":"2502.10563","title":"Accelerating Unbiased LLM Evaluation via Synthetic Feedback","created":"2025-02-14","cited_by_count":7,"area":"alignment"},{"id":"2502.14445","title":"PredictaBoard: Benchmarking LLM Score Predictability","created":"2025-02-20","cited_by_count":7,"area":null},{"id":"2512.21326","title":"Measuring all the noises of LLM Evals","created":"2025-12-24","cited_by_count":7,"area":null},{"id":"2605.05973","title":"Towards Reliable LLM Evaluation: Correcting the Winner's Curse in Adaptive Benchmarking","created":"2026-05-07","cited_by_count":7,"area":null},{"id":"2605.30315","title":"Resolution Diagnostics for Paired LLM Evaluation","created":"2026-05-28","cited_by_count":7,"area":null},{"id":"2404.00712","title":"Survey of Computerized Adaptive Testing: A Machine Learning Perspective","created":"2024-03-31","cited_by_count":6,"area":null},{"id":"2407.04065","title":"On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboards","created":"2024-07-04","cited_by_count":6,"area":null},{"id":"2408.03325","title":"CoverBench: A Challenging Benchmark for Complex Claim Verification","created":"2024-08-06","cited_by_count":6,"area":null},{"id":"2410.10112","title":"Can We Predict Performance of Large Models across Vision-Language Tasks?","created":"2024-10-14","cited_by_count":6,"area":"mllm"},{"id":"2502.06990","title":"Investigating the Zone of Proximal Development of Language Models for In-Context Learning","created":"2025-02-10","cited_by_count":6,"area":null},{"id":"2502.15210","title":"PairBench: Are Vision-Language Models Reliable at Comparing What They See?","created":"2025-02-21","cited_by_count":6,"area":"mllm"},{"id":"2502.15563","title":"Bridging vision language model (VLM) evaluation gaps with a framework for scalable and cost-effective benchmark generation","created":"2025-02-21","cited_by_count":6,"area":"mllm"},{"id":"2508.10175","title":"Estimating Machine Translation Difficulty","created":"2025-08-13","cited_by_count":6,"area":null},{"id":"2510.17998","title":"SimBA: Simplifying Benchmark Analysis Using Performance Matrices Alone","created":"2025-10-20","cited_by_count":6,"area":null},{"id":"2601.15812","title":"ErrorMap and ErrorAtlas: Charting the Failure Landscape of Large Language Models","created":"2026-01-22","cited_by_count":6,"area":null},{"id":"2601.19375","title":"Selective Steering: Norm-Preserving Control Through Discriminative Layer Selection","created":"2026-01-27","cited_by_count":6,"area":null},{"id":"2603.08835","title":"MASEval: Extending Multi-Agent Evaluation from Models to Systems","created":"2026-03-09","cited_by_count":6,"area":"agents"},{"id":"2406.03618","title":"TACT: Advancing Complex Aggregative Reasoning with Information Extraction Tools","created":"2024-06-05","cited_by_count":5,"area":"lr"},{"id":"2410.01600","title":"ENTP: Encoder-only Next Token Prediction","created":"2024-10-02","cited_by_count":5,"area":null},{"id":"2410.18436","title":"Can Code-Switched Texts Activate a Knowledge Switch in LLMs? A Case Study on English-Korean Code-Switching","created":"2024-10-24","cited_by_count":5,"area":null},{"id":"2412.06461","title":"Ranked from Within: Ranking Large Multimodal Models Without Labels","created":"2024-12-09","cited_by_count":5,"area":"mllm"},{"id":"2412.07192","title":"PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flips","created":"2024-12-10","cited_by_count":5,"area":"alignment"},{"id":"2502.08943","title":"Beyond the Singular: Revealing the Value of Multiple Generations in Benchmark Evaluation","created":"2025-02-13","cited_by_count":5,"area":null},{"id":"2503.01345","title":"Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustness","created":"2025-03-03","cited_by_count":5,"area":null},{"id":"2504.08781","title":"Efficient Evaluation of Large Language Models via Collaborative Filtering","created":"2025-04-05","cited_by_count":5,"area":null}],"next_cursor":"100"}