{"total":133,"rows":[{"id":"2411.16594","title":"From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge","created":"2024-11-25","cited_by_count":494,"area":null},{"id":"2412.05579","title":"LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods","created":"2024-12-07","cited_by_count":465,"area":null},{"id":"2502.01534","title":"Preference Leakage: A Contamination Problem in LLM-as-a-judge","created":"2025-02-03","cited_by_count":125,"area":null},{"id":"2407.18370","title":"Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement","created":"2024-07-25","cited_by_count":105,"area":null},{"id":"2409.15254","title":"Archon: An Architecture Search Framework for Inference-Time Techniques","created":"2024-09-23","cited_by_count":60,"area":null},{"id":"2503.05061","title":"No Free Labels: Limitations of LLM-as-a-Judge Without Human Grounding","created":"2025-03-07","cited_by_count":54,"area":null},{"id":"2410.13341","title":"Limits to scalable evaluation at the frontier: LLM as Judge won't beat twice the data","created":"2024-10-17","cited_by_count":51,"area":null},{"id":"2502.12446","title":"Multi-Attribute Steering of Language Models via Targeted Intervention","created":"2025-02-18","cited_by_count":46,"area":null},{"id":"2506.22316","title":"Evaluating Scoring Bias in LLM-as-a-Judge","created":"2025-06-27","cited_by_count":43,"area":null},{"id":"2409.06857","title":"What is the Role of Small Models in the LLM Era: A Survey","created":"2024-09-10","cited_by_count":41,"area":null},{"id":"2507.02856","title":"Answer Matching Outperforms Multiple Choice for Language Model Evaluation","created":"2025-07-03","cited_by_count":41,"area":null},{"id":"2510.27106","title":"Rating Roulette: Self-Inconsistency in LLM-As-A-Judge Frameworks","created":"2025-10-31","cited_by_count":38,"area":null},{"id":"2410.20774","title":"Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluation","created":"2024-10-28","cited_by_count":29,"area":null},{"id":"2412.09569","title":"JuStRank: Benchmarking LLM Judges for System Ranking","created":"2024-12-12","cited_by_count":29,"area":null},{"id":"2503.04104","title":"LLMs Can Generate a Better Answer by Aggregating Their Own Responses","created":"2025-03-06","cited_by_count":27,"area":null},{"id":"2503.09347","title":"Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to Artifacts","created":"2025-03-12","cited_by_count":26,"area":null},{"id":"2504.10356","title":"MultiLoKo: a multilingual local knowledge benchmark for LLMs spanning 31 languages","created":"2025-04-14","cited_by_count":26,"area":null},{"id":"2601.03193","title":"UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision","created":"2026-01-06","cited_by_count":26,"area":null},{"id":"2605.29800","title":"Nine Judges, Two Effective Votes: Correlated Errors Undermine LLM Evaluation Panels","created":"2026-05-28","cited_by_count":26,"area":null},{"id":"2408.09235","title":"Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form QA","created":"2024-08-17","cited_by_count":25,"area":null},{"id":"2601.20913","title":"Noisy but Valid: Robust Statistical Evaluation of LLMs with Imperfect Judges","created":"2026-01-28","cited_by_count":24,"area":null},{"id":"2508.08285","title":"The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs","created":"2025-08-01","cited_by_count":22,"area":null},{"id":"2502.10709","title":"An Empirical Analysis of Uncertainty in Large Language Model Evaluations","created":"2025-02-15","cited_by_count":20,"area":null},{"id":"2509.21117","title":"TrustJudge: Inconsistencies of LLM-as-a-Judge and How to Alleviate Them","created":"2025-09-25","cited_by_count":20,"area":null},{"id":"2506.07949","title":"Cost-Optimal Active AI Model Evaluation","created":"2025-06-09","cited_by_count":19,"area":null},{"id":"2509.08682","title":"Automatic Failure Attribution and Critical Step Prediction Method for Multi-Agent Systems Based on Causal Inference","created":"2025-09-10","cited_by_count":18,"area":null},{"id":"2407.13244","title":"PM-LLM-Benchmark: Evaluating Large Language Models on Process Mining Tasks","created":"2024-07-18","cited_by_count":16,"area":null},{"id":"2411.04424","title":"Bayesian Calibration of Win Rate Estimation with LLM Evaluators","created":"2024-11-07","cited_by_count":16,"area":null},{"id":"2510.11822","title":"Beyond Consensus: Mitigating the Agreeableness Bias in LLM Judge Evaluations","created":"2025-10-13","cited_by_count":16,"area":null},{"id":"2602.00521","title":"Diagnosing the Reliability of LLM-as-a-Judge via Item Response Theory","created":"2026-01-31","cited_by_count":16,"area":null},{"id":"2505.03427","title":"MedArabiQ: Benchmarking Large Language Models on Arabic Medical Tasks","created":"2025-05-06","cited_by_count":15,"area":null},{"id":"2511.17826","title":"Deterministic Inference across Tensor Parallel Sizes That Eliminates Training-Inference Mismatch","created":"2025-11-21","cited_by_count":14,"area":null},{"id":"2604.07666","title":"An Imperfect Verifier is Good Enough: Learning with Noisy Rewards","created":"2026-04-09","cited_by_count":13,"area":null},{"id":"2510.08783","title":"MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfaces","created":"2025-10-09","cited_by_count":11,"area":null},{"id":"2502.17591","title":"Proactive Privacy Amnesia for Large Language Models: Safeguarding PII with Negligible Impact on Model Utility","created":"2025-02-24","cited_by_count":10,"area":null},{"id":"2505.11613","title":"MedGUIDE: Benchmarking Clinical Decision-Making in Large Language Models","created":"2025-05-16","cited_by_count":10,"area":null},{"id":"2508.14146","title":"MMReview: A Multidisciplinary and Multimodal Benchmark for LLM-Based Peer Review Automation","created":"2025-08-19","cited_by_count":10,"area":null},{"id":"2601.09487","title":"SlidesGen-Bench: Evaluating Slides Generation via Computational and Quantitative Metrics","created":"2026-01-14","cited_by_count":10,"area":null},{"id":"2604.23478","title":"JudgeSense: A Benchmark for Prompt Sensitivity in LLM-as-a-Judge Systems","created":"2026-04-26","cited_by_count":10,"area":null},{"id":"2603.05399","title":"Judge Reliability Harness: Stress Testing the Reliability of LLM Judges","created":"2026-03-05","cited_by_count":8,"area":null},{"id":"2502.01683","title":"LLM-Powered Benchmark Factory: Reliable, Generic, and Efficient","created":"2025-02-02","cited_by_count":7,"area":null},{"id":"2502.18018","title":"Verdict: A Library for Scaling Judge-Time Compute","created":"2025-02-25","cited_by_count":7,"area":null},{"id":"2508.12792","title":"Bridging Human and LLM Judgments: Understanding and Narrowing the Gap","created":"2025-08-18","cited_by_count":7,"area":null},{"id":"2510.12110","title":"Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Models","created":"2025-10-14","cited_by_count":7,"area":null},{"id":"2603.16848","title":"Mediocrity is the key for LLM as a Judge Anchor Selection","created":"2026-03-17","cited_by_count":7,"area":null},{"id":"2409.10825","title":"Unveiling and Mitigating Bias in Large Language Model Recommendations: A Path to Fairness","created":"2024-09-17","cited_by_count":6,"area":null},{"id":"2411.15560","title":"Do LLMs Agree on the Creativity Evaluation of Alternative Uses?","created":"2024-11-23","cited_by_count":6,"area":null},{"id":"2412.14612","title":"KARRIEREWEGE: A Large Scale Career Path Prediction Dataset","created":"2024-12-19","cited_by_count":6,"area":null},{"id":"2502.06633","title":"Combining Large Language Models with Static Analyzers for Code Review Generation","created":"2025-02-10","cited_by_count":6,"area":null},{"id":"2506.02945","title":"Quantitative LLM Judges","created":"2025-06-03","cited_by_count":6,"area":null},{"id":"2508.08777","title":"Evaluating Podcast Recommendations with Profile-Aware LLM-as-a-Judge","created":"2025-08-12","cited_by_count":6,"area":null},{"id":"2510.05154","title":"Can AI Truly Represent Your Voice in Deliberations? A Comprehensive Study of Large-Scale Opinion Aggregation with LLMs","created":"2025-10-02","cited_by_count":6,"area":null},{"id":"2609.29769","title":"Decision Models vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Places","created":"2026-09-24","cited_by_count":6,"area":null},{"id":"2504.08024","title":"Summarizing Speech: A Comprehensive Survey","created":"2025-04-10","cited_by_count":5,"area":null},{"id":"2506.20274","title":"Enterprise Large Language Model Evaluation Benchmark","created":"2025-06-25","cited_by_count":5,"area":null},{"id":"2601.07506","title":"Judging Against the Reference: Uncovering Knowledge-Driven Failures in LLM-Judges on QA Evaluation","created":"2026-01-12","cited_by_count":5,"area":null},{"id":"2602.13699","title":"Gradient-Stable Attention Heads Signal LLM Correctness","created":"2026-02-14","cited_by_count":5,"area":null},{"id":"2410.11096","title":"SeCodePLT: A Unified Platform for Evaluating the Security of Code GenAI","created":"2024-10-14","cited_by_count":4,"area":null},{"id":"2501.17581","title":"CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMs","created":"2025-01-29","cited_by_count":4,"area":null},{"id":"2503.05551","title":"Revitalizing Saturated Benchmarks: A Weighted Metric Approach for Differentiating Large Language Model Performance","created":"2025-03-07","cited_by_count":4,"area":null},{"id":"2505.05445","title":"clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations","created":"2025-05-08","cited_by_count":4,"area":null},{"id":"2511.01348","title":"The Future of Generative AI in Software Engineering: A Vision from Industry and Academia in the European GENIUS Project","created":"2025-11-03","cited_by_count":4,"area":null},{"id":"2512.04578","title":"LexGenius: An Expert-Level Benchmark for Large Language Models in Legal General Intelligence","created":"2025-12-04","cited_by_count":4,"area":null},{"id":"2601.15307","title":"DeepSurvey-Bench: Evaluating Academic Value of Automatically Generated Scientific Surveys","created":"2026-01-13","cited_by_count":4,"area":null},{"id":"2604.16790","title":"Bias in the Loop: Auditing LLM-as-a-Judge for Software Engineering","created":"2026-04-18","cited_by_count":4,"area":null},{"id":"2605.10267","title":"IndustryBench: Probing the Industrial Knowledge Boundaries of LLMs","created":"2026-05-11","cited_by_count":4,"area":null},{"id":"2607.12885","title":"LLM Judges Can Be Too Generous When There Is No Reference Answer","created":"2026-07-14","cited_by_count":4,"area":null},{"id":"2409.10702","title":"Model-in-the-Loop (MILO): Accelerating Multimodal AI Data Annotation with LLMs","created":"2024-09-16","cited_by_count":3,"area":null},{"id":"2410.08442","title":"JurEE not Judges: safeguarding llm interactions with small, specialised Encoder Ensembles","created":"2024-10-11","cited_by_count":3,"area":null},{"id":"2502.16942","title":"NUTSHELL: A Dataset for Abstract Generation from Scientific Talks","created":"2025-02-24","cited_by_count":3,"area":null},{"id":"2502.18339","title":"Correlating and Predicting Human Evaluations of Language Models from Natural Language Processing Benchmarks","created":"2025-02-24","cited_by_count":3,"area":null},{"id":"2503.03303","title":"SEOE: A Scalable and Reliable Semantic Evaluation Framework for Open Domain Event Detection","created":"2025-03-05","cited_by_count":3,"area":null},{"id":"2505.11189","title":"Can Global XAI Methods Reveal Injected Behaviours in LLMs? SHAP vs Rule Extraction vs RuleSHAP","created":"2025-05-16","cited_by_count":3,"area":null},{"id":"2508.00454","title":"Learning an Efficient Multi-Turn Dialogue Evaluator from Multiple LLM Judges","created":"2025-08-01","cited_by_count":3,"area":null},{"id":"2511.14967","title":"MermaidSeqBench: An Evaluation Benchmark for NL-to-Mermaid Sequence Diagram Generation","created":"2025-11-18","cited_by_count":3,"area":null},{"id":"2512.08936","title":"A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellness","created":"2025-10-23","cited_by_count":3,"area":null},{"id":"2601.14698","title":"ClaimDB: A Fact Verification Benchmark over Large Structured Data","created":"2026-01-21","cited_by_count":3,"area":null},{"id":"2603.18557","title":"Cross-Lingual LLM-Judge Transfer via Evaluation Decomposition","created":"2026-03-19","cited_by_count":3,"area":null},{"id":"2604.02359","title":"Using LLM-as-a-Judge/Jury to Advance Scalable, Clinically-Validated Safety Evaluations of Model Responses to Users Demonstrating Psychosis","created":"2026-03-20","cited_by_count":3,"area":null},{"id":"2410.20791","title":"From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap","created":"2024-10-28","cited_by_count":2,"area":null},{"id":"2412.15683","title":"Variability Need Not Imply Error: The Case of Adequate but Semantically Distinct Responses","created":"2024-12-20","cited_by_count":2,"area":null},{"id":"2512.04108","title":"Responsible LLM Deployment for High-Stake Decisions by Decentralized Technologies and Human-AI Interactions","created":"2025-11-28","cited_by_count":2,"area":null},{"id":"2512.19475","title":"A Large-Language-Model Framework for Automated Humanitarian Situation Reporting","created":"2025-12-22","cited_by_count":2,"area":null},{"id":"2603.02029","title":"Rich Insights from Cheap Signals: Efficient Evaluations via Tensor Factorization","created":"2026-03-02","cited_by_count":2,"area":null},{"id":"2604.00259","title":"LLM Essay Scoring Under Holistic and Analytic Rubrics: Prompt Effects and Bias","created":"2026-03-31","cited_by_count":2,"area":null},{"id":"2502.12052","title":"A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability","created":"2025-02-17","cited_by_count":1,"area":null},{"id":"2504.14044","title":"Multi-Stage Retrieval for Operational Technology Cybersecurity Compliance Using Large Language Models: A Railway Casestudy","created":"2025-04-18","cited_by_count":1,"area":null},{"id":"2506.19185","title":"Spiritual-LLM : Gita Inspired Mental Health Therapy In the Era of LLMs","created":"2025-06-23","cited_by_count":1,"area":null},{"id":"2508.10161","title":"LaajMeter: A Framework for LaaJ Evaluation","created":"2025-08-13","cited_by_count":1,"area":null},{"id":"2511.17432","title":"SMILE: A Composite Lexical-Semantic Metric for Question-Answering Evaluation","created":"2025-11-21","cited_by_count":1,"area":null},{"id":"2603.03319","title":"Automated Concept Discovery for LLM-as-a-Judge Preference Analysis","created":"2026-02-09","cited_by_count":1,"area":null},{"id":"2604.15873","title":"How Hypocritical Is Your LLM judge? Listener-Speaker Asymmetries in the Pragmatic Competence of Large Language Models","created":"2026-04-17","cited_by_count":1,"area":null},{"id":"2605.25652","title":"A Two-Phase Stability Study of LLM Judges and Bar Council Examiners on Thai Bar-Exam Free-Form Essays","created":"2026-05-25","cited_by_count":1,"area":null},{"id":"2605.31381","title":"LLM Judges Inconsistently Disagree Across Safety Criteria and Harm Categories","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2606.07936","title":"Illusions of the Gold Standard: A Large-scale Analysis of Human Evaluation Protocols for Long-form Text Generation","created":"2026-06-06","cited_by_count":1,"area":null},{"id":"2606.19714","title":"AURA: Adaptive Uncertainty-aware Refinement for LLM-as-a-Judge Auditing","created":"2026-06-18","cited_by_count":1,"area":null},{"id":"2608.23705","title":"The Limits of Automatic Evaluation of Creativity in Large Language Models","created":"2026-08-24","cited_by_count":1,"area":null},{"id":"2412.17395","title":"WarriorCoder: Learning from Expert Battles to Augment Code Large Language Models","created":"2024-12-23","cited_by_count":0,"area":null},{"id":"2502.07186","title":"PCS: Perceived Confidence Scoring of Black Box LLMs with Metamorphic Relations","created":"2025-02-11","cited_by_count":0,"area":null},{"id":"2508.04945","title":"Towards Robust Evaluation of Visual Activity Recognition: Resolving Verb Ambiguity with Sense Clustering","created":"2025-08-07","cited_by_count":0,"area":null}],"next_cursor":"100"}