{"total":65,"rows":[{"id":"2411.16594","title":"From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge","created":"2024-11-25","cited_by_count":494,"area":null},{"id":"2412.05579","title":"LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods","created":"2024-12-07","cited_by_count":465,"area":null},{"id":"2406.07791","title":"Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge","created":"2024-06-12","cited_by_count":269,"area":null},{"id":"2410.07137","title":"Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates","created":"2024-10-09","cited_by_count":45,"area":null},{"id":"2508.18076","title":"Neither Valid nor Reliable? Investigating the Use of LLMs as Judges","created":"2025-08-25","cited_by_count":39,"area":null},{"id":"2503.03064","title":"Improving LLM-as-a-Judge Inference with the Judgment Distribution","created":"2025-03-04","cited_by_count":37,"area":null},{"id":"2410.15393","title":"CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-Judges","created":"2024-10-20","cited_by_count":34,"area":null},{"id":"2505.12201","title":"How Reliable is Multilingual LLM-as-a-Judge?","created":"2025-05-18","cited_by_count":30,"area":null},{"id":"2410.20774","title":"Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluation","created":"2024-10-28","cited_by_count":29,"area":null},{"id":"2503.09347","title":"Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to Artifacts","created":"2025-03-12","cited_by_count":26,"area":null},{"id":"2601.03193","title":"UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision","created":"2026-01-06","cited_by_count":26,"area":null},{"id":"2502.10709","title":"An Empirical Analysis of Uncertainty in Large Language Model Evaluations","created":"2025-02-15","cited_by_count":20,"area":null},{"id":"2407.03453","title":"On Large Language Models in National Security Applications","created":"2024-07-03","cited_by_count":19,"area":null},{"id":"2406.03777","title":"Empirical Guidelines for Deploying LLMs onto Resource-constrained Edge Devices","created":"2024-06-06","cited_by_count":17,"area":null},{"id":"2501.17858","title":"Improving Your Model Ranking on Chatbot Arena by Vote Rigging","created":"2025-01-29","cited_by_count":17,"area":null},{"id":"2510.11288","title":"Emergent Misalignment via In-Context Learning: Narrow in-context examples can produce broadly misaligned LLMs","created":"2025-10-13","cited_by_count":17,"area":null},{"id":"2407.13244","title":"PM-LLM-Benchmark: Evaluating Large Language Models on Process Mining Tasks","created":"2024-07-18","cited_by_count":16,"area":null},{"id":"2506.11113","title":"Breaking the Reviewer: Assessing the Vulnerability of Large Language Models in Automated Peer Review Under Textual Adversarial Attacks","created":"2025-06-08","cited_by_count":16,"area":null},{"id":"2502.02260","title":"Position: Adversarial ML for LLMs Is Not Making Any Progress","created":"2025-02-04","cited_by_count":15,"area":null},{"id":"2504.11972","title":"Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses","created":"2025-04-16","cited_by_count":14,"area":null},{"id":"2605.12673","title":"Do Androids Dream of Breaking the Game? Systematically Auditing AI Agent Benchmarks with BenchJack","created":"2026-05-12","cited_by_count":14,"area":null},{"id":"2505.18658","title":"Robustness in Large Language Models: A Survey of Mitigation Strategies and Evaluation Metrics","created":"2025-05-24","cited_by_count":12,"area":null},{"id":"2605.18661","title":"AI for Auto-Research: Roadmap & User Guide","created":"2026-05-18","cited_by_count":11,"area":null},{"id":"2412.09269","title":"Towards Understanding the Robustness of LLM-based Evaluations under Perturbations","created":"2024-12-12","cited_by_count":10,"area":null},{"id":"2508.11847","title":"Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings","created":"2025-08-16","cited_by_count":8,"area":null},{"id":"2601.06884","title":"Paraphrasing Adversarial Attack on LLM-as-a-Reviewer","created":"2026-01-11","cited_by_count":8,"area":null},{"id":"2404.11960","title":"MCRanker: Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers","created":"2024-04-18","cited_by_count":7,"area":null},{"id":"2510.23854","title":"Can LLMs Narrate Tabular Data? An Evaluation Framework for Natural Language Representations of Text-to-SQL System Outputs","created":"2025-10-27","cited_by_count":7,"area":null},{"id":"2409.18475","title":"Data Analysis in the Era of Generative AI","created":"2024-09-27","cited_by_count":6,"area":null},{"id":"2501.16033","title":"Helping Johnny Make Sense of Privacy Policies with LLMs","created":"2025-01-27","cited_by_count":5,"area":null},{"id":"2502.13031","title":"HPSS: Heuristic Prompting Strategy Search for LLM Evaluators","created":"2025-02-18","cited_by_count":5,"area":null},{"id":"2412.00621","title":"Exposing LLM Vulnerabilities: Adversarial Scam Detection and Performance","created":"2024-12-01","cited_by_count":4,"area":null},{"id":"2605.26156","title":"Turning Bias into Bugs: Bandit-Guided Style Manipulation Attacks on LLM Judges","created":"2026-05-24","cited_by_count":4,"area":null},{"id":"2609.30243","title":"JevOut: Natural Context Can Flip Decision Models","created":"2026-09-24","cited_by_count":4,"area":null},{"id":"2512.08936","title":"A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellness","created":"2025-10-23","cited_by_count":3,"area":null},{"id":"2408.00728","title":"CERT-ED: Certifiably Robust Text Classification for Edit Distance","created":"2024-08-01","cited_by_count":2,"area":null},{"id":"2509.19880","title":"Do Before You Judge: Self-Reference as a Pathway to Better LLM Evaluation","created":"2025-09-24","cited_by_count":2,"area":null},{"id":"2510.06823","title":"Exposing Citation Vulnerabilities in Generative Engines","created":"2025-10-08","cited_by_count":2,"area":null},{"id":"2604.23593","title":"When AI reviews science: Can we trust the referee?","created":"2026-04-26","cited_by_count":2,"area":null},{"id":"2605.15761","title":"A Unified Perturbation Framework for Analyzing Leaderboard Stability and Manipulation","created":"2026-05-15","cited_by_count":2,"area":null},{"id":"2606.11643","title":"Improving Cross-Format Robustness in Language Models with Multi-Format Training","created":"2026-06-10","cited_by_count":2,"area":null},{"id":"2410.20490","title":"Who Speaks Matters: Analysing the Influence of the Speaker's Ethnicity on Hate Classification","created":"2024-10-27","cited_by_count":1,"area":null},{"id":"2505.07247","title":"SAS-Bench: A Fine-Grained Benchmark for Evaluating Short Answer Scoring with Large Language Models","created":"2025-05-12","cited_by_count":1,"area":null},{"id":"2512.02625","title":"CryptoQA: A Large-scale Question-answering Dataset for AI-assisted Cryptography","created":"2025-12-02","cited_by_count":1,"area":null},{"id":"2601.15511","title":"AdversaRiskQA: An Adversarial Factuality Benchmark for High-Risk Domains","created":"2026-01-21","cited_by_count":1,"area":null},{"id":"2602.16039","title":"How Uncertain Is the Grade? A Benchmark of Uncertainty Metrics for LLM-Based Automatic Assessment","created":"2026-02-17","cited_by_count":1,"area":null},{"id":"2603.23517","title":"Beyond Accuracy: Introducing a Symbolic-Mechanistic Approach to Interpretable Evaluation","created":"2026-03-06","cited_by_count":1,"area":null},{"id":"2502.18874","title":"Learning to Align Multi-Faceted Evaluation: A Unified and Robust Framework","created":"2025-02-26","cited_by_count":0,"area":null},{"id":"2508.07975","title":"Improving Document Retrieval Coherence for Semantically Equivalent Queries","created":"2025-08-11","cited_by_count":0,"area":null},{"id":"2511.03128","title":"From Insight to Exploit: Leveraging LLM Collaboration for Adaptive Adversarial Text Generation","created":"2025-11-05","cited_by_count":0,"area":null},{"id":"2602.07673","title":"Blind to the Human Touch: Overlap Bias in LLM-Based Summary Evaluation","created":"2026-02-07","cited_by_count":0,"area":null},{"id":"2603.04417","title":"Same Input, Different Scores: A Multi Model Study on the Inconsistency of LLM Judge","created":"2026-02-04","cited_by_count":0,"area":null},{"id":"2605.06656","title":"Why Global LLM Leaderboards Are Misleading: Small Portfolios for Heterogeneous Supervised ML","created":"2026-05-07","cited_by_count":0,"area":null},{"id":"2605.12422","title":"Predicting Disagreement with Human Raters in LLM-as-a-Judge Difficulty Assessment without Using Generation-Time Probability Signals","created":"2026-05-12","cited_by_count":0,"area":null},{"id":"2605.23970","title":"Faithful or Fabricated? A Causal Framework for Rationalization Bias in LLM Judges","created":"2026-05-13","cited_by_count":0,"area":null},{"id":"2605.30521","title":"Evaluating using Mock Tool Calls to Quarantine Untrusted Prompt Inputs","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2606.30219","title":"EvalSafetyGap: A Hybrid Survey and Conceptual Framework for LLM Evaluation-Safety Failures","created":"2026-06-29","cited_by_count":0,"area":null},{"id":"2607.10402","title":"Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerability","created":"2026-07-11","cited_by_count":0,"area":null},{"id":"2607.28636","title":"Chain-of-Models: Cross-Model Auditing for Bias-Robust LLM Judges","created":"2026-05-19","cited_by_count":0,"area":null},{"id":"2609.11067","title":"When Noise Fabricates Bias: The Fragility of LLM-as-a-Judge Bias Measurement under Noisy Text","created":"2026-09-10","cited_by_count":0,"area":null},{"id":"2609.24516","title":"LLJ Cards: Best practices for the Use of LLMs as Judges","created":"2026-09-21","cited_by_count":0,"area":null},{"id":"2610.02022","title":"Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation","created":"2026-10-01","cited_by_count":0,"area":null},{"id":"2610.16814","title":"StableJudge: A Lightweight Adversarial Defense Framework for LLM-as-a-Judge","created":"2026-10-12","cited_by_count":0,"area":null},{"id":"2610.17820","title":"Same Attack, Different Judge: A First Controlled Adversarial Comparison of Jev, LLM Judges, and Purpose-Built Safety Classifiers","created":"2026-10-13","cited_by_count":0,"area":null},{"id":"2610.19992","title":"SoK: Grading Open-Text Legal Answers, from Law School Exams to Trustworthy Rubric Judges","created":"2026-10-14","cited_by_count":0,"area":null}],"next_cursor":null}