{"total":90,"rows":[{"id":"2406.12624","title":"Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges","created":"2024-06-18","cited_by_count":205,"area":null},{"id":"2406.11657","title":"Can LLM be a Personalized Judge?","created":"2024-06-17","cited_by_count":100,"area":null},{"id":"2407.04069","title":"A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations","created":"2024-07-04","cited_by_count":85,"area":null},{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52,"area":null},{"id":"2505.10831","title":"Creating General User Models from Computer Use","created":"2025-05-16","cited_by_count":44,"area":null},{"id":"2502.14815","title":"Optimizing Model Selection for Compound AI Systems","created":"2025-02-20","cited_by_count":36,"area":null},{"id":"2412.13091","title":"LMUnit: Fine-grained Evaluation with Natural Language Unit Tests","created":"2024-12-17","cited_by_count":33,"area":null},{"id":"2505.13360","title":"What Prompts Don't Say: Understanding and Managing Underspecification in LLM Prompts","created":"2025-05-19","cited_by_count":32,"area":null},{"id":"2504.18838","title":"Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks","created":"2025-04-26","cited_by_count":28,"area":null},{"id":"2409.08775","title":"What Should We Engineer in Prompts? Training Humans in Requirement-Driven LLM Use","created":"2024-09-13","cited_by_count":24,"area":null},{"id":"2601.20913","title":"Noisy but Valid: Robust Statistical Evaluation of LLMs with Imperfect Judges","created":"2026-01-28","cited_by_count":24,"area":null},{"id":"2502.17898","title":"VeriPlan: Integrating Formal Verification and LLMs into End-User Planning","created":"2025-02-25","cited_by_count":20,"area":null},{"id":"2602.08672","title":"Learning to Judge: LLMs Designing and Applying Evaluation Rubrics","created":"2026-02-09","cited_by_count":19,"area":null},{"id":"2503.12600","title":"GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluation","created":"2025-03-16","cited_by_count":17,"area":null},{"id":"2409.19242","title":"SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback Refinement","created":"2024-09-28","cited_by_count":15,"area":null},{"id":"2604.07666","title":"An Imperfect Verifier is Good Enough: Learning with Noisy Rewards","created":"2026-04-09","cited_by_count":13,"area":null},{"id":"2410.12071","title":"Beyond the Comfort Zone: Emerging Solutions to Overcome Challenges in Integrating LLMs into Software Products","created":"2024-10-15","cited_by_count":11,"area":null},{"id":"2503.23339","title":"A Scalable Framework for Evaluating Health Language Models","created":"2025-03-30","cited_by_count":11,"area":null},{"id":"2504.07971","title":"SPHERE: An Evaluation Card for Human-AI Systems","created":"2025-03-24","cited_by_count":9,"area":null},{"id":"2506.17863","title":"LLMs for Customized Marketing Content Generation and Evaluation at Scale","created":"2025-06-22","cited_by_count":9,"area":null},{"id":"2503.00269","title":"Reducing Large Language Model Safety Risks in Women's Health using Semantic Entropy","created":"2025-03-01","cited_by_count":8,"area":null},{"id":"2604.23178","title":"Judging the Judges: A Systematic Evaluation of Bias Mitigation Strategies in LLM-as-a-Judge Pipelines","created":"2026-04-25","cited_by_count":8,"area":null},{"id":"2502.07974","title":"From Hazard Identification to Controller Design: Proactive and LLM-Supported Safety Engineering for ML-Powered Systems","created":"2025-02-11","cited_by_count":7,"area":null},{"id":"2502.10407","title":"Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Management","created":"2025-01-22","cited_by_count":7,"area":null},{"id":"2502.18018","title":"Verdict: A Library for Scaling Judge-Time Compute","created":"2025-02-25","cited_by_count":7,"area":null},{"id":"2504.05325","title":"Unequal Opportunities: Examining the Bias in Geographical Recommendations by Large Language Models","created":"2025-03-16","cited_by_count":7,"area":null},{"id":"2510.14591","title":"Just-In-Time Objectives: A General Approach for Specialized AI Interactions","created":"2025-10-16","cited_by_count":7,"area":null},{"id":"2405.11612","title":"Sociotechnical Implications of Generative Artificial Intelligence for Information Access","created":"2024-05-19","cited_by_count":6,"area":null},{"id":"2409.18203","title":"Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviors","created":"2024-09-26","cited_by_count":5,"area":null},{"id":"2412.16829","title":"Visual Prompting with Iterative Refinement for Design Critique Generation","created":"2024-12-22","cited_by_count":5,"area":null},{"id":"2508.12358","title":"Uncovering Systematic Failures of LLMs in Verifying Code Against Natural Language Specifications","created":"2025-08-17","cited_by_count":5,"area":null},{"id":"2605.25240","title":"JudgmentBench: Comparing Rubric and Preference Evaluation for Quality Assessment","created":"2026-05-24","cited_by_count":5,"area":null},{"id":"2505.21972","title":"LLMs Judging LLMs: A Simplex Perspective","created":"2025-05-28","cited_by_count":4,"area":null},{"id":"2509.03764","title":"LLM-based Relevance Assessment for Web-Scale Search Evaluation at Pinterest","created":"2025-09-03","cited_by_count":4,"area":null},{"id":"2603.00539","title":"Are LLMs Reliable Code Reviewers? Systematic Overcorrection in Requirement Conformance Judgement","created":"2026-02-28","cited_by_count":4,"area":null},{"id":"2411.01228","title":"The Interaction Layer: An Exploration for Co-Designing User-LLM Interactions in Parental Wellbeing Support Systems","created":"2024-11-02","cited_by_count":3,"area":null},{"id":"2411.13760","title":"A Framework for Evaluating LLMs Under Task Indeterminacy","created":"2024-11-21","cited_by_count":3,"area":null},{"id":"2504.09283","title":"Semantic Commit: Helping Users Update Intent Specifications for AI Memory at Scale","created":"2025-04-12","cited_by_count":3,"area":null},{"id":"2504.10391","title":"LLM-driven Constrained Copy Generation through Iterative Refinement","created":"2025-04-14","cited_by_count":3,"area":null},{"id":"2505.18514","title":"Test-Time Adaptation with Binary Feedback","created":"2025-05-24","cited_by_count":3,"area":null},{"id":"2509.11206","title":"Evalet: Evaluating Large Language Models through Functional Fragmentation","created":"2025-09-14","cited_by_count":3,"area":null},{"id":"2512.08936","title":"A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellness","created":"2025-10-23","cited_by_count":3,"area":null},{"id":"2603.15676","title":"Automated Self-Testing as a Quality Gate: Evidence-Driven Release Management for LLM Applications","created":"2026-03-13","cited_by_count":3,"area":null},{"id":"2508.08504","title":"When the Domain Expert Has No Time and the LLM Developer Has No Clinical Expertise: Real-World Lessons from LLM Co-Design in a Safety-Net Hospital","created":"2025-08-11","cited_by_count":2,"area":null},{"id":"2602.05636","title":"Generative Ontology: When Structured Knowledge Learns to Create","created":"2026-02-05","cited_by_count":2,"area":null},{"id":"2604.21769","title":"Who Defines \"Best\"? Towards Interactive, User-Defined Evaluation of LLM Leaderboards","created":"2026-04-23","cited_by_count":2,"area":null},{"id":"2409.16001","title":"Artificial Human Intelligence: The role of Humans in the Development of Next Generation AI","created":"2024-09-24","cited_by_count":1,"area":null},{"id":"2501.13480","title":"Adaptive Testing for LLM-Based Applications: A Diversity-based Approach","created":"2025-01-23","cited_by_count":1,"area":null},{"id":"2502.13016","title":"LLM-Powered Proactive Data Systems","created":"2025-02-18","cited_by_count":1,"area":null},{"id":"2502.20635","title":"Can LLM Assist in the Evaluation of the Quality of Machine Learning Explanations?","created":"2025-02-28","cited_by_count":1,"area":null},{"id":"2507.02819","title":"Measurement as Bricolage: Examining How Data Scientists Construct Target Variables for Predictive Modeling Tasks","created":"2025-07-03","cited_by_count":1,"area":null},{"id":"2507.03829","title":"RELRaE: LLM-Based Relationship Extraction, Labelling, Refinement, and Evaluation","created":"2025-07-04","cited_by_count":1,"area":null},{"id":"2510.12728","title":"Data-Prompt Co-Evolution: Growing Test Sets to Refine LLM Behavior","created":"2025-10-14","cited_by_count":1,"area":null},{"id":"2510.25662","title":"User Misconceptions of LLM-Based Conversational Programming Assistants","created":"2025-10-29","cited_by_count":1,"area":null},{"id":"2511.21708","title":"Lost in the Pipeline: How Well Do Large Language Models Handle Data Preparation?","created":"2025-11-17","cited_by_count":1,"area":null},{"id":"2602.14357","title":"Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Study","created":"2026-02-16","cited_by_count":1,"area":null},{"id":"2605.05767","title":"Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wild","created":"2026-05-07","cited_by_count":1,"area":null},{"id":"2606.05384","title":"Stability vs. Manipulability: Evaluating Robustness Under Post-Decision Interaction in LLM Judges","created":"2026-06-03","cited_by_count":1,"area":null},{"id":"2606.26185","title":"Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations","created":"2026-06-24","cited_by_count":1,"area":null},{"id":"2608.25824","title":"Localize-Then-Decide Guarantees for LLM Judgments","created":"2026-08-26","cited_by_count":1,"area":null},{"id":"2608.25869","title":"Anchoring Bias in LLM-as-a-Judge Systems: Prior Scores Compromise Evaluation Independence","created":"2026-08-26","cited_by_count":1,"area":null},{"id":"2609.22512","title":"Agreement Overstates Evidence: Error Dependence in LLM Judge Consensus","created":"2026-09-18","cited_by_count":1,"area":null},{"id":"2411.10055","title":"Towards unearthing neglected climate innovations from scientific literature using Large Language Models","created":"2024-11-15","cited_by_count":0,"area":null},{"id":"2502.08312","title":"Word Synchronization Challenge: A Benchmark for Word Association Responses for Large Language Models","created":"2025-02-12","cited_by_count":0,"area":null},{"id":"2507.19567","title":"Differentiating hype from practical applications of large language models in medicine -- a primer for healthcare professionals","created":"2025-07-25","cited_by_count":0,"area":null},{"id":"2508.06443","title":"The Fair Game: Auditing & Debiasing AI Algorithms Over Time","created":"2025-08-08","cited_by_count":0,"area":null},{"id":"2508.18636","title":"LaQual: An Automated Framework for LLM App Quality Evaluation","created":"2025-08-26","cited_by_count":0,"area":null},{"id":"2509.02476","title":"Perturbing the Derivative: Wild Refitting for Model-Free Evaluation of Machine Learning Models under Bregman Losses","created":"2025-09-02","cited_by_count":0,"area":null},{"id":"2512.04442","title":"TaskEval: Synthesised Evaluation for Foundation-Model Tasks","created":"2025-12-04","cited_by_count":0,"area":null},{"id":"2602.11091","title":"Can Large Language Models Make Everyone Happy?","created":"2026-02-11","cited_by_count":0,"area":null},{"id":"2603.22766","title":"From Overload to Convergence: Supporting Multi-Issue Human-AI Negotiation with Bayesian Visualization","created":"2026-03-24","cited_by_count":0,"area":null},{"id":"2604.00396","title":"VLM-in-the-Loop: A Plug-In Quality Assurance Module for ECG Digitization Pipelines","created":"2026-04-01","cited_by_count":0,"area":null},{"id":"2604.16304","title":"Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild","created":"2026-01-25","cited_by_count":0,"area":null},{"id":"2604.27275","title":"Evaluating Epistemic Guardrails in AI Reading Assistants: A Behavioral Audit of a Minimal Prototype","created":"2026-04-30","cited_by_count":0,"area":null},{"id":"2605.02765","title":"U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning","created":"2026-05-04","cited_by_count":0,"area":null},{"id":"2606.16368","title":"Evaluating LLM Personalization via Semantic Constraint Verification","created":"2026-06-15","cited_by_count":0,"area":null},{"id":"2607.05638","title":"EvalLoop: A Methodology for Evaluation-Driven Iterative Improvement of Business AI Systems","created":"2026-07-06","cited_by_count":0,"area":null},{"id":"2608.01810","title":"RADAR: Rubric-Aware Dependency and Redundancy Analysis for LLM-as-Judge Evaluation","created":"2026-08-03","cited_by_count":0,"area":null},{"id":"2609.04141","title":"Efficient Test-Time Adaptation through Human-AI Interaction","created":"2026-09-03","cited_by_count":0,"area":null},{"id":"2609.06212","title":"SLATE: Are AI-Generated Slides Educationally Effective? A Benchmark for Language Teaching Quality and Learner Knowledge Acquisition","created":"2026-09-05","cited_by_count":0,"area":null},{"id":"2609.10385","title":"MOONWALK: Mediating Operations with Intent-Evidence-Action Alignment Across Junior-Supervisor Review Workflows in Animation/VFX Pre-Production","created":"2026-09-09","cited_by_count":0,"area":null},{"id":"2609.26926","title":"Experts Rise Where LLMs Disagree: Using Cross-Model Disagreement to Target Expert Effort in LLM Codebook Revision for Large-Scale Annotation","created":"2026-09-22","cited_by_count":0,"area":null},{"id":"2609.27043","title":"EduBehaviors: Assertion-based Schemas for Auditable Coding of Educational Dialogues","created":"2026-09-22","cited_by_count":0,"area":null},{"id":"2609.33179","title":"Scoring the Wrong Question: Readout Failures in Constrained-Option Evaluation","created":"2026-09-27","cited_by_count":0,"area":null},{"id":"2609.34799","title":"STRIDE: Automated Evaluation of Text-to-Trajectory Alignment across Diverse Contexts","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2609.35815","title":"How to Run Statistics over LLM Judges and Trust the Results: Calibrated Inference for Small-Sample AI Evaluation with evalstats","created":"2026-09-20","cited_by_count":0,"area":null},{"id":"2609.39909","title":"DoGBench: Can Agents Meet Expert Standards for User-Facing Documentation?","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.04430","title":"MERCI Cards: An LLM Evaluation and Deployment Framework for High-Stakes Domains","created":"2026-10-03","cited_by_count":0,"area":null},{"id":"2610.10809","title":"Evaluating Rubric Generation with Interventional Transfer","created":"2026-10-07","cited_by_count":0,"area":null},{"id":"2610.18635","title":"DTScribe: Generating Models for Digital Twin Reporting using Local Large Language Models","created":"2026-10-13","cited_by_count":0,"area":null}],"next_cursor":null}