{"total":144,"rows":[{"id":"2412.05579","title":"LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods","created":"2024-12-07","cited_by_count":465,"area":null},{"id":"2401.12794","title":"Benchmarking LLMs via Uncertainty Quantification","created":"2024-01-23","cited_by_count":126,"area":null},{"id":"2312.14033","title":"T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Step","created":"2023-12-21","cited_by_count":93,"area":null},{"id":"2404.01349","title":"Fairness in Large Language Models: A Taxonomic Survey","created":"2024-03-31","cited_by_count":58,"area":null},{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52,"area":null},{"id":"2402.16775","title":"A Comprehensive Evaluation of Quantization Strategies for Large Language Models","created":"2024-02-26","cited_by_count":48,"area":null},{"id":"2406.18406","title":"IRCAN: Mitigating Knowledge Conflicts in LLM Generation via Identifying and Reweighting Context-Aware Neurons","created":"2024-06-26","cited_by_count":38,"area":null},{"id":"2404.16038","title":"A Survey on Generative AI and LLM for Video Generation, Understanding, and Streaming","created":"2024-01-30","cited_by_count":37,"area":null},{"id":"2402.15043","title":"KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models","created":"2024-02-23","cited_by_count":36,"area":null},{"id":"2404.16966","title":"Examining the robustness of LLM evaluation to the distributional assumptions of benchmarks","created":"2024-04-25","cited_by_count":31,"area":null},{"id":"2504.15521","title":"The Bitter Lesson Learned from 2,000+ Multilingual Benchmarks","created":"2025-04-22","cited_by_count":31,"area":null},{"id":"2406.00936","title":"A Survey of Useful LLM Evaluation","created":"2024-06-03","cited_by_count":29,"area":null},{"id":"2410.02650","title":"Undesirable Memorization in Large Language Models: A Survey","created":"2024-10-03","cited_by_count":29,"area":null},{"id":"2502.14776","title":"SurveyX: Academic Survey Automation via Large Language Models","created":"2025-02-20","cited_by_count":29,"area":null},{"id":"2407.10627","title":"Arena Learning: Build Data Flywheel for LLMs Post-training via Simulated Chatbot Arena","created":"2024-07-15","cited_by_count":26,"area":null},{"id":"2506.11094","title":"The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMs","created":"2025-06-06","cited_by_count":26,"area":null},{"id":"2408.08656","title":"LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMs","created":"2024-08-16","cited_by_count":25,"area":null},{"id":"2410.15319","title":"Causality for Large Language Models","created":"2024-10-20","cited_by_count":25,"area":null},{"id":"2402.11100","title":"When LLMs Meet Cunning Texts: A Fallacy Understanding Benchmark for Large Language Models","created":"2024-02-16","cited_by_count":22,"area":null},{"id":"2404.06644","title":"Khayyam Challenge (PersianMMLU): Is Your LLM Truly Wise to The Persian Language?","created":"2024-04-09","cited_by_count":22,"area":null},{"id":"2407.07796","title":"Evaluating Large Language Models with Grid-Based Game Competitions: An Extensible LLM Benchmark and Leaderboard","created":"2024-07-10","cited_by_count":22,"area":null},{"id":"2407.13934","title":"Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models","created":"2024-06-01","cited_by_count":22,"area":null},{"id":"2312.16132","title":"RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Models","created":"2023-12-26","cited_by_count":21,"area":null},{"id":"2406.17789","title":"Spanish and LLM Benchmarks: is MMLU Lost in Translation?","created":"2024-05-28","cited_by_count":20,"area":null},{"id":"2407.12858","title":"Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)","created":"2024-07-10","cited_by_count":20,"area":null},{"id":"2405.11874","title":"xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation","created":"2024-05-20","cited_by_count":19,"area":null},{"id":"2404.08008","title":"Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competition","created":"2024-04-10","cited_by_count":18,"area":null},{"id":"2406.03339","title":"The Challenges of Evaluating LLM Applications: An Analysis of Automated, Human, and LLM-Based Approaches","created":"2024-06-05","cited_by_count":18,"area":null},{"id":"2401.00437","title":"BatchEval: Towards Human-like Text Evaluation","created":"2023-12-31","cited_by_count":17,"area":null},{"id":"2404.15777","title":"A Comprehensive Survey on Evaluating Large Language Model Applications in the Medical Industry","created":"2024-04-24","cited_by_count":17,"area":null},{"id":"2405.02637","title":"TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistants","created":"2024-05-04","cited_by_count":17,"area":null},{"id":"2405.02178","title":"Assessing and Verifying Task Utility in LLM-Powered Applications","created":"2024-05-03","cited_by_count":16,"area":null},{"id":"2402.01874","title":"The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Models","created":"2024-02-02","cited_by_count":15,"area":null},{"id":"2405.11290","title":"MBIAS: Mitigating Bias in Large Language Models While Retaining Context","created":"2024-05-18","cited_by_count":15,"area":null},{"id":"2505.03427","title":"MedArabiQ: Benchmarking Large Language Models on Arabic Medical Tasks","created":"2025-05-06","cited_by_count":15,"area":null},{"id":"2504.12558","title":"Benchmarking LLM-based Relevance Judgment Methods","created":"2025-04-17","cited_by_count":14,"area":null},{"id":"2404.17047","title":"Near to Mid-term Risks and Opportunities of Open-Source Generative AI","created":"2024-04-25","cited_by_count":13,"area":null},{"id":"2405.08597","title":"Risks and Opportunities of Open-Source Generative AI","created":"2024-05-14","cited_by_count":13,"area":null},{"id":"2405.19740","title":"PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations","created":"2024-05-30","cited_by_count":13,"area":null},{"id":"2502.14502","title":"How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?","created":"2025-02-20","cited_by_count":13,"area":null},{"id":"2505.18658","title":"Robustness in Large Language Models: A Survey of Mitigation Strategies and Evaluation Metrics","created":"2025-05-24","cited_by_count":12,"area":null},{"id":"2410.06003","title":"Is the MMI Criterion Necessary for Interpretability? Degenerating Non-causal Features to Plain Noise for Self-Rationalization","created":"2024-10-08","cited_by_count":11,"area":null},{"id":"2503.23339","title":"A Scalable Framework for Evaluating Health Language Models","created":"2025-03-30","cited_by_count":11,"area":null},{"id":"2403.17859","title":"ChroniclingAmericaQA: A Large-scale Question Answering Dataset based on Historical American Newspaper Pages","created":"2024-03-26","cited_by_count":10,"area":null},{"id":"2408.06273","title":"FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data","created":"2024-08-12","cited_by_count":10,"area":null},{"id":"2408.09819","title":"CMoralEval: A Moral Evaluation Benchmark for Chinese Large Language Models","created":"2024-08-19","cited_by_count":10,"area":null},{"id":"2506.02672","title":"EvaLearn: Quantifying the Learning Capability and Efficiency of LLMs via Sequential Problem Solving","created":"2025-06-03","cited_by_count":10,"area":null},{"id":"2403.12316","title":"OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety","created":"2024-03-18","cited_by_count":9,"area":null},{"id":"2406.07736","title":"MultiPragEval: Multilingual Pragmatic Evaluation of Large Language Models","created":"2024-06-11","cited_by_count":9,"area":null},{"id":"2406.11402","title":"Are Small Language Models Ready to Compete with Large Language Models for Practical Applications?","created":"2024-06-17","cited_by_count":9,"area":null},{"id":"2406.16714","title":"AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models","created":"2024-06-24","cited_by_count":9,"area":null},{"id":"2505.19240","title":"LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Models","created":"2025-05-25","cited_by_count":9,"area":null},{"id":"2403.12675","title":"Pragmatic Competence Evaluation of Large Language Models for the Korean Language","created":"2024-03-19","cited_by_count":8,"area":null},{"id":"2405.13578","title":"ConTrans: Weak-to-Strong Alignment Engineering via Concept Transplantation","created":"2024-05-22","cited_by_count":8,"area":null},{"id":"2411.14483","title":"Ranking Unraveled: Recipes for LLM Rankings in Head-to-Head AI Combat","created":"2024-11-19","cited_by_count":8,"area":null},{"id":"2502.19676","title":"FOReCAst: The Future Outcome Reasoning and Confidence Assessment Benchmark","created":"2025-02-27","cited_by_count":8,"area":null},{"id":"2504.13938","title":"Never Start from Scratch: Expediting On-Device LLM Personalization via Explainable Model Selection","created":"2025-04-15","cited_by_count":8,"area":null},{"id":"2404.06003","title":"FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models","created":"2024-04-09","cited_by_count":7,"area":null},{"id":"2412.15557","title":"MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems","created":"2024-12-20","cited_by_count":7,"area":null},{"id":"2406.10366","title":"Improving the Validity and Practical Usefulness of AI/ML Evaluations Using an Estimands Framework","created":"2024-06-14","cited_by_count":6,"area":null},{"id":"2406.14023","title":"Evaluating Implicit Bias in Large Language Models by Attacking From a Psychometric Perspective","created":"2024-06-20","cited_by_count":6,"area":null},{"id":"2407.04065","title":"On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboards","created":"2024-07-04","cited_by_count":6,"area":null},{"id":"2410.12445","title":"Open Ko-LLM Leaderboard2: Bridging Foundational and Practical Evaluation for Korean LLMs","created":"2024-10-16","cited_by_count":6,"area":null},{"id":"2412.05145","title":"Explingo: Explaining AI Predictions using Large Language Models","created":"2024-12-06","cited_by_count":6,"area":null},{"id":"2501.13778","title":"Explainable XR: Understanding User Behaviors of XR Environments using LLM-assisted Analytics Framework","created":"2025-01-23","cited_by_count":6,"area":null},{"id":"2503.01033","title":"Variance reduction in output from generative AI","created":"2025-03-02","cited_by_count":6,"area":null},{"id":"2505.02118","title":"Adversarial Cooperative Rationalization: The Risk of Spurious Correlations in Even Clean Datasets","created":"2025-05-04","cited_by_count":6,"area":null},{"id":"2509.18776","title":"AECBench: A Hierarchical Benchmark for Knowledge Evaluation of Large Language Models in the AEC Field","created":"2025-09-23","cited_by_count":6,"area":null},{"id":"2403.15250","title":"Comprehensive Reassessment of Large-Scale Evaluation Outcomes in LLMs: A Multifaceted Statistical Approach","created":"2024-03-22","cited_by_count":5,"area":null},{"id":"2404.00943","title":"Evalverse: Unified and Accessible Library for Large Language Model Evaluation","created":"2024-04-01","cited_by_count":5,"area":null},{"id":"2502.14911","title":"Batayan: A Filipino NLP benchmark for evaluating Large Language Models","created":"2025-02-19","cited_by_count":5,"area":null},{"id":"2504.17544","title":"Auditing the Ethical Logic of Generative AI Models","created":"2025-04-24","cited_by_count":5,"area":null},{"id":"2506.01793","title":"Research-Oriented Human-Centric Evaluation for Foundation Models","created":"2025-06-02","cited_by_count":5,"area":null},{"id":"2506.18710","title":"Benchmarking the Pedagogical Knowledge of Large Language Models","created":"2025-06-23","cited_by_count":5,"area":null},{"id":"2506.22439","title":"Psycholinguistic Word Features: a New Approach for the Evaluation of LLMs Alignment with Humans","created":"2025-05-29","cited_by_count":5,"area":null},{"id":"2402.11432","title":"Can Deception Detection Go Deeper? Dataset, Evaluation, and Benchmark for Deception Reasoning","created":"2024-02-18","cited_by_count":4,"area":null},{"id":"2406.01311","title":"FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs","created":"2024-06-03","cited_by_count":4,"area":null},{"id":"2408.09330","title":"Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation dataset","created":"2024-08-18","cited_by_count":4,"area":null},{"id":"2408.09386","title":"Game Development as Human-LLM Interaction","created":"2024-08-18","cited_by_count":4,"area":null},{"id":"2410.11507","title":"TestAgent: Automatic Benchmarking and Exploratory Interaction for Evaluating LLMs in Vertical Domains","created":"2024-10-15","cited_by_count":4,"area":null},{"id":"2412.14471","title":"Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMs","created":"2024-12-19","cited_by_count":4,"area":null},{"id":"2503.00812","title":"BOSE: A Systematic Evaluation Method Optimized for Base Models","created":"2025-03-02","cited_by_count":4,"area":null},{"id":"2508.18609","title":"Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models","created":"2025-08-26","cited_by_count":4,"area":null},{"id":"2607.17409","title":"Efficient Sequential Evaluation of Large Language Models","created":"2026-07-19","cited_by_count":4,"area":null},{"id":"2402.13222","title":"RoCode: A Dataset for Measuring Code Intelligence from Problem Definitions in Romanian","created":"2024-02-20","cited_by_count":3,"area":null},{"id":"2402.13518","title":"RITFIS: Robust input testing framework for LLMs-based intelligent software","created":"2024-02-21","cited_by_count":3,"area":null},{"id":"2404.06996","title":"XNLIeu: a dataset for cross-lingual NLI in Basque","created":"2024-04-10","cited_by_count":3,"area":null},{"id":"2409.12580","title":"LLMs Can Check Their Own Results to Mitigate Hallucinations in Traffic Understanding Tasks","created":"2024-09-19","cited_by_count":3,"area":null},{"id":"2409.13521","title":"A Survey on Moral Foundation Theory and Pre-Trained Language Models: Current Advances and Challenges","created":"2024-09-20","cited_by_count":3,"area":null},{"id":"2412.18811","title":"DCIS: Efficient Length Extrapolation of LLMs via Divide-and-Conquer Scaling Factor Search","created":"2024-12-25","cited_by_count":3,"area":null},{"id":"2506.04142","title":"Establishing Trustworthy LLM Evaluation via Shortcut Neuron Analysis","created":"2025-06-04","cited_by_count":3,"area":null},{"id":"2511.03166","title":"Measuring Aleatoric and Epistemic Uncertainty in LLMs: Empirical Evaluation on ID and OOD QA Tasks","created":"2025-11-05","cited_by_count":3,"area":null},{"id":"2512.08936","title":"A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellness","created":"2025-10-23","cited_by_count":3,"area":null},{"id":"2403.13369","title":"Clinical information extraction for Low-resource languages with Few-shot learning using Pre-trained language models and Prompting","created":"2024-03-20","cited_by_count":2,"area":null},{"id":"2406.14171","title":"Ranking LLMs by compression","created":"2024-06-20","cited_by_count":2,"area":null},{"id":"2407.09549","title":"Recursive InPainting (RIP): how much information is lost under recursive inferences?","created":"2024-06-27","cited_by_count":2,"area":null},{"id":"2408.02907","title":"Leveraging Inter-Chunk Interactions for Enhanced Retrieval in Large Language Model-Based Question Answering","created":"2024-08-06","cited_by_count":2,"area":null},{"id":"2408.08848","title":"PsychoLex: Unveiling the Psychological Mind of Large Language Models","created":"2024-08-16","cited_by_count":2,"area":null},{"id":"2410.02787","title":"Navigation with VLM framework: Towards Going to Any Language","created":"2024-09-18","cited_by_count":2,"area":null},{"id":"2410.04795","title":"Representing the Under-Represented: Cultural and Core Capability Benchmarks for Developing Thai Large Language Models","created":"2024-10-07","cited_by_count":2,"area":null}],"next_cursor":"100"}