{"total":154,"rows":[{"id":"2309.03882","title":"Large Language Models Are Not Robust Multiple Choice Selectors","created":"2023-09-07","cited_by_count":486,"area":null},{"id":"2308.11483","title":"Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions","created":"2023-08-22","cited_by_count":263,"area":null},{"id":"2306.05540","title":"DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Text","created":"2023-05-23","cited_by_count":210,"area":null},{"id":"2405.14782","title":"Lessons from the Trenches on Reproducible Evaluation of Language Models","created":"2024-05-23","cited_by_count":179,"area":null},{"id":"2304.10428","title":"GPT-NER: Named Entity Recognition via Large Language Models","created":"2023-04-20","cited_by_count":160,"area":null},{"id":"2406.04244","title":"Benchmark Data Contamination of Large Language Models: A Survey","created":"2024-06-06","cited_by_count":147,"area":null},{"id":"2402.01781","title":"When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards","created":"2024-02-01","cited_by_count":137,"area":null},{"id":"2305.18703","title":"Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey","created":"2023-05-30","cited_by_count":135,"area":null},{"id":"2406.08446","title":"OLMES: A Standard for Language Model Evaluations","created":"2024-06-12","cited_by_count":106,"area":null},{"id":"2408.04667","title":"Non-Determinism of \"Deterministic\" LLM Settings","created":"2024-08-06","cited_by_count":92,"area":null},{"id":"2311.12399","title":"A Survey of Graph Meets Large Language Model: Progress and Future Directions","created":"2023-11-21","cited_by_count":85,"area":null},{"id":"2404.12259","title":"Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooM","created":"2024-04-18","cited_by_count":78,"area":null},{"id":"2312.09300","title":"Self-Evaluation Improves Selective Generation in Large Language Models","created":"2023-12-14","cited_by_count":76,"area":null},{"id":"2406.07545","title":"Open-LLM-Leaderboard: From Multi-choice to Open-style Questions for LLMs Evaluation, Benchmark, and Arena","created":"2024-06-11","cited_by_count":76,"area":null},{"id":"2306.07951","title":"Questioning the Survey Responses of Large Language Models","created":"2023-06-13","cited_by_count":74,"area":null},{"id":"2306.08189","title":"Language models are not naysayers: An analysis of language models on negation benchmarks","created":"2023-06-14","cited_by_count":74,"area":null},{"id":"2402.12483","title":"Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?","created":"2024-02-19","cited_by_count":71,"area":null},{"id":"2403.17752","title":"Can multiple-choice questions really be useful in detecting the abilities of LLMs?","created":"2024-03-26","cited_by_count":69,"area":null},{"id":"2404.13081","title":"SuRe: Summarizing Retrievals using Answer Candidates for Open-domain QA of LLMs","created":"2024-04-17","cited_by_count":67,"area":null},{"id":"2307.14385","title":"Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data","created":"2023-07-26","cited_by_count":66,"area":null},{"id":"2309.15427","title":"Graph Neural Prompting with Large Language Models","created":"2023-09-27","cited_by_count":64,"area":null},{"id":"2311.16534","title":"Graph Prompt Learning: A Comprehensive Survey and Beyond","created":"2023-11-28","cited_by_count":61,"area":null},{"id":"2401.07078","title":"PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities","created":"2024-01-13","cited_by_count":59,"area":null},{"id":"2403.14622","title":"Language Repository for Long Video Understanding","created":"2024-03-21","cited_by_count":55,"area":null},{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52,"area":null},{"id":"2404.13627","title":"NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding","created":"2024-04-21","cited_by_count":51,"area":null},{"id":"2408.01337","title":"MuChoMusic: Evaluating Music Understanding in Multimodal Audio-Language Models","created":"2024-08-02","cited_by_count":44,"area":null},{"id":"2506.22316","title":"Evaluating Scoring Bias in LLM-as-a-Judge","created":"2025-06-27","cited_by_count":43,"area":null},{"id":"2304.14827","title":"ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relations","created":"2023-04-28","cited_by_count":40,"area":null},{"id":"2407.03129","title":"Social Bias Evaluation for Large Language Models Requires Prompt Variations","created":"2024-07-03","cited_by_count":40,"area":null},{"id":"2306.10073","title":"Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses","created":"2023-06-15","cited_by_count":39,"area":null},{"id":"2309.08163","title":"Self-Assessment Tests are Unreliable Measures of LLM Personality","created":"2023-09-15","cited_by_count":39,"area":null},{"id":"2403.01988","title":"FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMs","created":"2024-03-04","cited_by_count":38,"area":null},{"id":"2407.15018","title":"Answer, Assemble, Ace: Understanding How LMs Answer Multiple Choice Questions","created":"2024-07-21","cited_by_count":35,"area":null},{"id":"2402.01349","title":"LLMs May Perform MCQA by Selecting the Least Incorrect Option","created":"2024-02-02","cited_by_count":33,"area":null},{"id":"2303.08033","title":"Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Code","created":"2023-03-09","cited_by_count":32,"area":null},{"id":"2304.05510","title":"chatClimate: Grounding Conversational AI in Climate Science","created":"2023-04-11","cited_by_count":32,"area":null},{"id":"2305.14693","title":"Have Large Language Models Developed a Personality?: Applicability of Self-Assessment Tests in Measuring Personality in LLMs","created":"2023-05-24","cited_by_count":32,"area":null},{"id":"2306.13906","title":"Can GPT-4 Support Analysis of Textual Data in Tasks Requiring Highly Specialized Domain Expertise?","created":"2023-06-24","cited_by_count":31,"area":null},{"id":"2405.11966","title":"Multiple-Choice Questions are Efficient and Robust LLM Evaluators","created":"2024-05-20","cited_by_count":28,"area":null},{"id":"2503.14996","title":"Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering","created":"2025-03-19","cited_by_count":28,"area":null},{"id":"2407.14614","title":"Evaluating language models as risk scores","created":"2024-07-19","cited_by_count":27,"area":null},{"id":"2312.00678","title":"The Efficiency Spectrum of Large Language Models: An Algorithmic Survey","created":"2023-12-01","cited_by_count":26,"area":null},{"id":"2406.06316","title":"Tx-LLM: A Large Language Model for Therapeutics","created":"2024-06-10","cited_by_count":25,"area":null},{"id":"2408.08656","title":"LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMs","created":"2024-08-16","cited_by_count":25,"area":null},{"id":"2305.08391","title":"Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Study","created":"2023-05-15","cited_by_count":24,"area":null},{"id":"2406.06027","title":"HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs","created":"2024-06-10","cited_by_count":24,"area":null},{"id":"2401.07955","title":"A Study on Large Language Models' Limitations in Multiple-Choice Question Answering","created":"2024-01-15","cited_by_count":22,"area":null},{"id":"2405.14383","title":"Perception of Knowledge Boundary for Large Language Models through Semi-open-ended Question Answering","created":"2024-05-23","cited_by_count":20,"area":null},{"id":"2406.03009","title":"Unveiling Selection Biases: Exploring Order and Token Sensitivity in Large Language Models","created":"2024-06-05","cited_by_count":20,"area":null},{"id":"2410.08851","title":"Measuring the Inconsistency of Large Language Models in Preferential Ranking","created":"2024-10-11","cited_by_count":19,"area":null},{"id":"2312.11518","title":"User Modeling in the Era of Large Language Models: Current Research and Future Directions","created":"2023-12-11","cited_by_count":18,"area":null},{"id":"2504.01801","title":"Investigating and Scaling up Code-Switching for Multilingual Language Model Pre-Training","created":"2025-04-02","cited_by_count":16,"area":null},{"id":"2403.01924","title":"To Generate or to Retrieve? On the Effectiveness of Artificial Contexts for Medical Open-Domain Question Answering","created":"2024-03-04","cited_by_count":15,"area":null},{"id":"2406.01026","title":"Strengthened Symbol Binding Makes Large Language Models Reliable Multiple-Choice Selectors","created":"2024-06-03","cited_by_count":15,"area":null},{"id":"2509.22820","title":"MMPB: It's Time for Multi-Modal Personalization","created":"2025-09-26","cited_by_count":14,"area":null},{"id":"2402.18113","title":"Small But Funny: A Feedback-Driven Approach to Humor Distillation","created":"2024-02-28","cited_by_count":12,"area":null},{"id":"2407.01992","title":"Is Your Large Language Model Knowledgeable or a Choices-Only Cheater?","created":"2024-07-02","cited_by_count":12,"area":null},{"id":"2409.18857","title":"Mitigating Selection Bias with Node Pruning and Auxiliary Options","created":"2024-09-27","cited_by_count":12,"area":null},{"id":"2311.04694","title":"Evaluating Generative Ad Hoc Information Retrieval","created":"2023-11-08","cited_by_count":11,"area":null},{"id":"2404.04113","title":"BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language Models","created":"2024-04-05","cited_by_count":11,"area":null},{"id":"2406.03993","title":"Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing","created":"2024-06-06","cited_by_count":11,"area":null},{"id":"2502.18316","title":"WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging","created":"2025-02-25","cited_by_count":11,"area":null},{"id":"2306.01549","title":"Evaluating Machine Translation Quality with Conformal Predictive Distributions","created":"2023-06-02","cited_by_count":9,"area":null},{"id":"2510.04398","title":"SECA: Semantically Equivalent and Coherent Attacks for Eliciting LLM Hallucinations","created":"2025-10-05","cited_by_count":9,"area":null},{"id":"2511.00280","title":"Calibration Across Layers: Understanding Calibration Evolution in LLMs","created":"2025-10-31","cited_by_count":9,"area":null},{"id":"2511.20315","title":"Geometry of Decision Making in Language Models","created":"2025-11-25","cited_by_count":9,"area":null},{"id":"2609.25845","title":"Visual Jev: Accurate and Efficient Decisions from Shared Visual Context","created":"2026-09-22","cited_by_count":9,"area":null},{"id":"2305.14725","title":"AMELI: Enhancing Multimodal Entity Linking with Fine-Grained Attributes","created":"2023-05-24","cited_by_count":8,"area":null},{"id":"2404.18255","title":"PatentGPT: A Large Language Model for Intellectual Property","created":"2024-04-28","cited_by_count":8,"area":null},{"id":"2408.05102","title":"How Well Do LLMs Identify Cultural Unity in Diversity?","created":"2024-08-09","cited_by_count":8,"area":null},{"id":"2409.13317","title":"JMedBench: A Benchmark for Evaluating Japanese Biomedical Large Language Models","created":"2024-09-20","cited_by_count":8,"area":null},{"id":"2503.04013","title":"Benchmarking Large Language Models on Multiple Tasks in Bioinformatics NLP with Prompting","created":"2025-03-06","cited_by_count":8,"area":null},{"id":"2506.04851","title":"Multiple-Choice Question Generation Using Large Language Models: Methodology and Educator Insights","created":"2025-06-05","cited_by_count":8,"area":null},{"id":"2609.23959","title":"Open-Jev Judgments on CallScreenBench: Calibrated One-Pass Scam Screening with a Small Language Model","created":"2026-09-21","cited_by_count":8,"area":null},{"id":"2404.06003","title":"FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models","created":"2024-04-09","cited_by_count":7,"area":null},{"id":"2506.03278","title":"FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure Modes","created":"2025-06-03","cited_by_count":7,"area":null},{"id":"2507.03279","title":"Conformal Information Pursuit for Interactively Guiding Large Language Models","created":"2025-07-04","cited_by_count":7,"area":null},{"id":"2508.12040","title":"Mind the Generation Process: Fine-Grained Confidence Estimation During LLM Generation","created":"2025-08-16","cited_by_count":6,"area":null},{"id":"2310.08885","title":"InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems","created":"2023-10-13","cited_by_count":5,"area":null},{"id":"2310.14804","title":"Large Language Models can Share Images, Too!","created":"2023-10-23","cited_by_count":5,"area":null},{"id":"2403.00881","title":"FedRDMA: Communication-Efficient Cross-Silo Federated LLM via Chunked RDMA Transmission","created":"2024-03-01","cited_by_count":5,"area":null},{"id":"2503.10628","title":"Uncertainty in Action: Confidence Elicitation in Embodied Agents","created":"2025-03-13","cited_by_count":5,"area":null},{"id":"2505.21003","title":"Uncertainty Unveiled: Can Exposure to More In-context Examples Mitigate Uncertainty for Large Language Models?","created":"2025-05-27","cited_by_count":5,"area":null},{"id":"2506.00288","title":"Emergent Abilities of Large Language Models under Continued Pretraining for Language Adaptation","created":"2025-05-30","cited_by_count":5,"area":null},{"id":"2506.20274","title":"Enterprise Large Language Model Evaluation Benchmark","created":"2025-06-25","cited_by_count":5,"area":null},{"id":"2512.07404","title":"On LLMs' Internal Representation of Code Correctness","created":"2025-12-08","cited_by_count":5,"area":null},{"id":"2602.06221","title":"BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks","created":"2026-02-05","cited_by_count":5,"area":null},{"id":"2310.09725","title":"KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models","created":"2023-10-15","cited_by_count":4,"area":null},{"id":"2412.09807","title":"LLM Distillation for Efficient Few-Shot Multiple Choice Question Answering","created":"2024-12-13","cited_by_count":4,"area":null},{"id":"2503.09032","title":"Teaching LLMs How to Learn with Contextual Fine-Tuning","created":"2025-03-12","cited_by_count":4,"area":null},{"id":"2310.12059","title":"Evaluating the Symbol Binding Ability of Large Language Models for Multiple-Choice Questions in Vietnamese General Education","created":"2023-10-18","cited_by_count":3,"area":null},{"id":"2310.13469","title":"Ask Language Model to Clean Your Noisy Translation Data","created":"2023-10-20","cited_by_count":3,"area":null},{"id":"2405.05741","title":"Can large language models understand uncommon meanings of common words?","created":"2024-05-09","cited_by_count":3,"area":null},{"id":"2406.11634","title":"The Base-Rate Effect on LLM Benchmark Performance: Disambiguating Test-Taking Strategies from Benchmark Performance","created":"2024-06-17","cited_by_count":3,"area":null},{"id":"2411.17204","title":"Strategic Prompting for Conversational Tasks: A Comparative Analysis of Large Language Models Across Diverse Conversational Tasks","created":"2024-11-26","cited_by_count":3,"area":null},{"id":"2412.01186","title":"SailCompass: Towards Reproducible and Robust Evaluation for Southeast Asian Languages","created":"2024-12-02","cited_by_count":3,"area":null},{"id":"2503.16167","title":"CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models","created":"2025-03-20","cited_by_count":3,"area":null},{"id":"2602.17445","title":"ABCD: All Biases Come Disguised","created":"2026-02-19","cited_by_count":3,"area":null},{"id":"2609.32160","title":"Typed Decision Models: An Early Evidence Audit and Evaluation Checklist","created":"2026-09-26","cited_by_count":3,"area":null}],"next_cursor":"100"}