mlsanityData to 7 Oct 2026

State of What Art? A Call for Multi-Prompt LLM Evaluation

arXiv 2401.00595 ↗First posted 31 Dec 2023cs.CLcited by 299

Not on the map. Why?

Cited by 23 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advances in large language models (LLMs) have led to the development of various evaluation benchmarks. These benchmarks typically rely on a single instruction template for evaluating all LLMs on a specific task. In this paper, we comprehensively analyze the brittleness of results obtained via single-prompt evaluations across 6.5M instances, involving 20 different LLMs and 39 tasks from 3 benchmarks. To improve robustness of the analysis, we propose to evaluate LLMs with a set of diverse prompts instead. We discuss tailored evaluation metrics for specific use cases (e.g., LLM developers vs. developers interested in a specific downstream task), ensuring a more reliable and meaningful assessment of LLM capabilities. We then implement these criteria and conduct evaluations of multiple models, providing insights into the true strengths and limitations of current LLMs.

Key facts. Cited by 299 papers in the map (data through 7 Oct 2026). Builds on 27 of its 55 references that are in the map. First posted on arXiv 31 Dec 2023.

Builds on

27 of 55 references.

References · 27

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  9. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  10. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  11. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  12. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
15 more
  1. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  2. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
  3. 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 778
  4. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
  5. 2022Unnatural Instructions: Tuning Language Models with (Almost) No Human Laborcited by 395
  6. 2021Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Modelscited by 227
  7. 2022Demystifying Prompts in Language Models via Perplexity Estimationcited by 215
  8. 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
  9. 2022Instruction Induction: From Few Examples to Natural Language Task Descriptionscited by 152
  10. 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
  11. 2023Efficient Benchmarking of Language Modelscited by 71
  12. 2023Evaluating the Zero-shot Robustness of Instruction-tuned Language Modelscited by 63
  13. 2022Robustness of Learning from Task Instructionscited by 34
  14. 2023Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learningcited by 31
  15. 2022LMentry: A Language Model Benchmark of Elementary Language Taskscited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 73; 2025: 94; 2026: 132.

299 papers.

Sort:

By area:

  1. 2024tinyBenchmarks: evaluating LLMs with fewer examplescited by 295
  2. 2024CRUXEval: A Benchmark for Code Reasoning, Understanding and Executioncited by 294
  3. 2024Lessons from the Trenches on Reproducible Evaluation of Language Modelscited by 172
  4. 2024WARM: On the Benefits of Weight Averaged Reward Modelscited by 145
  5. 2024ProSA: Assessing and Understanding the Prompt Sensitivity of LLMscited by 145
  6. 2024When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboardscited by 134
  7. 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
  8. 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
  9. 2024The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinismcited by 113
  10. 2025Measuring what Matters: Construct Validity in Large Language Model Benchmarkscited by 102
  11. 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 90
  12. 2024Mind Your Format: Towards Consistent Evaluation of In-Context Learning Improvementscited by 82
38 more
  1. 2024Efficient multi-prompt evaluation of LLMscited by 72
  2. 2025Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluationcited by 57
  3. 2024POSIX: A Prompt Sensitivity Index For Large Language Modelscited by 56
  4. 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
  5. 2024LoRA Soups: Merging LoRAs for Practical Skill Composition Taskscited by 49
  6. 2024BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Datacited by 49
  7. 2024Social Bias Evaluation for Large Language Models Requires Prompt Variationscited by 39
  8. 2025Rating Roulette: Self-Inconsistency in LLM-As-A-Judge Frameworkscited by 37
  9. 2024On the Worst Prompt Performance of Large Language Modelscited by 36
  10. 2024LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraintscited by 34
  11. 2024Examining the robustness of LLM evaluation to the distributional assumptions of benchmarkscited by 31
  12. 2024K-QA: A Real-World Medical Q&A Benchmarkcited by 30
  13. 2025Fluid Language Model Benchmarkingcited by 30
  14. 2024Knowledge Graphs, Large Language Models, and Hallucinations: An NLP Perspectivecited by 29
  15. 2024LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languagescited by 28
  16. 2024Teach Better or Show Smarter? On Instructions and Exemplars in Automatic Prompt Optimizationcited by 28
  17. 2025The Shrinking Landscape of Linguistic Diversity in the Age of Large Language Modelscited by 28
  18. 2025ECLeKTic: a Novel Challenge Set for Evaluation of Cross-Lingual Knowledge Transfercited by 28
  19. 2024JuStRank: Benchmarking LLM Judges for System Rankingcited by 27
  20. 2024Holmes: A Benchmark to Assess the Linguistic Competence of Language Modelscited by 26
  21. 2025Trust Me, I'm Wrong: LLMs Hallucinate with Certainty Despite Knowing the Answercited by 26
  22. 2024Do These LLM Benchmarks Agree? Fixing Benchmark Evaluation with BenchBenchcited by 25
  23. 2024How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMscited by 23
  24. 2025Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMscited by 23
  25. 2025MultiLoKo: a multilingual local knowledge benchmark for LLMs spanning 31 languagescited by 22
  26. 2024A Survey on the Honesty of Large Language Modelscited by 21
  27. 2025DOVE: A Large-Scale Multi-Dimensional Predictions Dataset Towards Meaningful LLM Evaluationcited by 21
  28. 2025Towards LLMs Robustness to Changes in Prompt Format Stylescited by 21
  29. 2024The Counterfeit Conundrum: Can Code Language Models Grasp the Nuances of Their Incorrect Generations?cited by 20
  30. 2024Beneath the Surface of Consistency: Exploring Cross-lingual Knowledge Representation Sharing in LLMscited by 20
  31. 2025SCORE: Systematic COnsistency and Robustness Evaluation for Large Language Modelscited by 19
  32. 2026Brittlebench: Quantifying LLM robustness via prompt sensitivitycited by 19
  33. 2024The Open Source Advantage in Large Language Models (LLMs)cited by 18
  34. 2025From Selection to Generation: A Survey of LLM-based Active Learningcited by 18
  35. 2025Mitigating Content Effects on Reasoning in Language Models through Fine-Grained Activation Steeringcited by 18
  36. 2025Learning When to Plan: Efficiently Allocating Test-Time Compute for LLM Agentscited by 18
  37. 2024Label-Efficient Model Selection for Text Generationcited by 17
  38. 2024The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Modelscited by 17

50 most cited of 299 All 299 (JSON)