mlsanityData to 7 Oct 2026

A Survey of LLM Prompt Datasets: Taxonomy, Linguistic Patterns, and Practical Uses

arXiv 2510.09316 ↗First posted 10 Oct 2025cs.LG cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

We compile 129 public LLM prompt datasets with more than 1.22TB and more than 673M instances and organize them into a unified taxonomy. We use seven datasets for detailed analysis and identify lexical, syntactic, and semantic patterns that distinguish prompts from general text. We evaluate these features in prompt filtering, source domain routing, and elicited response quality analysis. A 63 dimensional linguistic feature set that can be extracted on a CPU achieves over 91% of the F1 of GPU sentence embeddings and reduces latency per request by nearly half. In cross dataset routing, sentence embeddings reach 0.74 Macro-F1 and a structural feature subset reaches 0.61, compared with the chance level of 0.20. Structural routing features remain negatively associated with elicited response quality after prompt length is controlled on UltraFeedback. The apparent positive association of type to token ratio becomes much smaller under the same control. These findings support prompt processing pipelines that combine efficient structural features with robust semantic routing. Our catalogue, annotations, and code are given at https://github.com/ymzhang-cs/prompt-dataset-analysis.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 60 references that are in the map. First posted on arXiv 10 Oct 2025.

Builds on

23 of 60 references.

References · 23

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  3. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  4. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  5. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  6. 2018Hierarchical Neural Story Generationcited by 1,182
  7. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  8. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  9. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
  10. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
  11. 2021Datasets: A Community Library for Natural Language Processingcited by 526
  12. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
11 more
  1. 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 394
  2. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 257
  3. 2024HelpSteer2: Open-source dataset for training top-performing reward modelscited by 232
  4. 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 226
  5. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
  6. 2024CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmarkcited by 118
  7. 2024The Prompt Report: A Systematic Survey of Prompt Engineering Techniquescited by 115
  8. 2025OpenCodeReasoning: Advancing Data Distillation for Competitive Codingcited by 106
  9. 2024UltraMedical: Building Specialized Generalists in Biomedicinecited by 67
  10. 2025Beyond Prompt Content: Enhancing LLM Performance via Content-Format Integrated Prompt Optimizationcited by 15
  11. 2025Promptware Engineering: Software Engineering for Prompt-Enabled Systemscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.