An Empirical Categorization of Prompting Techniques for Large Language Models: A Practitioner's Guide
Not on the map. Why?
Abstract (arXiv)
Due to rapid advancements in the development of Large Language Models (LLMs), programming these models with prompts has recently gained significant attention. However, the sheer number of available prompt engineering techniques creates an overwhelming landscape for practitioners looking to utilize these tools. For the most efficient and effective use of LLMs, it is important to compile a comprehensive list of prompting techniques and establish a standardized, interdisciplinary categorization framework. In this survey, we examine some of the most well-known prompting techniques from both academic and practical viewpoints and classify them into seven distinct categories. We present an overview of each category, aiming to clarify their unique contributions and showcase their practical applications in real-world examples in order to equip fellow practitioners with a structured framework for understanding and categorizing prompting techniques tailored to their specific domains. We believe that this approach will help simplify the complex landscape of prompt engineering and enable more effective utilization of LLMs in various applications. By providing practitioners with a systematic approach to prompt categorization, we aim to assist in navigating the intricacies of effective prompt design for conversational pre-trained LLMs and inspire new possibilities in their respective fields.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 66 of its 88 references that are in the map. First posted on arXiv 18 Feb 2024.
Builds on
66 of 88 references.
References · 66
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
38 more
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Mistral 7Bcited by 3,065
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 778
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
- 2022A Systematic Evaluation of Large Language Models of Codecited by 360
- 2021True Few-Shot Learning with Language Modelscited by 343
- 2023Faithful Chain-of-Thought Reasoningcited by 285
- 2023Multilingual Jailbreak Challenges in Large Language Modelscited by 222
- 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 203
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 191
- 2022Ask Me Anything: A simple strategy for prompting language modelscited by 155
- 2023Fundamental Limitations of Alignment in Large Language Modelscited by 152
- 2023Progressive-Hint Prompting Improves Reasoning in Large Language Modelscited by 147
- 2023Auditing large language models: a three-layered approachcited by 135
- 2023Multimodal Prompting with Missing Modalities for Visual Recognitioncited by 121
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Datacited by 119
- 2023An LLM can Fool Itself: A Prompt-Based Adversarial Attackcited by 111
- 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
- 2023Conversational Health Agents: A Personalized LLM-Powered Agent Frameworkcited by 91
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 3.
7 papers.
- 2025DynTaskMAS: A Dynamic Task Graph-driven Framework for Asynchronous and Parallel LLM-based Multi-Agent Systemscited by 20
- 2025Thinking beyond the anthropomorphic paradigm benefits LLM researchcited by 13
- 2024The Prompt Canvas: A Literature-Based Practitioner Guide for Creating Effective Prompts in Large Language Modelscited by 4
- 2025Large language models replicate and predict human cooperation across experiments in game theorycited by 2
- 2026An Agentic Workflow for Detecting Personally Identifiable Information in Crash Narrativescited by 2
- 2026How to Ask the AI: A User Perspective Survey for Large Language Model Promptingcited by 1
- 2026Modularizing Educational LLM-Agency for Fostering Responsible Learning Assistancecited by 0
- 2026How to Ask the AI: A User Perspective Survey for Large Language Model Prompting17 Jun 2026
- 2026Modularizing Educational LLM-Agency for Fostering Responsible Learning Assistance28 May 2026
- 2026An Agentic Workflow for Detecting Personally Identifiable Information in Crash Narratives15 Apr 2026
- 2025Large language models replicate and predict human cooperation across experiments in game theory6 Nov 2025
- 2025DynTaskMAS: A Dynamic Task Graph-driven Framework for Asynchronous and Parallel LLM-based Multi-Agent Systems10 Mar 2025
- 2025Thinking beyond the anthropomorphic paradigm benefits LLM research13 Feb 2025
- 2024The Prompt Canvas: A Literature-Based Practitioner Guide for Creating Effective Prompts in Large Language Models6 Dec 2024