mlsanityData to 7 Oct 2026

Exploring Prompt Engineering: A Systematic Review with SWOT Analysis

arXiv 2410.12843 ↗First posted 9 Oct 2024cs.CL cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

In this paper, we conduct a comprehensive SWOT analysis of prompt engineering techniques within the realm of Large Language Models (LLMs). Emphasizing linguistic principles, we examine various techniques to identify their strengths, weaknesses, opportunities, and threats. Our findings provide insights into enhancing AI interactions and improving language model comprehension of human prompts. The analysis covers techniques including template-based approaches and fine-tuning, addressing the problems and challenges associated with each. The conclusion offers future research directions aimed at advancing the effectiveness of prompt engineering in optimizing human-machine communication.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 73 of its 104 references that are in the map. First posted on arXiv 9 Oct 2024.

Builds on

73 of 104 references.

References · 73

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  8. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  9. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  10. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  11. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
  12. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
38 more
  1. 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
  2. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  3. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
  4. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
  5. 2022Selective Annotation Makes Language Models Better Few-Shot Learnerscited by 242
  6. 2023Large Language Model Guided Tree-of-Thoughtcited by 218
  7. 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 213
  8. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
  9. 2024PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMscited by 187
  10. 2020How Context Affects Language Models' Factual Predictionscited by 181
  11. 2022The Unreliability of Explanations in Few-shot Prompting for Textual Reasoningcited by 169
  12. 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Promptingcited by 163
  13. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 160
  14. 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 147
  15. 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 124
  16. 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thoughtcited by 120
  17. 2023Iterative Prompt Learning for Unsupervised Backlit Image Enhancementcited by 107
  18. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
  19. 2023Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languagescited by 96
  20. 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 94
  21. 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
  22. 2022Iteratively Prompt Pre-trained Language Models for Chain of Thoughtcited by 75
  23. 2023Can ChatGPT Replace Traditional KBQA Models? An In-depth Analysis of the Question Answering Performance of the GPT LLM Familycited by 71
  24. 2022Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Modelscited by 70
  25. 2023Graph Neural Prompting with Large Language Modelscited by 64
  26. 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
  27. 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoningcited by 60
  28. 2022A Taxonomy of Prompt Modifiers for Text-To-Image Generationcited by 54
  29. 2023Prompt Engineering a Prompt Engineercited by 53
  30. 2024xCoT: Cross-lingual Instruction Tuning for Cross-lingual Chain-of-Thought Reasoningcited by 46
  31. 2023Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineeringcited by 40
  32. 2023LeanContext: Cost-Efficient Domain-Specific Question Answering Using LLMscited by 40
  33. 2022Self-Prompting Large Language Models for Zero-Shot Open-Domain QAcited by 39
  34. 2021True Few-Shot Learning with Prompts -- A Real-World Perspectivecited by 38
  35. 2023Query-Dependent Prompt Evaluation and Optimization with Offline Inverse RLcited by 37
  36. 2023CoTDet: Affordance Knowledge Prompting for Task Driven Object Detectioncited by 36
  37. 2024Cantor: Inspiring Multimodal Chain-of-Thought of MLLMcited by 34
  38. 2024ChatCite: LLM Agent with Human Workflow Guidance for Comparative Literature Summarycited by 30

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 5.

5 papers.

  1. 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 242
  2. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  3. 2025LLMs in Disease Diagnosis: A Comparative Study of DeepSeek-R1 and O3 Mini Across Chronic Health Conditionscited by 3
  4. 2025AI-Facilitated Analysis of Abstracts and Conclusions: Flagging Unsubstantiated Claims and Ambiguous Pronounscited by 0
  5. 2025Bayesian Network Fusion of Large Language Models for Sentiment Analysiscited by 0