mlsanityData to 7 Oct 2026

Prompt Design and Engineering: Introduction and Advanced Methods

arXiv 2401.14423 ↗First posted 24 Jan 2024cs.SE cs.LGcited by 45

Not on the map. Why?

Abstract (arXiv)

Prompt design and engineering has rapidly become essential for maximizing the potential of large language models. In this paper, we introduce core concepts, advanced techniques like Chain-of-Thought and Reflection, and the principles behind building LLM-based agents. Finally, we provide a survey of tools for prompt engineers.

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 24 Jan 2024.

Builds on

13 of 20 references.

References · 13

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  5. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  6. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  7. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  8. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  9. 2023Large Language Modelscited by 774
  10. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
  11. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  12. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
1 more
  1. 2023DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agentscited by 52

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 10; 2025: 31; 2026: 4.

45 papers.

Sort:

By area:

  1. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  2. 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 94
  3. 2024Unleashing the Potential of Large Language Models as Prompt Optimizers: Analogical Analysis with Gradient-based Model Optimizerscited by 33
  4. 2024Probing the limitations of multimodal language models for chemistry and materials researchcited by 31
  5. 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking Systemcited by 18
  6. 2024PersoBench: Benchmarking Personalized Response Generation in Large Language Modelscited by 12
  7. 2024Large Language Models are Contrastive Reasonerscited by 11
  8. 2025Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approachcited by 8
  9. 2025Doubling Your Data in Minutes: Ultra-fast Tabular Data Generation via LLM-Induced Dependency Graphscited by 8
  10. 2025GPT-4.1 Sets the Standard in Automated Experiment Design Using Novel Python Librariescited by 8
  11. 2025LAURA: Enhancing Code Review Generation with Context-Enriched Retrieval-Augmented LLMcited by 8
  12. 2025An Evaluation of Large Language Models on Text Summarization Tasks Using Prompt Engineering Techniquescited by 6
33 more
  1. 2025AutoSurvey2: Empowering Researchers with Next Level Automated Literature Surveyscited by 6
  2. 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactionscited by 5
  3. 2025Local Prompt Optimizationcited by 4
  4. 2024Towards Goal-oriented Prompt Engineering for Large Language Models: A Surveycited by 3
  5. 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcarecited by 2
  6. 2025Reflexive Prompt Engineering: A Framework for Responsible Prompt Engineering and Interaction Designcited by 2
  7. 2025RiOT: Efficient Prompt Refinement with Residual Optimization Treecited by 2
  8. 2025LLM Based Bayesian Optimization for Prompt Searchcited by 2
  9. 2025SoraNav: Adaptive UAV Task-Centric Navigation via Zeroshot VLM Reasoningcited by 2
  10. 2025Large language models replicate and predict human cooperation across experiments in game theorycited by 2
  11. 2024PCToolkit: A Unified Plug-and-Play Prompt Compression Toolkit of Large Language Modelscited by 1
  12. 2024Open Artificial Knowledgecited by 1
  13. 2025An Empirically-grounded tool for Automatic Prompt Linting and Repair: A Case Study on Bias, Vulnerability, and Optimization in Developer Promptscited by 1
  14. 2025Can Large Language Models Unveil the Mysteries? An Exploration of Their Ability to Unlock Information in Complex Scenarioscited by 1
  15. 2025Representing data in words: A context engineering approachcited by 1
  16. 2025Reliable Decision Support with LLMs: A Framework for Evaluating Consistency in Binary Text Classification Applicationscited by 1
  17. 2025Ratas framework: A comprehensive genai-based approach to rubric-based marking of real-world textual examscited by 1
  18. 2025Re-Evaluating Code LLM Benchmarks Under Semantic Mutationcited by 1
  19. 2025Drones that Think on their Feet: Sudden Landing Decisions with Embodied AIcited by 1
  20. 2025Humanoid Artificial Consciousness Designed with Large Language Model Based on Psychoanalysis and Personality Theorycited by 1
  21. 2025Reasoning Relay: Evaluating Stability and Interchangeability of Large Language Models in Mathematical Reasoningcited by 1
  22. 2026Decoding ML Decision: An Agentic Reasoning Framework for Large-Scale Ranking Systemcited by 1
  23. 2026How to Ask the AI: A User Perspective Survey for Large Language Model Promptingcited by 1
  24. 2024MaTableGPT: GPT-based Table Data Extractor from Materials Science Literaturecited by 0
  25. 2025Working Document -- Formalising Software Requirements with Large Language Modelscited by 0
  26. 2025MCP2OSC: Parametric Control by Natural Languagecited by 0
  27. 2025LLMs for LLMs: A Structured Prompting Methodology for Long Legal Documentscited by 0
  28. 2025Limited Reference, Reliable Generation: A Two-Component Framework for Tabular Data Generation in Low-Data Regimescited by 0
  29. 2025PromptPilot: Improving Human-AI Collaboration Through LLM-Enhanced Prompt Engineeringcited by 0
  30. 2025SeeingSounds: Learning Audio-to-Visual Alignment via Textcited by 0
  31. 2025Modeling Layered Consciousness with Multi-Agent Large Language Modelscited by 0
  32. 2026AI Agent for Reverse-Engineering Legacy Finite-Difference Code and Translating to Devitocited by 0
  33. 2026Opti-Q: A Constraint-Based Optimization Framework for Multi-LLM Question Planningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024The Prompt Canvas: A Literature-Based Practitioner Guide for Creating Effective Prompts in Large Language Models
  2. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications
  3. 2024Minstrel: Structural Prompt Generation with Multi-Agents Coordination for Non-AI Experts
  4. 2024LangGPT: Rethinking Structured Reusable Prompt Design Framework for LLMs from the Programming Language
  5. 2023Unleashing the potential of prompt engineering for large language models
  6. 2024RePrompt: Planning by Automatic Prompt Engineering for Large Language Models Agents
  7. 2026The PICCO Framework for Large Language Model Prompting: A Taxonomy and Reference Architecture for Prompt Structure
  8. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges