mlsanityData to 7 Oct 2026

PatternGPT :A Pattern-Driven Framework for Large Language Model Text Generation

arXiv 2307.00470 ↗First posted 2 Jul 2023cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models(LLMS)have shown excellent text generation capabilities, capable of generating fluent human-like responses for many downstream tasks. However, applying large language models to real-world critical tasks remains challenging due to their susceptibility to hallucinations and inability to directly use external knowledge. To cope with the above challenges, this paper proposes PatternGPT, a pattern-driven text generation framework for Large Language Models. Firstly, the framework utilizes the extraction capability of Large Language Models to generate rich and diversified structured and formalized patterns, which facilitates the introduction of external knowledge to do the computation, and then draws on the idea of federated learning to use multiple agents to achieve the sharing in order to obtain more diversified patterns, and finally uses judgment criteria and optimization algorithm to search for high-quality patterns to guide the generation of models. Finally, external knowledge such as judgment criteria and optimization algorithms are used to search for high-quality patterns, and the searched patterns are used to guide model generation. This framework has the advantages of generating diversified patterns, protecting data privacy, combining external knowledge, and improving the quality of generation, which provides an effective method to optimize the text generation capability of large language models, and make it better applied to the field of intelligent dialogue and content generation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 50 references that are in the map. First posted on arXiv 2 Jul 2023.

Builds on

29 of 50 references.

References · 29

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  8. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  9. 2019Language Models as Knowledge Bases?cited by 1,922
  10. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  11. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  12. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
17 more
  1. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  2. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  3. 2021Deduplicating Training Data Makes Language Models Bettercited by 705
  4. 2022PAL: Program-aided Language Modelscited by 635
  5. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  6. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  7. 2020Detecting Hallucinated Content in Conditional Neural Sequence Generationcited by 151
  8. 2019Handling Divergent Reference Texts when Evaluating Table-to-Text Generationcited by 119
  9. 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
  10. 2023Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Modelscited by 58
  11. 2022Structured information extraction from complex scientific text with fine-tuned large language modelscited by 56
  12. 2023ChatGPT versus Traditional Question Answering for Knowledge Graphs: Current Status and Future Directions Towards Knowledge Graph Chatbotscited by 47
  13. 2020Language Models as Few-Shot Learner for Task-Oriented Dialogue Systemscited by 41
  14. 2023Think Outside the Code: Brainstorming Boosts Large Language Models in Code Generationcited by 19
  15. 2022Incorporating Context into Subword Vocabulariescited by 11
  16. 2022Do LSTMs See Gender? Probing the Ability of LSTMs to Learn Abstract Syntactic Rulescited by 6
  17. 2023Harvesting Event Schemas from Large Language Modelscited by 6

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.