GPT-3 Powered Information Extraction for Building Robust Knowledge Bases
Not on the map. Why?
Abstract (arXiv)
This work uses the state-of-the-art language model GPT-3 to offer a novel method of information extraction for knowledge base development. The suggested method attempts to solve the difficulties associated with obtaining relevant entities and relationships from unstructured text in order to extract structured information. We conduct experiments on a huge corpus of text from diverse fields to assess the performance of our suggested technique. The evaluation measures, which are frequently employed in information extraction tasks, include precision, recall, and F1-score. The findings demonstrate that GPT-3 can be used to efficiently and accurately extract pertinent and correct information from text, hence increasing the precision and productivity of knowledge base creation. We also assess how well our suggested approach performs in comparison to the most advanced information extraction techniques already in use. The findings show that by utilizing only a small number of instances in in-context learning, our suggested strategy yields competitive outcomes with notable savings in terms of data annotation and engineering expense. Additionally, we use our proposed method to retrieve Biomedical information, demonstrating its practicality in a real-world setting. All things considered, our suggested method offers a viable way to overcome the difficulties involved in obtaining structured data from unstructured text in order to create knowledge bases. It can greatly increase the precision and effectiveness of information extraction, which is necessary for many applications including chatbots, recommendation engines, and question-answering systems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 31 Jul 2024.
Builds on
22 of 34 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
- 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 557
- 2021True Few-Shot Learning with Language Modelscited by 343
10 more
- 2021Constrained Language Models Yield Few-Shot Semantic Parserscited by 162
- 2021Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Modelscited by 139
- 2021SciFive: a text-to-text transformer model for biomedical literaturecited by 99
- 2022Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Againcited by 83
- 2021Coherence boosting: When your pretrained language model is not paying enough attentioncited by 38
- 2021True Few-Shot Learning with Prompts -- A Real-World Perspectivecited by 38
- 2021GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domaincited by 36
- 2022In-BoXBART: Get Instructions into Biomedical Multi-Task Learningcited by 16
- 2021Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognitioncited by 10
- 2021Exploring a Unified Sequence-To-Sequence Transformer for Medical Product Safety Monitoring in Social Mediacited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.