mlsanityData to 7 Oct 2026

ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPT

arXiv 2302.10205 ↗First posted 20 Feb 2023cs.CLcited by 250

Not on the map. Why?

Abstract (arXiv)

Zero-shot information extraction (IE) aims to build IE systems from the unannotated text. It is challenging due to involving little human intervention. Challenging but worthwhile, zero-shot IE reduces the time and effort that data labeling takes. Recent efforts on large language models (LLMs, e.g., GPT-3, ChatGPT) show promising performance on zero-shot settings, thus inspiring us to explore prompt-based methods. In this work, we ask whether strong IE models can be constructed by directly prompting LLMs. Specifically, we transform the zero-shot IE task into a multi-turn question-answering problem with a two-stage framework (ChatIE). With the power of ChatGPT, we extensively evaluate our framework on three IE tasks: entity-relation triple extract, named entity recognition, and event extraction. Empirical results on six datasets across two languages show that ChatIE achieves impressive performance and even surpasses some full-shot models on several datasets (e.g., NYT11-HRL). We believe that our work could shed light on building IE models with limited resources.

Key facts. Cited by 250 papers in the map (data through 7 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 20 Feb 2023.

Builds on

24 of 43 references.

References · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  4. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  5. 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
  6. 2022Unified Structure Generation for Universal Information Extractioncited by 220
  7. 2019Dice Loss for Data-imbalanced NLP Taskscited by 180
  8. 2020Event Extraction by Answering (Almost) Natural Questionscited by 177
  9. 2021Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extractioncited by 129
  10. 2022ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reportscited by 100
  11. 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
  12. 2021Unified Named Entity Recognition as Word-Word Relation Classificationcited by 89
12 more
  1. 2022ChatGPT: The End of Online Exam Integrity?cited by 88
  2. 2022How would Stance Detection Techniques Evolve after the Launch of ChatGPT?cited by 76
  3. 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
  4. 2020TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linkingcited by 72
  5. 2019CrossWeigh: Training Named Entity Tagger from Imperfect Annotationscited by 60
  6. 2018A Hierarchical Framework for Relation Extraction with Reinforcement Learningcited by 49
  7. 2021PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple Extractioncited by 40
  8. 2021Learning from Noisy Labels for Entity-Centric Information Extractioncited by 34
  9. 2022Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learningcited by 25
  10. 2021Revisiting the Negative Data of Distantly Supervised Relation Extractioncited by 15
  11. 2015Improved Relation Extraction with Feature-Rich Compositional Embedding Modelscited by 12
  12. 2022ZS4IE: A toolkit for Zero-Shot Information Extraction with simple Verbalizationscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 84; 2024: 104; 2025: 39; 2026: 23.

250 papers.

Sort:

By area:

  1. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  2. 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 420
  3. 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 339
  4. 2023Can Large Language Models Transform Computational Social Science?cited by 245
  5. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 224
  6. 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
  7. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  8. 2023AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotatorscited by 171
  9. 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 152
  10. 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarkscited by 139
  11. 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
  12. 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 128
38 more
  1. 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
  2. 2023A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capabilitycited by 118
  3. 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
  4. 2024Large Language Models Meet NLP: A Surveycited by 102
  5. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
  6. 2023LLMaAA: Making Large Language Models as Active Annotatorscited by 78
  7. 2023GPTEval: A Survey on Assessments of ChatGPT and GPT-4cited by 73
  8. 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
  9. 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
  10. 2024Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Constructioncited by 70
  11. 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluationcited by 69
  12. 2023Empirical Study of Zero-Shot NER with ChatGPTcited by 60
  13. 2023On the (In)Effectiveness of Large Language Models for Chinese Text Correctioncited by 53
  14. 2023Zero-shot Temporal Relation Extraction with ChatGPTcited by 52
  15. 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
  16. 2023Data-Juicer: A One-Stop Data Processing System for Large Language Modelscited by 52
  17. 2023Fine-tuning ChatGPT for Automatic Scoringcited by 50
  18. 2024GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social Abusecited by 50
  19. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
  20. 2023An Empirical Study on Information Extraction using Large Language Modelscited by 46
  21. 2023Towards LLM-guided Causal Explainability for Black-box Text Classifierscited by 44
  22. 2023FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Modelscited by 44
  23. 2024Reinforcement Learning from Human Feedback with Active Queriescited by 39
  24. 2023Large Language Models Are Zero-Shot Text Classifierscited by 35
  25. 2024LLMArena: Assessing Capabilities of Large Language Models in Dynamic Multi-Agent Environmentscited by 35
  26. 2023Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistancecited by 33
  27. 2025Who is Introducing the Failure? Automatically Attributing Failures of Multi-Agent Systems via Spectrum Analysiscited by 33
  28. 2023A Preliminary Evaluation of ChatGPT for Zero-shot Dialogue Understandingcited by 31
  29. 2023Revisiting Large Language Models as Zero-shot Relation Extractorscited by 29
  30. 2023Primacy Effect of ChatGPTcited by 27
  31. 2023Differentiate ChatGPT-generated and Human-written Medical Textscited by 26
  32. 2024PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluationcited by 26
  33. 2023Iterative Zero-Shot LLM Prompting for Knowledge Graph Constructioncited by 25
  34. 2024Can Small Language Models be Good Reasoners for Sequential Recommendation?cited by 25
  35. 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
  36. 2023Guideline Learning for In-context Information Extractioncited by 24
  37. 2024ADELIE: Aligning Large Language Models on Information Extractioncited by 24
  38. 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMscited by 24

50 most cited of 250 All 250 (JSON)