mlsanityData to 7 Oct 2026

Large Language Models for Generative Information Extraction: A Survey

arXiv 2312.17617 ↗First posted 29 Dec 2023cs.CLcited by 183

Not on the map. Why?

Cited by 23 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Information extraction (IE) aims to extract structural knowledge from plain natural language texts. Recently, generative Large Language Models (LLMs) have demonstrated remarkable capabilities in text understanding and generation. As a result, numerous works have been proposed to integrate LLMs for IE tasks based on a generative paradigm. To conduct a comprehensive systematic review and exploration of LLM efforts for IE tasks, in this study, we survey the most recent advancements in this field. We first present an extensive overview by categorizing these works in terms of various IE subtasks and techniques, and then we empirically analyze the most advanced methods and discover the emerging trend of IE tasks with LLMs. Based on a thorough review conducted, we identify several insights in technique and promising research directions that deserve further exploration in future studies. We maintain a public repository and consistently update related works and resources on GitHub (hrefhttps://github.com/quqxui/Awesome-LLM4IE-PapersLLM4IE repository)

Key facts. Cited by 183 papers in the map (data through 7 Oct 2026). Builds on 138 of its 312 references that are in the map. First posted on arXiv 29 Dec 2023.

Builds on

138 of 312 references.

References · 138

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  7. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  10. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  11. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  12. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
38 more
  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  2. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  3. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  4. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  5. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  6. 2023A Survey on Multimodal Large Language Modelscited by 898
  7. 2023A Survey on Large Language Models for Recommendationcited by 378
  8. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
  9. 2019Abductive Commonsense Reasoningcited by 300
  10. 2022Reasoning with Language Model Prompting: A Surveycited by 251
  11. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  12. 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
  13. 2022Unified Structure Generation for Universal Information Extractioncited by 220
  14. 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 206
  15. 2023Efficient Guided Generation for Large Language Modelscited by 192
  16. 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 188
  17. 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
  18. 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
  19. 2023GPT-NER: Named Entity Recognition via Large Language Modelscited by 158
  20. 2021Document-Level Event Argument Extraction by Conditional Generationcited by 154
  21. 2021Template-Based Named Entity Recognition Using BARTcited by 153
  22. 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 151
  23. 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 150
  24. 2021A Unified Generative Framework for Various NER Subtaskscited by 141
  25. 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
  26. 2021Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extractioncited by 129
  27. 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
  28. 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 116
  29. 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applicationscited by 110
  30. 2020CrossNER: Evaluating Cross-Domain Named Entity Recognitioncited by 102
  31. 2023Revisiting Relation Extraction in the era of Large Language Modelscited by 100
  32. 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
  33. 2023Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extractioncited by 89
  34. 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 84
  35. 2022Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Againcited by 83
  36. 2021DEGREE: A Data-Efficient Generation-Based Event Extraction Modelcited by 82
  37. 2019Multi-Sentence Argument Linkingcited by 80
  38. 2023LLMaAA: Making Large Language Models as Active Annotatorscited by 78

50 most cited of 138 All 138 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 69; 2025: 69; 2026: 45.

183 papers.

Sort:

By area:

  1. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  2. 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
  3. 2024Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQLcited by 118
  4. 2024Large Language Models Meet NLP: A Surveycited by 102
  5. 2024CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Modelscited by 50
  6. 2025Graph-R1: Towards Agentic GraphRAG Framework via End-to-end Reinforcement Learningcited by 50
  7. 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extractioncited by 33
  8. 2024Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extractioncited by 33
  9. 2024Artificial Intelligence for Literature Reviews: Opportunities and Challengescited by 30
  10. 2024CityGPT: Empowering Urban Spatial Cognition of Large Language Modelscited by 29
  11. 2024MARE: Multi-Agents Collaboration Framework for Requirements Engineeringcited by 28
  12. 2024Chain-of-Layer: Iteratively Prompting Large Language Models for Taxonomy Induction from Limited Examplescited by 24
38 more
  1. 2024ADELIE: Aligning Large Language Models on Information Extractioncited by 24
  2. 2024HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMscited by 24
  3. 2024C-ICL: Contrastive In-context Learning for Information Extractioncited by 22
  4. 2024Multi-perspective Improvement of Knowledge Graph Completion with Large Language Modelscited by 20
  5. 2024Surveying the MLLM Landscape: A Meta-Review of Current Surveyscited by 20
  6. 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
  7. 2025Instruction-Tuning LLMs for Event Extraction with Annotation Guidelinescited by 18
  8. 2024Natural Language Reinforcement Learningcited by 17
  9. 2024AutoRE: Document-Level Relation Extraction with Large Language Modelscited by 16
  10. 2024From Natural Language to SQL: Review of LLM-based Text-to-SQL Systemscited by 15
  11. 2024Logical Consistency of Large Language Models in Fact-checkingcited by 15
  12. 2024MetaIE: Distilling a Meta Model from LLM for All Kinds of Information Extraction Taskscited by 14
  13. 2024CHiSafetyBench: A Chinese Hierarchical Safety Benchmark for Large Language Modelscited by 13
  14. 2024Beyond Single-Event Extraction: Towards Efficient Document-Level Multi-Event Argument Extractioncited by 12
  15. 2024DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuningcited by 11
  16. 2025Iterative Self-Incentivization Empowers Large Language Models as Agentic Searcherscited by 11
  17. 2024Editing Factual Knowledge and Explanatory Ability of Medical Large Language Modelscited by 10
  18. 2025FlowKV: A Disaggregated Inference Framework with Low-Latency KV Cache Transfer and Load-Aware Schedulingcited by 10
  19. 2025SoLoPO: Unlocking Long-Context Capabilities in LLMs via Short-to-Long Preference Optimizationcited by 10
  20. 2024Revealing and Mitigating the Challenge of Detecting Character Knowledge Errors in LLM Role-Playingcited by 9
  21. 2024On the Modeling Capabilities of Large Language Models for Sequential Decision Makingcited by 9
  22. 2024NAT-NL2GQL: A Novel Multi-Agent Framework for Translating Natural Language to Graph Query Languagecited by 9
  23. 2025Safety Evaluation of DeepSeek Models in Chinese Contextscited by 9
  24. 202534 Examples of LLM Applications in Materials Science and Chemistry: Towards Automation, Assistants, Agents, and Accelerated Scientific Discoverycited by 9
  25. 2025Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generationcited by 9
  26. 2025AUTOCT: Automating Interpretable Clinical Trial Prediction with LLM Agentscited by 9
  27. 2026Probability-Entropy Calibration: An Elastic Indicator for Adaptive Fine-tuningcited by 9
  28. 2024DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priorscited by 8
  29. 2024Reflections from the 2024 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistrycited by 8
  30. 2024Stepwise Reasoning Error Disruption Attack of LLMscited by 8
  31. 2024OneKE: A Dockerized Schema-Guided LLM Agent-based Knowledge Extraction Systemcited by 8
  32. 2025CarMem: Enhancing Long-Term Memory in LLM Voice Assistants through Category-Boundingcited by 8
  33. 2025STRUCTSENSE: A Task-Agnostic Agentic Framework for Structured Information Extraction with Human-In-The-Loop Evaluation and Benchmarkingcited by 8
  34. 2025A Survey of Inductive Reasoning for Large Language Modelscited by 8
  35. 2024Enhancing Question Answering for Enterprise Knowledge Bases using Large Language Modelscited by 7
  36. 2024Generalizable and Scalable Multistage Biomedical Concept Normalization Leveraging Large Language Modelscited by 7
  37. 2024Preserving Generalization of Language models in Few-shot Continual Relation Extractioncited by 7
  38. 2024KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregationcited by 7

50 most cited of 183 All 183 (JSON)