mlsanityData to 7 Oct 2026

Universal Information Extraction as Unified Semantic Matching

arXiv 2301.03282 ↗First posted 9 Jan 2023cs.CLcited by 47

Not on the map. Why?

Abstract (arXiv)

The challenge of information extraction (IE) lies in the diversity of label schemas and the heterogeneity of structures. Traditional methods require task-specific model design and rely heavily on expensive supervision, making them difficult to generalize to new schemas. In this paper, we decouple IE into two basic abilities, structuring and conceptualizing, which are shared by different tasks and schemas. Based on this paradigm, we propose to universally model various IE tasks with Unified Semantic Matching (USM) framework, which introduces three unified token linking operations to model the abilities of structuring and conceptualizing. In this way, USM can jointly encode schema and input text, uniformly extract substructures in parallel, and controllably decode target structures on demand. Empirical evaluation on 4 IE tasks shows that the proposed method achieves state-of-the-art performance under the supervised experiments and shows strong generalization ability in zero/few-shot transfer settings.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Builds on 42 of its 73 references that are in the map. First posted on arXiv 9 Jan 2023.

Builds on

42 of 73 references.

References · 42

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  7. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  8. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  9. 2016Neural Architectures for Named Entity Recognitioncited by 548
  10. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  11. 2016NewsQA: A Machine Comprehension Datasetcited by 330
  12. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
30 more
  1. 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
  2. 2022Unified Structure Generation for Universal Information Extractioncited by 220
  3. 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
  4. 2019MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehensioncited by 183
  5. 2021Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extractioncited by 129
  6. 2017Joint Extraction of Entities and Relations Based on a Novel Tagging Schemecited by 102
  7. 2020CrossNER: Evaluating Cross-Domain Named Entity Recognitioncited by 102
  8. 2020Position-Aware Tagging for Aspect Sentiment Triplet Extractioncited by 90
  9. 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
  10. 2021Improving Named Entity Recognition by External Context Retrieving and Cooperative Learningcited by 76
  11. 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
  12. 2020TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linkingcited by 72
  13. 2017Zero-Shot Transfer Learning for Event Extractioncited by 66
  14. 2021Learning Span-Level Interactions for Aspect Sentiment Triplet Extractioncited by 60
  15. 2017A causal framework for explaining the predictions of black-box sequence-to-sequence modelscited by 58
  16. 2020Joint Entity and Relation Extraction with Set Prediction Networkscited by 54
  17. 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
  18. 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
  19. 2021A Partition Filter Network for Joint Entity and Relation Extractioncited by 42
  20. 2021PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple Extractioncited by 40
  21. 2021Query and Extract: Refining Event Extraction as Type-oriented Binary Decodingcited by 26
  22. 2022Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learningcited by 25
  23. 2021Zero-Shot Information Extraction as a Unified Text-to-Triple Translationcited by 22
  24. 2021MapRE: An Effective Semantic Mapping Approach for Low-resource Relation Extractioncited by 16
  25. 2022Global Pointer: Novel Efficient Span-based Approach for Named Entity Recognitioncited by 15
  26. 2022Nested Named Entity Recognition as Latent Lexicalized Constituency Parsingcited by 14
  27. 2021Aspect Sentiment Triplet Extraction Using Reinforcement Learningcited by 12
  28. 2019Leveraging Dependency Forest for Neural Medical Relation Extractioncited by 10
  29. 2022Pre-training to Match for Unified Low-shot Relation Extractioncited by 8
  30. 2020Learnability with Indirect Supervision Signalscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 17; 2024: 21; 2025: 5; 2026: 4.

47 papers.

Sort:

By area:

  1. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  2. 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
  3. 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 116
  4. 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 84
  5. 2023Retrieval-Augmented Code Generation for Universal Information Extractioncited by 40
  6. 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extractioncited by 33
  7. 2024Looking Right is Sometimes Right: Investigating the Capabilities of Decoder-only LLMs for Sequence Labelingcited by 24
  8. 2023YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extractioncited by 19
  9. 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
  10. 2024UMIE: Unified Multimodal Information Extraction with Instruction Tuningcited by 17
  11. 2024ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budgetcited by 16
  12. 2024Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scalecited by 14
35 more
  1. 2023Mirror: A Universal Framework for Various Information Extraction Taskscited by 12
  2. 2023PIVOINE: Instruction Tuning for Open-world Information Extractioncited by 10
  3. 2023InstructIE: A Bilingual Instruction-based Information Extraction Datasetcited by 9
  4. 2023RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extractioncited by 7
  5. 2023Benchmarking Large Language Models with Augmented Instructions for Fine-grained Information Extractioncited by 6
  6. 2023GIELLM: Japanese General Information Extraction Large Language Model Utilizing Mutual Reinforcement Effectcited by 6
  7. 2024AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extractioncited by 6
  8. 2023DemoSG: Demonstration-enhanced Schema-guided Generation for Low-resource Event Extractioncited by 5
  9. 2024IEPile: Unearthing Large-Scale Schema-Based Information Extraction Corpuscited by 5
  10. 2023Schema-adaptable Knowledge Graph Constructioncited by 4
  11. 2024EventRL: Enhancing Event Extraction with Outcome Supervision for Large Language Modelscited by 3
  12. 2024CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graphcited by 3
  13. 2024WhisperNER: Unified Open Named Entity and Speech Recognitioncited by 3
  14. 2024RUIE: Retrieval-based Unified Information Extraction using Large Language Modelcited by 3
  15. 2025GuideX: Guided Synthetic Data Generation for Zero-Shot Information Extractioncited by 3
  16. 2023Benchingmaking Large Langage Models in Biomedical Triple Extractioncited by 2
  17. 2024Familiarity: Better Evaluation of Zero-Shot Named Entity Recognition by Quantifying Label Shifts in Synthetic Training Datacited by 2
  18. 2025FiNERweb: Datasets and Artifacts for Scalable Multilingual Named Entity Recognitioncited by 2
  19. 2026To Neuro-Symbolic Classification and Beyond by Compiling Description Logic Ontologies to Probabilistic Circuitscited by 2
  20. 2024A Regularization-based Transfer Learning Method for Information Extraction via Instructed Graph Decodercited by 1
  21. 2024ChatUIE: Exploring Chat-based Unified Information Extraction using Large Language Modelscited by 1
  22. 2024Is There a One-Model-Fits-All Approach to Information Extraction? Revisiting Task Definition Biasescited by 1
  23. 2024VANER: Leveraging Large Language Model for Versatile and Adaptive Biomedical Named Entity Recognitioncited by 1
  24. 2024EXCEEDS: Extracting Complex Events via Nugget-based Grid Modeling in Scientific Domaincited by 1
  25. 2024A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extractioncited by 1
  26. 2024Label Alignment and Reassignment with Generalist Large Language Model for Enhanced Cross-Domain Named Entity Recognitioncited by 1
  27. 2024Expressive Prompting: Improving Emotion Intensity and Speaker Consistency in Zero-Shot TTScited by 1
  28. 2025Label Drop for Multi-Aspect Relation Modeling in Universal Information Extractioncited by 1
  29. 2023Nested Event Extraction upon Pivot Element Recognitoncited by 0
  30. 2024RexUniNLU: Recursive Method with Explicit Schema Instructor for Universal NLUcited by 0
  31. 2025ToMMeR -- Efficient Entity Mention Detection from Large Language Modelscited by 0
  32. 2025SCIR: A Self-Correcting Iterative Refinement Framework for Enhanced Information Extraction Based on Schemacited by 0
  33. 2026What Matters When Building Universal Multilingual Named Entity Recognition Models?cited by 0
  34. 2026Large Language Models for Causal Relations Extraction in Social Media: A Validation Framework for Disaster Intelligencecited by 0
  35. 2026DIRECT: Direct Decoding for Efficient and Aligned Sequence Labeling with Large Language Modelscited by 0