Universal Information Extraction as Unified Semantic Matching
Not on the map. Why?
Abstract (arXiv)
The challenge of information extraction (IE) lies in the diversity of label schemas and the heterogeneity of structures. Traditional methods require task-specific model design and rely heavily on expensive supervision, making them difficult to generalize to new schemas. In this paper, we decouple IE into two basic abilities, structuring and conceptualizing, which are shared by different tasks and schemas. Based on this paradigm, we propose to universally model various IE tasks with Unified Semantic Matching (USM) framework, which introduces three unified token linking operations to model the abilities of structuring and conceptualizing. In this way, USM can jointly encode schema and input text, uniformly extract substructures in parallel, and controllably decode target structures on demand. Empirical evaluation on 4 IE tasks shows that the proposed method achieves state-of-the-art performance under the supervised experiments and shows strong generalization ability in zero/few-shot transfer settings.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Builds on 42 of its 73 references that are in the map. First posted on arXiv 9 Jan 2023.
Builds on
42 of 73 references.
References · 42
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
- 2016NewsQA: A Machine Comprehension Datasetcited by 330
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
30 more
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
- 2022Unified Structure Generation for Universal Information Extractioncited by 220
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
- 2019MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehensioncited by 183
- 2021Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extractioncited by 129
- 2017Joint Extraction of Entities and Relations Based on a Novel Tagging Schemecited by 102
- 2020CrossNER: Evaluating Cross-Domain Named Entity Recognitioncited by 102
- 2020Position-Aware Tagging for Aspect Sentiment Triplet Extractioncited by 90
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
- 2021Improving Named Entity Recognition by External Context Retrieving and Cooperative Learningcited by 76
- 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
- 2020TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linkingcited by 72
- 2017Zero-Shot Transfer Learning for Event Extractioncited by 66
- 2021Learning Span-Level Interactions for Aspect Sentiment Triplet Extractioncited by 60
- 2017A causal framework for explaining the predictions of black-box sequence-to-sequence modelscited by 58
- 2020Joint Entity and Relation Extraction with Set Prediction Networkscited by 54
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
- 2021A Partition Filter Network for Joint Entity and Relation Extractioncited by 42
- 2021PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple Extractioncited by 40
- 2021Query and Extract: Refining Event Extraction as Type-oriented Binary Decodingcited by 26
- 2022Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learningcited by 25
- 2021Zero-Shot Information Extraction as a Unified Text-to-Triple Translationcited by 22
- 2021MapRE: An Effective Semantic Mapping Approach for Low-resource Relation Extractioncited by 16
- 2022Global Pointer: Novel Efficient Span-based Approach for Named Entity Recognitioncited by 15
- 2022Nested Named Entity Recognition as Latent Lexicalized Constituency Parsingcited by 14
- 2021Aspect Sentiment Triplet Extraction Using Reinforcement Learningcited by 12
- 2019Leveraging Dependency Forest for Neural Medical Relation Extractioncited by 10
- 2022Pre-training to Match for Unified Low-shot Relation Extractioncited by 8
- 2020Learnability with Indirect Supervision Signalscited by 7
Built on by
Citing papers per year: 2023: 17; 2024: 21; 2025: 5; 2026: 4.
47 papers.
Sort:
By area:
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
- 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 116
- 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 84
- 2023Retrieval-Augmented Code Generation for Universal Information Extractioncited by 40
- 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extractioncited by 33
- 2024Looking Right is Sometimes Right: Investigating the Capabilities of Decoder-only LLMs for Sequence Labelingcited by 24
- 2023YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extractioncited by 19
- 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
- 2024UMIE: Unified Multimodal Information Extraction with Instruction Tuningcited by 17
- 2024ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budgetcited by 16
- 2024Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scalecited by 14
35 more
- 2023Mirror: A Universal Framework for Various Information Extraction Taskscited by 12
- 2023PIVOINE: Instruction Tuning for Open-world Information Extractioncited by 10
- 2023InstructIE: A Bilingual Instruction-based Information Extraction Datasetcited by 9
- 2023RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extractioncited by 7
- 2023Benchmarking Large Language Models with Augmented Instructions for Fine-grained Information Extractioncited by 6
- 2023GIELLM: Japanese General Information Extraction Large Language Model Utilizing Mutual Reinforcement Effectcited by 6
- 2024AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extractioncited by 6
- 2023DemoSG: Demonstration-enhanced Schema-guided Generation for Low-resource Event Extractioncited by 5
- 2024IEPile: Unearthing Large-Scale Schema-Based Information Extraction Corpuscited by 5
- 2023Schema-adaptable Knowledge Graph Constructioncited by 4
- 2024EventRL: Enhancing Event Extraction with Outcome Supervision for Large Language Modelscited by 3
- 2024CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graphcited by 3
- 2024WhisperNER: Unified Open Named Entity and Speech Recognitioncited by 3
- 2024RUIE: Retrieval-based Unified Information Extraction using Large Language Modelcited by 3
- 2025GuideX: Guided Synthetic Data Generation for Zero-Shot Information Extractioncited by 3
- 2023Benchingmaking Large Langage Models in Biomedical Triple Extractioncited by 2
- 2024Familiarity: Better Evaluation of Zero-Shot Named Entity Recognition by Quantifying Label Shifts in Synthetic Training Datacited by 2
- 2025FiNERweb: Datasets and Artifacts for Scalable Multilingual Named Entity Recognitioncited by 2
- 2026To Neuro-Symbolic Classification and Beyond by Compiling Description Logic Ontologies to Probabilistic Circuitscited by 2
- 2024A Regularization-based Transfer Learning Method for Information Extraction via Instructed Graph Decodercited by 1
- 2024ChatUIE: Exploring Chat-based Unified Information Extraction using Large Language Modelscited by 1
- 2024Is There a One-Model-Fits-All Approach to Information Extraction? Revisiting Task Definition Biasescited by 1
- 2024VANER: Leveraging Large Language Model for Versatile and Adaptive Biomedical Named Entity Recognitioncited by 1
- 2024EXCEEDS: Extracting Complex Events via Nugget-based Grid Modeling in Scientific Domaincited by 1
- 2024A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extractioncited by 1
- 2024Label Alignment and Reassignment with Generalist Large Language Model for Enhanced Cross-Domain Named Entity Recognitioncited by 1
- 2024Expressive Prompting: Improving Emotion Intensity and Speaker Consistency in Zero-Shot TTScited by 1
- 2025Label Drop for Multi-Aspect Relation Modeling in Universal Information Extractioncited by 1
- 2023Nested Event Extraction upon Pivot Element Recognitoncited by 0
- 2024RexUniNLU: Recursive Method with Explicit Schema Instructor for Universal NLUcited by 0
- 2025ToMMeR -- Efficient Entity Mention Detection from Large Language Modelscited by 0
- 2025SCIR: A Self-Correcting Iterative Refinement Framework for Enhanced Information Extraction Based on Schemacited by 0
- 2026What Matters When Building Universal Multilingual Named Entity Recognition Models?cited by 0
- 2026Large Language Models for Causal Relations Extraction in Social Media: A Validation Framework for Disaster Intelligencecited by 0
- 2026DIRECT: Direct Decoding for Efficient and Aligned Sequence Labeling with Large Language Modelscited by 0
- 2026DIRECT: Direct Decoding for Efficient and Aligned Sequence Labeling with Large Language Models29 Jul 2026
- 2026Large Language Models for Causal Relations Extraction in Social Media: A Validation Framework for Disaster Intelligence12 May 2026
- 2026To Neuro-Symbolic Classification and Beyond by Compiling Description Logic Ontologies to Probabilistic Circuits21 Jan 2026
- 2026What Matters When Building Universal Multilingual Named Entity Recognition Models?9 Jan 2026
- 2025FiNERweb: Datasets and Artifacts for Scalable Multilingual Named Entity Recognition15 Dec 2025
- 2025SCIR: A Self-Correcting Iterative Refinement Framework for Enhanced Information Extraction Based on Schema13 Dec 2025
- 2025ToMMeR -- Efficient Entity Mention Detection from Large Language Models22 Oct 2025
- 2025GuideX: Guided Synthetic Data Generation for Zero-Shot Information Extraction31 May 2025
- 2025Label Drop for Multi-Aspect Relation Modeling in Universal Information Extraction18 Feb 2025
- 2024Familiarity: Better Evaluation of Zero-Shot Named Entity Recognition by Quantifying Label Shifts in Synthetic Training Data13 Dec 2024
- 2024Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale7 Nov 2024
- 2024Expressive Prompting: Improving Emotion Intensity and Speaker Consistency in Zero-Shot TTS27 Sep 2024
35 more
- 2024RUIE: Retrieval-based Unified Information Extraction using Large Language Model18 Sep 2024
- 2024WhisperNER: Unified Open Named Entity and Speech Recognition12 Sep 2024
- 2024RexUniNLU: Recursive Method with Explicit Schema Instructor for Universal NLU9 Sep 2024
- 2024AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extraction3 Sep 2024
- 2024ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget31 Jul 2024
- 2024Label Alignment and Reassignment with Generalist Large Language Model for Enhanced Cross-Domain Named Entity Recognition24 Jul 2024
- 2024A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extraction15 Jul 2024
- 2024CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph25 Jun 2024
- 2024EXCEEDS: Extracting Complex Events via Nugget-based Grid Modeling in Scientific Domain20 Jun 2024
- 2024VANER: Leveraging Large Language Model for Versatile and Adaptive Biomedical Named Entity Recognition27 Apr 2024
- 2024Is There a One-Model-Fits-All Approach to Information Extraction? Revisiting Task Definition Biases25 Mar 2024
- 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction12 Mar 2024
- 2024ChatUIE: Exploring Chat-based Unified Information Extraction using Large Language Models8 Mar 2024
- 2024A Regularization-based Transfer Learning Method for Information Extraction via Instructed Graph Decoder1 Mar 2024
- 2024IEPile: Unearthing Large-Scale Schema-Based Information Extraction Corpus22 Feb 2024
- 2024EventRL: Enhancing Event Extraction with Outcome Supervision for Large Language Models18 Feb 2024
- 2024Looking Right is Sometimes Right: Investigating the Capabilities of Decoder-only LLMs for Sequence Labeling25 Jan 2024
- 2024UMIE: Unified Multimodal Information Extraction with Instruction Tuning5 Jan 2024
- 2023Large Language Models for Generative Information Extraction: A Survey29 Dec 2023
- 2023YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction24 Dec 2023
- 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformer14 Nov 2023
- 2023GIELLM: Japanese General Information Extraction Large Language Model Utilizing Mutual Reinforcement Effect12 Nov 2023
- 2023Mirror: A Universal Framework for Various Information Extraction Tasks9 Nov 2023
- 2023Retrieval-Augmented Code Generation for Universal Information Extraction6 Nov 2023
- 2023Benchingmaking Large Langage Models in Biomedical Triple Extraction27 Oct 2023
- 2023DemoSG: Demonstration-enhanced Schema-guided Generation for Low-resource Event Extraction16 Oct 2023
- 2023Benchmarking Large Language Models with Augmented Instructions for Fine-grained Information Extraction8 Oct 2023
- 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction5 Oct 2023
- 2023Nested Event Extraction upon Pivot Element Recogniton22 Sep 2023
- 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understanding21 Aug 2023
- 2023PIVOINE: Instruction Tuning for Open-world Information Extraction24 May 2023
- 2023InstructIE: A Bilingual Instruction-based Information Extraction Dataset19 May 2023
- 2023Schema-adaptable Knowledge Graph Construction15 May 2023
- 2023RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extraction28 Apr 2023
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extraction17 Apr 2023
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
- 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 116
- 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 84
- 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extractioncited by 33
- 2024Looking Right is Sometimes Right: Investigating the Capabilities of Decoder-only LLMs for Sequence Labelingcited by 24
- 2023YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extractioncited by 19
- 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
- 2024UMIE: Unified Multimodal Information Extraction with Instruction Tuningcited by 17
- 2024ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budgetcited by 16
- 2024Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scalecited by 14
- 2023Mirror: A Universal Framework for Various Information Extraction Taskscited by 12
12 most cited of 43 All 43 (JSON)
- 2026Large Language Models for Causal Relations Extraction in Social Media: A Validation Framework for Disaster Intelligence12 May 2026
- 2026To Neuro-Symbolic Classification and Beyond by Compiling Description Logic Ontologies to Probabilistic Circuits21 Jan 2026
- 2026What Matters When Building Universal Multilingual Named Entity Recognition Models?9 Jan 2026
- 2025FiNERweb: Datasets and Artifacts for Scalable Multilingual Named Entity Recognition15 Dec 2025
- 2025SCIR: A Self-Correcting Iterative Refinement Framework for Enhanced Information Extraction Based on Schema13 Dec 2025
- 2025ToMMeR -- Efficient Entity Mention Detection from Large Language Models22 Oct 2025
- 2025Label Drop for Multi-Aspect Relation Modeling in Universal Information Extraction18 Feb 2025
- 2024Familiarity: Better Evaluation of Zero-Shot Named Entity Recognition by Quantifying Label Shifts in Synthetic Training Data13 Dec 2024
- 2024Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale7 Nov 2024
- 2024Expressive Prompting: Improving Emotion Intensity and Speaker Consistency in Zero-Shot TTS27 Sep 2024
- 2024RUIE: Retrieval-based Unified Information Extraction using Large Language Model18 Sep 2024
- 2024WhisperNER: Unified Open Named Entity and Speech Recognition12 Sep 2024
12 newest of 43 All 43 (JSON)