Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction
Not on the map. Why?
Abstract (arXiv)
We introduce a multi-task setup of identifying and classifying entities, relations, and coreference clusters in scientific articles. We create SciERC, a dataset that includes annotations for all three tasks and develop a unified framework called Scientific Information Extractor (SciIE) for with shared span representations. The multi-task setup reduces cascading errors between tasks and leverages cross-sentence relations through coreference links. Experiments show that our multi-task model outperforms previous models in scientific information extraction without using any domain-specific features. We further show that the framework supports construction of a scientific knowledge graph, which we use to analyze information in scientific literature.
Key facts. Cited by 321 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 52; 2022: 61; 2023: 86; 2024: 64; 2025: 29; 2026: 29.
321 papers.
Sort:
By area:
- 2021Merging Models with Fisher-Weighted Averagingcited by 613
- 2023Data Selection for Language Models via Importance Resamplingcited by 322
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
- 2023Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2cited by 227
- 2022Unified Structure Generation for Universal Information Extractioncited by 220
- 2023Continual Pre-training of Language Modelscited by 194
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 174
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
- 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
- 2021Lifelong Pretraining: Continually Adapting Language Models to Emerging Corporacited by 114
- 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
38 more
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2021Time Waits for No One! Analysis and Challenges of Temporal Misalignmentcited by 91
- 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
- 2022Black-box Prompt Learning for Pre-trained Language Modelscited by 70
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
- 2024Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Constructioncited by 70
- 2023CodeIE: Large Code Generation Models are Better Few-Shot Information Extractorscited by 67
- 2021Can We Automate Scientific Reviewing?cited by 63
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2021Multi-Task Learning in Natural Language Processing: An Overviewcited by 61
- 2021Packed Levitated Marker for Entity and Relation Extractioncited by 49
- 2022Generative Knowledge Graph Construction: A Reviewcited by 49
- 2023Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Textcited by 48
- 2023Universal Information Extraction as Unified Semantic Matchingcited by 47
- 2024Let's Learn Step by Step: Enhancing In-Context Learning Ability with Curriculum Learningcited by 47
- 2021A Partition Filter Network for Joint Entity and Relation Extractioncited by 42
- 2022A Decade of Knowledge Graphs in Natural Language Processing: A Surveycited by 40
- 2023Retrieval-Augmented Code Generation for Universal Information Extractioncited by 40
- 2021A Survey on Neural-symbolic Learning Systemscited by 39
- 2021UniRE: A Unified Label Space for Entity Relation Extractioncited by 38
- 2022Revise and Resubmit: An Intertextual Model of Text-based Collaboration in Peer Reviewcited by 37
- 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literaturecited by 37
- 2021Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domainscited by 36
- 2021Efficient Domain Adaptation of Language Models via Adaptive Tokenizationcited by 34
- 2021NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Frameworkcited by 34
- 2022Continual Training of Language Models for Few-Shot Learningcited by 33
- 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extractioncited by 33
- 2024Get more for less: Principled Data Selection for Warming Up Fine-Tuning in LLMscited by 32
- 2021An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learningcited by 31
- 2023How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?cited by 30
- 2021TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metricscited by 29
- 2022Performance Optimization for Semantic Communications: An Attention-based Reinforcement Learning Approachcited by 28
- 2023CodeKGC: Code Language Model for Generative Knowledge Graph Constructioncited by 28
- 2024TSDS: Data Selection for Task-Specific Model Finetuningcited by 28
- 2022Neuro-Symbolic Entropy Regularizationcited by 27
- 2021A Trigger-Sense Memory Flow Framework for Joint Entity and Relation Extractioncited by 26
- 2021Should We Be Pre-training? An Argument for End-task Aware Training as an Alternativecited by 26
50 most cited of 321 All 321 (JSON)
- 2026PathAnchor: Path-Structured Evidence for Scientific Agents30 Sep 2026
- 2026From Weak Task Specifications to Scientific Extraction Agents: Optimizing Task Construction28 Sep 2026
- 2026Same Problem, Different Field: Cross-Domain Solution Import via Domain-Stripped Computational Fingerprints7 Sep 2026
- 2026SCoR: A Hierarchical Framework for Forecasting Relations Between Scientific Concepts27 Aug 2026
- 2026From Extraction to Governed Memory: Multi-Agent Knowledge Graph Construction with Domain-Expert Review12 Aug 2026
- 2026MUSE: A Full-Text Cross-Domain Knowledge Base of Scientific Problems, Solutions, and Rationales11 Aug 2026
- 2026Enhancing Scientific Named Entity Recognition via Large Language Models: A Type-driven Multi-task Learning Approach9 Aug 2026
- 2026AskChem: Claim-Centered Infrastructure for Chemistry Literature Synthesis30 Jul 2026
- 2026From Static Bibliometrics to Dynamic Knowledge Graphs: An LLM-Powered Framework for Modernizing Science, Technology, and Innovation (STI) Analytics23 Jul 2026
- 2026Object Aligner: A Configurable JSON Schema Similarity Score for Graphs, Applied to LLM Prompt Optimization2 Jul 2026
- 2026Revealing the Technology Development of Natural Language Processing: A Scientific Entity-Centric Perspective29 Jun 2026
- 2026LC-ICL: Label-Guided Contrastive In-Context Learning for Robust Information Extraction28 Jun 2026
38 more
- 2026Extracting Problem and Method Sentence from Scientific Papers: A Context-enhanced Transformer Using Formulaic Expression Desensitization25 Jun 2026
- 2026How Does Research Evolve? Tracing Cross-Domain Trajectories in NLP, ML, and CV Through Claim-Grounded Typed Citations21 Jun 2026
- 2026Building Agent Harnesses for Scientific Curation from Multimodal Sources19 Jun 2026
- 2026AutoTail-BSFGM: Class-Balance-Aware Fine-Tuning for Chinese Scholarly Text Classification2 Jun 2026
- 2026HyBIRD: Hyperbolic Bridge Retrieval and Diagnosis for Methodology Inspiration Retrieval29 May 2026
- 2026The Scientific Contribution Graph: Automated Literature-based Technological Roadmapping at Scale14 May 2026
- 2026Material Database Agent: A Multimodal Agentic Framework for Scientific Literature Mining5 May 2026
- 2026MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning18 Apr 2026
- 2026LLMs Underperform Graph-Based Parsers on Supervised Relation Extraction for Complex Graphs9 Apr 2026
- 2026Do Lexical and Contextual Coreference Resolution Systems Degrade Differently under Mention Noise? An Empirical Study on Scientific Software Mentions2 Apr 2026
- 2026HGNet: Scalable Foundation Model for Automated Knowledge Graph Generation from Scientific Literature24 Mar 2026
- 2026Context Selection for Hypothesis and Statistical Evidence Extraction from Full-Text Scientific Articles22 Mar 2026
- 2026NERdME: a Named Entity Recognition Dataset for Indexing Research Artifacts in Code Repositories5 Mar 2026
- 2026MetaLead: A Comprehensive Human-Curated Leaderboard Dataset for Transparent Reporting of Machine Learning Experiments30 Jan 2026
- 2026Multi-Disciplinary Dataset Discovery from Citation-Verified Literature Contexts8 Jan 2026
- 2026BioPIE: A Biomedical Protocol Information Extraction Dataset for Experiment Understanding8 Jan 2026
- 2026Structured Decomposition for LLM Reasoning: Cross-Domain Validation and Semantic Web Integration4 Jan 2026
- 2025Evaluating LLMs for Zeolite Synthesis Event Extraction (ZSEE): A Systematic Analysis of Prompting Strategies17 Dec 2025
- 2025SciLaD: A Large-Scale, Transparent, Reproducible Dataset for Natural Scientific Language Processing12 Dec 2025
- 2025OmniStruct: Universal Text-to-Structure Generation across Diverse Schemas23 Nov 2025
- 2025ManufactuBERT: Efficient Continual Pretraining for Manufacturing7 Nov 2025
- 2025A systematic review of relation extraction task since the emergence of Transformers5 Nov 2025
- 2025LightKGG: Simple and Efficient Knowledge Graph Generation from Textual Data27 Oct 2025
- 2025ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflows23 Oct 2025
- 2025Evaluating Embedding Frameworks for Scientific Domain3 Oct 2025
- 2025SciEvent: Benchmarking Multi-domain Scientific Event Extraction19 Sep 2025
- 2025Unveiling the Merits and Defects of LLMs in Automatic Review Generation for Scientific Papers13 Sep 2025
- 2025MR-UIE: Multi-Perspective Reasoning with Reinforcement Learning for Universal Information Extraction11 Sep 2025
- 2025SciNLP: A Domain-Specific Benchmark for Full-Text Scientific Entity and Relation Extraction in NLP9 Sep 2025
- 2025Hallucination-Resistant Relation Extraction via Dependency-Aware Sentence Simplification and Two-tiered Hierarchical Refinement20 Aug 2025
- 2025An LLM + ASP Workflow for Joint Entity-Relation Extraction18 Aug 2025
- 2025Structuring the Unstructured: A Systematic Review of Text-to-Structure Generation for Agentic AI with a Universal Evaluation Framework17 Aug 2025
- 2025DynamixSFT: Dynamic Mixture Optimization of Instruction Tuning Collections16 Aug 2025
- 2025Reflect then Learn: Active Prompting for Information Extraction Guided by Introspective Confusion10 Aug 2025
- 2025GLiDRE: Generalist Lightweight model for Document-level Relation Extraction1 Aug 2025
- 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledge4 Jul 2025
- 2025DoMIX: An Efficient Framework for Exploiting Domain Knowledge in Fine-Tuning3 Jul 2025
- 2025KnowCoder-V2: Deep Knowledge Analysis7 Jun 2025
50 newest of 321 All 321 (JSON)
- 2024AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extractioncited by 6
- 2025Structuring the Unstructured: A Systematic Review of Text-to-Structure Generation for Agentic AI with a Universal Evaluation Frameworkcited by 2
- 2025OmniStruct: Universal Text-to-Structure Generation across Diverse Schemascited by 0
- 2026Material Database Agent: A Multimodal Agentic Framework for Scientific Literature Miningcited by 0
- 2026Object Aligner: A Configurable JSON Schema Similarity Score for Graphs, Applied to LLM Prompt Optimizationcited by 0
- 2026From Extraction to Governed Memory: Multi-Agent Knowledge Graph Construction with Domain-Expert Reviewcited by 0
- 2026From Weak Task Specifications to Scientific Extraction Agents: Optimizing Task Constructioncited by 0
- 2026From Weak Task Specifications to Scientific Extraction Agents: Optimizing Task Construction28 Sep 2026
- 2026From Extraction to Governed Memory: Multi-Agent Knowledge Graph Construction with Domain-Expert Review12 Aug 2026
- 2026Object Aligner: A Configurable JSON Schema Similarity Score for Graphs, Applied to LLM Prompt Optimization2 Jul 2026
- 2026Material Database Agent: A Multimodal Agentic Framework for Scientific Literature Mining5 May 2026
- 2025OmniStruct: Universal Text-to-Structure Generation across Diverse Schemas23 Nov 2025
- 2025Structuring the Unstructured: A Systematic Review of Text-to-Structure Generation for Agentic AI with a Universal Evaluation Framework17 Aug 2025
- 2024AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extraction3 Sep 2024
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extractioncited by 6
- 2025MR-UIE: Multi-Perspective Reasoning with Reinforcement Learning for Universal Information Extractioncited by 6
- 2024Inferring Scientific Cross-Document Coreference and Hierarchy with Definition-Augmented Relational Reasoningcited by 2
- 2025KnowCoder-V2: Deep Knowledge Analysiscited by 1
- 2026Structured Decomposition for LLM Reasoning: Cross-Domain Validation and Semantic Web Integrationcited by 1
- 2026MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoningcited by 0
- 2026MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning18 Apr 2026
- 2026Structured Decomposition for LLM Reasoning: Cross-Domain Validation and Semantic Web Integration4 Jan 2026
- 2025MR-UIE: Multi-Perspective Reasoning with Reinforcement Learning for Universal Information Extraction11 Sep 2025
- 2025KnowCoder-V2: Deep Knowledge Analysis7 Jun 2025
- 2024Inferring Scientific Cross-Document Coreference and Hierarchy with Definition-Augmented Relational Reasoning23 Sep 2024
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extraction27 Apr 2024
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities22 May 2023
- 2023Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2cited by 227
- 2024ADELIE: Aligning Large Language Models on Information Extractioncited by 24
- 2025Hallucination-Resistant Relation Extraction via Dependency-Aware Sentence Simplification and Two-tiered Hierarchical Refinementcited by 0
- 2025Hallucination-Resistant Relation Extraction via Dependency-Aware Sentence Simplification and Two-tiered Hierarchical Refinement20 Aug 2025
- 2024ADELIE: Aligning Large Language Models on Information Extraction8 May 2024
- 2023Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 217 Nov 2023
- 2021Merging Models with Fisher-Weighted Averagingcited by 613
- 2023Data Selection for Language Models via Importance Resamplingcited by 322
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
- 2022Unified Structure Generation for Universal Information Extractioncited by 220
- 2023Continual Pre-training of Language Modelscited by 194
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 174
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
- 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
- 2021Lifelong Pretraining: Continually Adapting Language Models to Emerging Corporacited by 114
- 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
12 most cited of 302 All 302 (JSON)
- 2026PathAnchor: Path-Structured Evidence for Scientific Agents30 Sep 2026
- 2026Same Problem, Different Field: Cross-Domain Solution Import via Domain-Stripped Computational Fingerprints7 Sep 2026
- 2026SCoR: A Hierarchical Framework for Forecasting Relations Between Scientific Concepts27 Aug 2026
- 2026MUSE: A Full-Text Cross-Domain Knowledge Base of Scientific Problems, Solutions, and Rationales11 Aug 2026
- 2026Enhancing Scientific Named Entity Recognition via Large Language Models: A Type-driven Multi-task Learning Approach9 Aug 2026
- 2026AskChem: Claim-Centered Infrastructure for Chemistry Literature Synthesis30 Jul 2026
- 2026From Static Bibliometrics to Dynamic Knowledge Graphs: An LLM-Powered Framework for Modernizing Science, Technology, and Innovation (STI) Analytics23 Jul 2026
- 2026Revealing the Technology Development of Natural Language Processing: A Scientific Entity-Centric Perspective29 Jun 2026
- 2026LC-ICL: Label-Guided Contrastive In-Context Learning for Robust Information Extraction28 Jun 2026
- 2026Extracting Problem and Method Sentence from Scientific Papers: A Context-enhanced Transformer Using Formulaic Expression Desensitization25 Jun 2026
- 2026How Does Research Evolve? Tracing Cross-Domain Trajectories in NLP, ML, and CV Through Claim-Grounded Typed Citations21 Jun 2026
- 2026Building Agent Harnesses for Scientific Curation from Multimodal Sources19 Jun 2026
12 newest of 302 All 302 (JSON)