mlsanityData to 14 Oct 2026

GIELLM: Japanese General Information Extraction Large Language Model Utilizing Mutual Reinforcement Effect

arXiv 2311.06838 ↗First posted 12 Nov 2023cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Information Extraction (IE) stands as a cornerstone in natural language processing, traditionally segmented into distinct sub-tasks. The advent of Large Language Models (LLMs) heralds a paradigm shift, suggesting the feasibility of a singular model addressing multiple IE subtasks. In this vein, we introduce the General Information Extraction Large Language Model (GIELLM), which integrates text Classification, Sentiment Analysis, Named Entity Recognition, Relation Extraction, and Event Extraction using a uniform input-output schema. This innovation marks the first instance of a model simultaneously handling such a diverse array of IE subtasks. Notably, the GIELLM leverages the Mutual Reinforcement Effect (MRE), enhancing performance in integrated tasks compared to their isolated counterparts. Our experiments demonstrate State-of-the-Art (SOTA) results in five out of six Japanese mixed datasets, significantly surpassing GPT-3.5-Turbo. Further, an independent evaluation using the novel Text Classification Relation and Event Extraction(TCREE) dataset corroborates the synergistic advantages of MRE in text and word classification. This breakthrough paves the way for most IE subtasks to be subsumed under a singular LLM framework. Specialized fine-tune task-specific models are no longer needed.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 12 Nov 2023.

Builds on

23 of 32 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  9. 2023LIMA: Less Is More for Alignmentcited by 1,100
  10. 2022A Survey on In-context Learningcited by 721
  11. 2016Neural Architectures for Named Entity Recognitioncited by 550
  12. 2022Unified Structure Generation for Universal Information Extractioncited by 221
11 more
  1. 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
  2. 2019Text Classification Algorithms: A Surveycited by 163
  3. 2021A Unified Generative Framework for Various NER Subtaskscited by 141
  4. 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 72
  5. 2021GenIE: Generative Information Extractioncited by 53
  6. 2023Universal Information Extraction as Unified Semantic Matchingcited by 48
  7. 2023Retrieval-Augmented Code Generation for Universal Information Extractioncited by 40
  8. 2022InstructionNER: A Multi-Task Instruction-Based Generative Framework for Few-shot NERcited by 31
  9. 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
  10. 2023USA: Universal Sentiment Analysis Model & Construction of Japanese Sentiment Text Classification and Part of Speech Datasetcited by 6
  11. 2023Sentence-to-Label Generation Framework for Multi-task Learning of Japanese Sentence Classification and Named Entity Recognitioncited by 3

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 4.

6 papers.