mlsanityData to 14 Oct 2026

Large Language Model for Extracting Complex Contract Information in Industrial Scenes

arXiv 2507.06539 ↗First posted 9 Jul 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper proposes a high-quality dataset construction method for complex contract information extraction tasks in industrial scenarios and fine-tunes a large language model based on this dataset. Firstly, cluster analysis is performed on industrial contract texts, and GPT-4 and GPT-3.5 are used to extract key information from the original contract data, obtaining high-quality data annotations. Secondly, data augmentation is achieved by constructing new texts, and GPT-3.5 generates unstructured contract texts from randomly combined keywords, improving model robustness. Finally, the large language model is fine-tuned based on the high-quality dataset. Experimental results show that the model achieves excellent overall performance while ensuring high field recall and precision and considering parsing efficiency. LoRA, data balancing, and data augmentation effectively enhance model accuracy and robustness. The proposed method provides a novel and efficient solution for industrial contract information extraction tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 9 Jul 2025.

Builds on

19 of 33 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2017Deep reinforcement learning from human preferencescited by 3,912
  5. 2023Qwen Technical Reportcited by 3,344
  6. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  7. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  8. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  9. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  10. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
  11. 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 559
  12. 2022Unified Structure Generation for Universal Information Extractioncited by 221
7 more
  1. 2022ZeroGen: Efficient Zero-shot Learning via Dataset Generationcited by 211
  2. 2023GPT-NER: Named Entity Recognition via Large Language Modelscited by 160
  3. 2022Code4Struct: Code Generation for Few-Shot Event Structure Predictioncited by 70
  4. 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
  5. 2023Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractorscited by 45
  6. 2023Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Modelscited by 9
  7. 2022Generative Entity Typing with Curriculum Learningcited by 8

Built on by

Not cited yet.