mlsanityData to 14 Oct 2026

ProUIE: A Macro-to-Micro Progressive Learning Method for LLM-based Universal Information Extraction

arXiv 2604.10633 ↗First posted 12 Apr 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

LLM-based universal information extraction (UIE) methods often rely on additional information beyond the original training data, which increases training complexity yet often yields limited gains. To address this, we propose ProUIE, a Macro-to-Micro progressive learning approach that improves UIE without introducing any external information. ProUIE consists of three stages: (i) macro-level Complete Modeling (CM), which learns NER, RE, and EE along their intrinsic difficulty order on the full training data to build a unified extraction foundation, (ii) meso-level Streamlined Alignment (SA), which operates on sampled data with simplified target formats, streamlining and regularizing structured outputs to make them more concise and controllable, and (iii) micro-level Deep Exploration (DE), which applies GRPO with stepwise fine-grained rewards (SFR) over structural units to guide exploration and improve performance. Experiments on 36 public datasets show that ProUIE consistently improves unified extraction, outperforming strong instruction-tuned baselines on average for NER and RE while using a smaller backbone, and it further demonstrates clear gains in large-scale production-oriented information extraction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 19 references that are in the map. First posted on arXiv 12 Apr 2026.

Builds on

15 of 19 references.

References · 15

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  3. 2016Neural Architectures for Named Entity Recognitioncited by 550
  4. 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
  5. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  6. 2022Unified Structure Generation for Universal Information Extractioncited by 221
  7. 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
  8. 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 119
  9. 2023LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Modelcited by 43
  10. 2023Retrieval-Augmented Code Generation for Universal Information Extractioncited by 40
  11. 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extractioncited by 34
  12. 2023Schema-Driven Information Extraction from Heterogeneous Tablescited by 25
3 more
  1. 2023Guideline Learning for In-context Information Extractioncited by 24
  2. 2023YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extractioncited by 19
  3. 2025MPL: Multiple Programming Languages with Large Language Models for Information Extractioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MR-UIE: Multi-Perspective Reasoning with Reinforcement Learning for Universal Information Extraction
  2. 2024ADELIE: Aligning Large Language Models on Information Extraction
  3. 2024ChatUIE: Exploring Chat-based Unified Information Extraction using Large Language Models
  4. 2025Taming Polysemanticity in LLMs: Provable Feature Recovery via Sparse Autoencoders
  5. 2024RUIE: Retrieval-based Unified Information Extraction using Large Language Model
  6. 2026Guiding LLM Post-training Data Engineering with Model Internals from Sparse Autoencoders
  7. 2025Extract-0: A Specialized Language Model for Document Information Extraction
  8. 2026MAPLE: A Multi-Axis Parametric Knowledge Extraction Lens for LLM Evaluation