LA-RL: Label-Aware Self-Reflection for Reinforcement Learning in Information Extraction
On the map: Deep reinforcement learning methods → RL training of language and agent models
Abstract (arXiv)
Large language models show strong promise for information extraction (IE), but existing reflection-based correction methods are often misaligned with structured extraction outputs. Free-form self-reflection can flag an error, yet it rarely identifies whether the failure is a missing span, wrong label, boundary mismatch, invalid relation type, or reversed argument order. We introduce LA-RL (Label-Aware Reflective Reinforcement Learning), an outcome-supervised framework that guides IE self-correction with task-grounded diagnostic labels. A single backbone first predicts an extraction, diagnoses task-specific error labels, and then revises its output conditioned on the diagnosis. Training starts from diagnostic data labeled by an annotation model for cold-start supervised fine-tuning and proceeds through two GRPO stages that reward final extraction quality, format validity, and first-pass correctness, without a process reward model. Experiments on named entity recognition, relation extraction, and event extraction show consistent same-backbone gains over SFT, including 6.83 average F1 on SciER relation extraction, about 20 F1 on out-of-distribution relation extraction, and 14.80 trigger F1 plus 17.50 argument F1 on DuEE1.0. Ablations show that reflection structure is task-sensitive: stronger constraints benefit relation extraction, whereas named entity recognition needs less restrictive correction under domain shift.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 21 of its 31 references that are in the map. First posted on arXiv 26 Jul 2026.
Builds on
21 of 31 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2016Neural Architectures for Named Entity Recognitioncited by 550
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
- 2025Competitive Programming with Large Reasoning Modelscited by 119
- 2023Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Modelscited by 87
- 2021Packed Levitated Marker for Entity and Relation Extractioncited by 49
9 more
- 2020A Frustratingly Easy Approach for Entity and Relation Extractioncited by 37
- 2024C-ICL: Contrastive In-context Learning for Information Extractioncited by 23
- 2024SciER: An Entity and Relation Extraction Dataset for Datasets, Methods, and Tasks in Scientific Documentscited by 21
- 2022CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translationcited by 17
- 2023mCL-NER: Cross-Lingual Named Entity Recognition via Multi-view Contrastive Learningcited by 14
- 2024Distinguishing Ignorance from Error in LLM Hallucinationscited by 14
- 2023Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networkscited by 11
- 2024Aligning Visual Contrastive learning models via Preference Optimizationcited by 4
- 2025Beyond path selection: Better LLMs for Scientific Information Extraction with MimicSFT and Relevance and Rule-induced(R2)GRPOcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025R1-RE: Cross-Domain Relation Extraction with RLVR
- 2026When Self-Belief Misleads: Active Label Acquisition for Reinforcement Learning with Verifiable Rewards
- 2025MR-UIE: Multi-Perspective Reasoning with Reinforcement Learning for Universal Information Extraction
- 2026Reflective Recovery: A Self-Supervised Method for Reasoning by Learning from Mistakes
- 2023Guideline Learning for In-context Information Extraction
- 2025Co-rewarding: Stable Self-supervised RL for Eliciting Reasoning in Large Language Models
- 2026Learning from Your Own Mistakes: Constructing Learnable Micro-Reflective Trajectories for Self-Distillation
- 2025Instructions are all you need: Self-supervised Reinforcement Learning for Instruction Following