A Dynamic Self-Evolving Extraction System
On the map: Synthetic data and self-improvement for LLMs → Self-evolving search agents
Abstract (arXiv)
The extraction of structured information from raw text is a fundamental component of many NLP applications, including document retrieval, ranking, and relevance estimation. High-quality extractions often require domain-specific accuracy, up-to-date understanding of specialized taxonomies, and the ability to incorporate emerging jargon and rare outliers. In many domains--such as medical, legal, and HR--the extraction model must also adapt to shifting terminology and benefit from explicit reasoning over structured knowledge. We propose DySECT, a Dynamic Self-Evolving Extraction and Curation Toolkit, which continually improves as it is used. The system incrementally populates a versatile, self-expanding knowledge base (KB) with triples extracted by the LLM. The KB further enriches itself through the integration of probabilistic knowledge and graph-based reasoning, gradually accumulating domain concepts and relationships. The enriched KB then feeds back into the LLM extractor via prompt tuning, sampling of relevant few-shot examples, or fine-tuning using KB-derived synthetic data. As a result, the system forms a symbiotic closed-loop cycle in which extraction continuously improves knowledge, and knowledge continuously improves extraction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Self-evolving search agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 4 of its 14 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
4 of 14 references.
References · 4
- 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2023Rethinking Language Models as Symbolic Knowledge Graphscited by 12
- 2024Continuous Unsupervised Domain Adaptation Using Stabilized Representations and Experience Replaycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025STRUCTSENSE: A Task-Agnostic Agentic Framework for Structured Information Extraction with Human-In-The-Loop Evaluation and Benchmarking
- 2024A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences
- 2026RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM
- 2026Guardian Crawler: Retrieval-First Knowledge Discovery with Bounded LLM Augmentation for Noisy Web Intelligence
- 2024LLMs are not Zero-Shot Reasoners for Biomedical Information Extraction
- 2025MedKGent: A Large Language Model Agent Framework for Constructing Temporally Evolving Medical Knowledge Graph
- 2023Fine-tuning and aligning question answering models for complex information extraction tasks
- 2025T-GRAG: A Dynamic GraphRAG Framework for Resolving Temporal Conflicts and Redundancy in Knowledge Retrieval