mlsanityData to 7 Oct 2026

A Dynamic Self-Evolving Extraction System

arXiv 2603.06915 ↗First posted 6 Mar 2026cs.CL cs.LGcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-evolving search agents

Abstract (arXiv)

The extraction of structured information from raw text is a fundamental component of many NLP applications, including document retrieval, ranking, and relevance estimation. High-quality extractions often require domain-specific accuracy, up-to-date understanding of specialized taxonomies, and the ability to incorporate emerging jargon and rare outliers. In many domains--such as medical, legal, and HR--the extraction model must also adapt to shifting terminology and benefit from explicit reasoning over structured knowledge. We propose DySECT, a Dynamic Self-Evolving Extraction and Curation Toolkit, which continually improves as it is used. The system incrementally populates a versatile, self-expanding knowledge base (KB) with triples extracted by the LLM. The KB further enriches itself through the integration of probabilistic knowledge and graph-based reasoning, gradually accumulating domain concepts and relationships. The enriched KB then feeds back into the LLM extractor via prompt tuning, sampling of relevant few-shot examples, or fine-tuning using KB-derived synthetic data. As a result, the system forms a symbiotic closed-loop cycle in which extraction continuously improves knowledge, and knowledge continuously improves extraction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Self-evolving search agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 4 of its 14 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

4 of 14 references.

References · 4

  1. 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
  2. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  3. 2023Rethinking Language Models as Symbolic Knowledge Graphscited by 12
  4. 2024Continuous Unsupervised Domain Adaptation Using Stabilized Representations and Experience Replaycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025STRUCTSENSE: A Task-Agnostic Agentic Framework for Structured Information Extraction with Human-In-The-Loop Evaluation and Benchmarking
  2. 2024A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences
  3. 2026RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM
  4. 2026Guardian Crawler: Retrieval-First Knowledge Discovery with Bounded LLM Augmentation for Noisy Web Intelligence
  5. 2024LLMs are not Zero-Shot Reasoners for Biomedical Information Extraction
  6. 2025MedKGent: A Large Language Model Agent Framework for Constructing Temporally Evolving Medical Knowledge Graph
  7. 2023Fine-tuning and aligning question answering models for complex information extraction tasks
  8. 2025T-GRAG: A Dynamic GraphRAG Framework for Resolving Temporal Conflicts and Redundancy in Knowledge Retrieval