mlsanityData to 7 Oct 2026

DynaContext: Self-Improving Dynamic Contextualization of Optimized Prompts for Heterogeneous Parameter Extraction

arXiv 2608.22014 ↗First posted 22 Aug 2026cs.AIcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-rewarding alignment and self-training

Abstract (arXiv)

Automated prompt and skill optimization typically produces a single static instruction that is reused across inference instances until the next optimization cycle. However, this approach cannot adapt when the required context, constraints, and evidence vary from one instance to another. For instance, parameter extraction from electronic component descriptions breaks this assumption: resistors, capacitors, transistors, and connectors require different fields, unit constraints, and demonstrations, and each input provides a different evidence state. We introduce DynaContext, a framework that combines an offline-optimized extraction core, learned with GEPA or SkillOpt, with inference-time contextual adaptation and validation-gated self-improvement. DynaContext routes each item through internal, external, or fallback evidence paths and composes an item-specific prompt from the core, schema, evidence, unresolved fields, and validated demonstrations. Deterministic validation and an LLM judge gate every output, uncertain cases go to human review, and only human-verified corrections enter the demonstration memory. On a single-category benchmark, average accuracy increases from 86.6% for the base prompt to 96.9% for standalone SkillOpt and 98.6% for the best DynaContext configuration. Across 850 heterogeneous gold parameter facts, average field-level F1 increases from 51.8% for an unoptimized, demonstration-free control to 59.2% with dynamic demonstrations alone, 66.9% with the optimized core alone, and 71.0% with both. Holding the model fixed, the full configuration outperforms the deployed static-prompting pipeline by 17.3 F1 points on average.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Self-rewarding alignment and self-training, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 25 of its 38 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

25 of 38 references.

References · 25

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  3. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  4. 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
  5. 2024OffsetBias: Leveraging Debiased Data for Tuning Evaluatorscited by 94
  6. 2018OpenTag: Open Attribute Value Extraction from Product Profiles [Deep Learning, Active Learning, Named Entity Recognition]cited by 62
  7. 2021MAVE: A Product Dataset for Multi-source Attribute Value Extractioncited by 53
  8. 2025You Don't Need Pre-built Graphs for RAG: Retrieval Augmented Generation with Adaptive Reasoning Structurescited by 23
  9. 2023ExtractGPT: Exploring the Potential of Large Language Models for Product Attribute Value Extractioncited by 20
  10. 2024Using LLMs for the Extraction and Normalization of Product Attribute Valuescited by 20
  11. 2025Think-J: Learning to Think for Generative LLM-as-a-Judgecited by 20
  12. 2024Enhancing Chain of Thought Prompting in Large Language Models via Reasoning Patternscited by 13
13 more
  1. 2024TrustUQA: A Trustful Framework for Unified Structured Data Question Answeringcited by 12
  2. 2025ReCode: Updating Code API Knowledge with Reinforcement Learningcited by 11
  3. 2024Multi-Label Zero-Shot Product Attribute-Value Extractioncited by 7
  4. 2026Toward Reliable Evaluation of LLM-Based Financial Multi-Agent Systems: Taxonomy, Coordination Primacy, and Cost Awarenesscited by 5
  5. 2024Retrieval Augmented Structured Generation: Business Document Information Extraction As Tool Usecited by 3
  6. 2025Agent-UniRAG: A Trainable Open-Source LLM Agent Framework for Unified Retrieval-Augmented Generation Systemscited by 2
  7. 2025Schema as Parameterized Tools for Universal Information Extractioncited by 2
  8. 2025GRETEL: A Goal-driven Retrieval and Execution-based Trial Framework for LLM Tool Selection Enhancingcited by 2
  9. 2025Self-Correction Distillation for Structured Data Question Answeringcited by 2
  10. 2025Retrieval-Augmented Multi-LLM Ensemble for Industrial Part Specification Extractioncited by 2
  11. 2024Teaching Models to Improve on Tapecited by 1
  12. 2024Enhancing Relation Extraction via Supervised Rationale Verification and Feedbackcited by 1
  13. 2026Dynamic Deep Prompt Optimization for Defending Against Jailbreak Attacks on LLMscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Rethinking Prompt Optimizers: From Prompt Merits to Optimization
  2. 2026Adaptive Prompt Structure Factorization: A Framework for Self-Discovering and Optimizing Compositional Prompt Programs
  3. 2025Self-Supervised Prompt Optimization
  4. 2026Reflective Prompt Tuning through Language Model Function-Calling
  5. 2026Targeted Tests for LLM Reasoning: An Audit-Constrained Protocol
  6. 2024Style-Compress: An LLM-Based Prompt Compression Framework Considering Task-Specific Styles
  7. 2025DynaPrompt: Dynamic Test-Time Prompt Tuning
  8. 2026Prompt Segmentation and Annotation Optimisation: Controlling LLM Behaviour via Optimised Segment-Level Annotations