Adapt Semantics, Not Structure: Few-Instance Schema Calibration for Scientific PDF Extraction
Not on the map. Why?
Abstract (arXiv)
A well-designed extraction schema is not necessarily ready for reliable LLM execution. When only limited verified extractions are available, manually tuning hundreds of field definitions through trial and error is costly. We frame this problem as few-instance schema calibration: adapting the operational semantics of an existing schema from a few annotated documents while preserving its structural contract. We introduce CPSE, a contract-preserving semantic extraction framework that jointly calibrates extraction prompts and field-level semantic descriptions from a few gold annotations. CPSE decomposes the schema into an invariant structural contract and mutable field semantics, and further separates identity discovery from record completion using manifest-conditioned resolution. On expert-annotated polymer-science documents, CPSE improves extraction by 9.93 points over an execution-matched baseline, with consistent gains under an independent judge and in a blinded expert audit. These results show that CPSE enables low-resource schema execution while preserving the output structure required downstream.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 18 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
13 of 18 references.
References · 13
- 2023Large Language Models as Optimizerscited by 830
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
- 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 186
- 2020SciREX: A Challenge Dataset for Document-Level Information Extractioncited by 111
- 2021Document-level Entity-based Extraction as Template Generationcited by 33
- 2022A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processingcited by 22
- 2024Mining experimental data from Materials Science literature with Large Language Models: an evaluation studycited by 11
- 2023Reconstructing Materials Tetrahedron: Challenges in Materials Information Extractioncited by 8
- 2024Learning to Extract Structured Entities Using Language Modelscited by 8
- 2025PARSE: LLM Driven Schema Optimization for Reliable Entity Extractioncited by 6
Built on by
Not cited yet.