Adaptive Cost-Efficient Evaluation for Reliable Patent Claim Generation
Not on the map. Why?
Abstract (arXiv)
Automated patent claim validation demands low error tolerance. However, existing approaches face a rigidity-resource dilemma: lightweight encoders cannot track long-range legal dependencies, while exhaustive LLM verification incurs 4-5X higher overhead at million-claim scale. A naive confidence-based cascade cannot resolve this because binary validity scores fail to distinguish structurally distinct error types which require different reasoning depths. We propose a two-stage framework: Adaptive Cost-efficient Evaluation (ACE), which exploits the categorical structure of patent errors for uncertainty-aware routing. In the first stage, a fine-tuned encoder projects claims into a K+1 distribution over legal error types, whose predictive entropy serves as the routing signal. Claims exceeding an entropy threshold are escalated to the second stage, where an expert LLM executes a schema-constrained Chain-of-Patent-Thought (CoPT) protocol to map claim elements against 35 U.S.C. standards whose schema constraint reduces per-claim latency by 42% while producing legally grounded verdicts. We further present a 40,000-claim dataset ACE-40k with MPEP-grounded annotations, where ACE surpasses competitive baselines including a supervised 70B-parameter LLM while reducing costs by 78%. On real USPTO rejection data, the routing mechanism transfers without re-calibration, reducing inference time by 60% while maintaining competitive recall.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
14 of 27 references.
References · 14
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 418
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 353
- 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistscited by 94
- 2022Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settingscited by 66
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Benchmarking Patent Drafting from Inventor-Style Disclosures21 Aug 2026