Pointer-Augmented Autoregressive Generation of Patent Claims with Joint Topology and Content Decoding
Not on the map. Why?
Abstract (arXiv)
Autoregressive decoders emit flat token sequences and cannot enforce hierarchical constraints across output segments, a limitation that becomes acute in patent claim generation, where a claim set forms a dependency forest whose scope must narrow monotonically with depth. Topology and content are mutually dependent: a dependent claim's wording must reflect its parent's scope, yet the parent must be chosen before that wording exists, so neither post-hoc parsing nor grammar-constrained decoding suffices. We propose SPG (Structure-aware Patent Generation), which predicts topology inside the autoregressive pass. A pointer head selects each dependent claim's parent, and its gradients, together with a depth-adaptive scope regularizer, reshape the shared decoder's representations during training. A second stage then applies a violation-weighted preference objective over self-generated deficient candidates, supplying the negative signal that granted-patent corpora lack. On HUPD-DCG, SPG on Llama-3-8B-Instruct recovers 79.0% of gold parent links, a quantity its training reward never supervises, and raises antecedent consistency from 0.292 to 0.478 over a supervised baseline of equal scale, with expert evaluation corroborating these gains.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
21 of 36 references.
References · 21
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
- 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
- 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 256
- 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 186
- 2016Language to Logical Form with Neural Attentioncited by 158
- 2022Pretrained Language Models for Text Generation: A Surveycited by 121
- 2018Coarse-to-Fine Decoding for Neural Semantic Parsingcited by 110
- 2017Abstract Syntax Networks for Code Generation and Semantic Parsingcited by 92
9 more
- 2019Patent Claim Generation by Fine-Tuning OpenAI GPT-2cited by 49
- 2018Stack-Pointer Networks for Dependency Parsingcited by 36
- 2022The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applicationscited by 32
- 2024Can Large Language Models Generate High-quality Patent Claims?cited by 19
- 2025PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claimscited by 10
- 2024Pap2Pat: Benchmarking Outline-Guided Long-Text Patent Generation with Patent-Paper Pairscited by 8
- 2025Enriching Patent Claim Generation with European Patent Datasetcited by 5
- 2024Large Language Model for Patent Concept Generationcited by 4
- 2026FlowPlan-G2P: A Structured Generation Framework for Transforming Scientific Papers into Patent Descriptionscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Benchmarking Patent Drafting from Inventor-Style Disclosures21 Aug 2026