mlsanityData to 7 Oct 2026

Pointer-Augmented Autoregressive Generation of Patent Claims with Joint Topology and Content Decoding

arXiv 2607.24040 ↗First posted 27 Jul 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Autoregressive decoders emit flat token sequences and cannot enforce hierarchical constraints across output segments, a limitation that becomes acute in patent claim generation, where a claim set forms a dependency forest whose scope must narrow monotonically with depth. Topology and content are mutually dependent: a dependent claim's wording must reflect its parent's scope, yet the parent must be chosen before that wording exists, so neither post-hoc parsing nor grammar-constrained decoding suffices. We propose SPG (Structure-aware Patent Generation), which predicts topology inside the autoregressive pass. A pointer head selects each dependent claim's parent, and its gradients, together with a depth-adaptive scope regularizer, reshape the shared decoder's representations during training. A second stage then applies a violation-weighted preference objective over self-generated deficient candidates, supplying the negative signal that granted-patent corpora lack. On HUPD-DCG, SPG on Llama-3-8B-Instruct recovers 79.0% of gold parent links, a quantity its training reward never supervises, and raises antecedent consistency from 0.292 to 0.478 over a supervised baseline of equal scale, with expert evaluation corroborating these gains.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 27 Jul 2026.

Builds on

21 of 36 references.

References · 21

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
  6. 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
  7. 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 256
  8. 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 186
  9. 2016Language to Logical Form with Neural Attentioncited by 158
  10. 2022Pretrained Language Models for Text Generation: A Surveycited by 121
  11. 2018Coarse-to-Fine Decoding for Neural Semantic Parsingcited by 110
  12. 2017Abstract Syntax Networks for Code Generation and Semantic Parsingcited by 92
9 more
  1. 2019Patent Claim Generation by Fine-Tuning OpenAI GPT-2cited by 49
  2. 2018Stack-Pointer Networks for Dependency Parsingcited by 36
  3. 2022The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applicationscited by 32
  4. 2024Can Large Language Models Generate High-quality Patent Claims?cited by 19
  5. 2025PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claimscited by 10
  6. 2024Pap2Pat: Benchmarking Outline-Guided Long-Text Patent Generation with Patent-Paper Pairscited by 8
  7. 2025Enriching Patent Claim Generation with European Patent Datasetcited by 5
  8. 2024Large Language Model for Patent Concept Generationcited by 4
  9. 2026FlowPlan-G2P: A Structured Generation Framework for Transforming Scientific Papers into Patent Descriptionscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.