LatticeBridge: Rare-Event Sequential Inference for Faithful Structured Sequence Synthesis
Not on the map. Why?
Abstract (arXiv)
Structured sequence generation often requires a model to satisfy several input-derived constraints in a single output. Standard decoding methods may assign high probability to fluent continuations while placing low mass on continuations that realize all required anchors jointly. We study this regime as a rare-event sequential inference problem. LatticeBridge combines a compact prefix language model, instance-compiled surface automata, and a twisted sequential Monte Carlo (SMC) decoder with resampling, multilevel splitting, and a source-support proposal term derived from instance-provided phrases. The constraint representation is compiled from each input instance and does not rely on manually curated lexical classes. On 2,610 attainable validation tasks spanning CommonGen, E2E NLG, and WikiBio, the particle decoder improves exact anchor satisfaction and mean anchor coverage over greedy, beam-filtered, and best-of-k ancestral baselines under a shared proposal model. Since exact anchor satisfaction alone does not rule out unsupported attribute substitutions, the evaluation reports required-anchor coverage, source coverage, source-intrusion diagnostics, overlap, runtime, and particle statistics jointly. The benchmark characterizes the faithfulness-overlap-latency frontier under a fixed proposal model.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
20 of 30 references.
References · 20
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
- 2021Datasets: A Community Library for Natural Language Processingcited by 526
- 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
- 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 252
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
- 2018Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translationcited by 181
- 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 153
- 2019Semantic Noise Matters for Neural Natural Language Generationcited by 64
- 2019Elements of Sequential Monte Carlocited by 60
- 2024Automata-based constraints for language model decodingcited by 49
- 2024Step-by-Step Reasoning for Math Problems via Twisted Sequential Monte Carlocited by 21
8 more
- 2016Neural Text Generation from Structured Data with Application to the Biography Domaincited by 20
- 2025Constrained Sampling for Language Models Should Be Easy: An MCMC Perspectivecited by 14
- 2026The Hidden Cost of Structured Generation in LLMs: Draft-Conditioned Constrained Decodingcited by 7
- 2026Vectorizing the Trie: Efficient Constrained Decoding for LLM-based Generative Retrieval on Acceleratorscited by 6
- 2026Thinking Before Constraining: A Unified Decoding Framework for Large Language Modelscited by 5
- 2025A*-Decoding: Token-Efficient Inference Scalingcited by 4
- 2026Ensembling Language Models with Sequential Monte Carlocited by 2
- 2025Improving Constrained Language Generation via Self-Distilled Twisted Sequential Monte Carlocited by 1
Built on by
Not cited yet.