SJD-PV: Speculative Jacobi Decoding with Phrase Verification for Autoregressive Image Generation
Not on the map. Why?
Abstract (arXiv)
Autoregressive (AR) image models have recently demonstrated remarkable generative capability, but their sequential nature results in significant inference latency. Existing training-free acceleration methods typically verify tokens independently, overlooking the strong co-occurrence patterns between adjacent visual tokens. This independence assumption often leads to contextual inconsistency and limits decoding efficiency. In this work, we introduce a novel training-free acceleration framework that performs phrase-level speculative verification, enabling the model to jointly validate multiple correlated tokens within each decoding window. To construct such phrase units, we analyze token co-occurrence statistics from the training corpus and group frequently co-occurring tokens into semantically coherent visual phrases. During inference, the proposed phrase-level verification evaluates aggregated likelihood ratios over each phrase, allowing simultaneous acceptance of multiple tokens while preserving generation quality. Extensive experiments on autoregressive text-to-image generation show that our method significantly reduces the number of function evaluations (NFE) and achieves up to 30% faster decoding without compromising visual fidelity. Our findings reveal that modeling short-range token co-occurrence provides an effective and general principle for accelerating autoregressive inference.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 25 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
21 of 25 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,653
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2016Conditional Image Generation with PixelCNN Decoderscited by 862
9 more
- 2016Pixel Recurrent Neural Networkscited by 816
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 150
- 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
- 2024Accelerating Auto-regressive Text-to-Image Generation with Training-free Speculative Jacobi Decodingcited by 66
- 2024Parallelized Autoregressive Visual Generationcited by 60
- 2020Accelerating Feedforward Computation via Parallel Nonlinear Equation Solvingcited by 52
- 2024LANTERN: Accelerating Visual Autoregressive Models with Relaxed Speculative Decodingcited by 47
- 2025Grouped Speculative Decoding for Autoregressive Image Generationcited by 17
Built on by
Citing papers per year: 2026: 1.
1 paper.