# Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding

arXiv: https://arxiv.org/abs/2605.29707 · HTML: https://mlsanity.com/paper/2605.29707/

## Key facts

- Cited by 34 papers in the map (data through 14 Oct 2026).
- Placed in Speculative decoding, one of 12 directions in Efficient LLM inference and serving.
- Builds on 20 of its 24 references that are in the map.
- First posted on arXiv 28 May 2026.

## Placed in

- Efficient LLM inference and serving / [Speculative decoding](https://mlsanity.com/inference/speculative-decoding/)

## Builds on (most cited first, 20 of 20)

- [Training Verifiers to Solve Math Word Problems](https://mlsanity.com/paper/2110.14168/) (2021)
- [Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena](https://mlsanity.com/paper/2306.05685/) (2023)
- [Evaluating Large Language Models Trained on Code](https://mlsanity.com/paper/2107.03374/) (2021)
- [Measuring Mathematical Problem Solving With the MATH Dataset](https://mlsanity.com/paper/2103.03874/) (2021)
- [Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation](https://mlsanity.com/paper/1406.1078/) (2014)
- [Program Synthesis with Large Language Models](https://mlsanity.com/paper/2108.07732/) (2021)
- [LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code](https://mlsanity.com/paper/2403.07974/) (2024)
- [Fast Inference from Transformers via Speculative Decoding](https://mlsanity.com/paper/2211.17192/) (2022)
- [Accelerating Large Language Model Decoding with Speculative Sampling](https://mlsanity.com/paper/2302.01318/) (2023)
- [Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads](https://mlsanity.com/paper/2401.10774/) (2024)
- [EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty](https://mlsanity.com/paper/2401.15077/) (2024)
- [EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees](https://mlsanity.com/paper/2406.16858/) (2024)
- [EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test](https://mlsanity.com/paper/2503.01840/) (2025)
- [DFlash: Block Diffusion for Flash Speculative Decoding](https://mlsanity.com/paper/2602.06036/) (2026)
- [How (not) to Train your Generative Model: Scheduled Sampling, Likelihood, Adversary?](https://mlsanity.com/paper/1511.05101/) (2015)
- [Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion](https://mlsanity.com/paper/2408.05636/) (2024)
- [DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding](https://mlsanity.com/paper/2510.02358/) (2025)
- [PARD: Accelerating LLM Inference with Low-Cost PARallel Draft Model Adaptation](https://mlsanity.com/paper/2504.18583/) (2025)
- [DART: Diffusion-Inspired Speculative Decoding for Fast LLM Inference](https://mlsanity.com/paper/2601.19278/) (2026)
- [Speculative Decoding with a Speculative Vocabulary](https://mlsanity.com/paper/2602.13836/) (2026)

## Built on by (most cited first, 30 of 34)

- [JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting](https://mlsanity.com/paper/2606.18394/) (2026)
- [xPress: Parallel Refinement for Diffusion Drafters in Speculative Decoding](https://mlsanity.com/paper/2608.02438/) (2026)
- [DARTree: Speculative Diffusion Decoding with Autoregressive Draft Trees](https://mlsanity.com/paper/2608.13524/) (2026)
- [D-cut: Adaptive Verification Depth Pruning for Batched Speculative Decoding](https://mlsanity.com/paper/2607.14647/) (2026)
- [DeLS-Spec: Decoupled Long-Short Contexts for Parallel Speculative Drafting](https://mlsanity.com/paper/2607.07409/) (2026)
- [AngelSpec: Towards Real-World High Performance Inference with Speculative Decoding](https://mlsanity.com/paper/2607.25852/) (2026)
- [LiLiCorr: Lightweight Likelihood Correlation of Parallel Drafts for Speculative Decoding](https://mlsanity.com/paper/2608.20530/) (2026)
- [Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters](https://mlsanity.com/paper/2607.01893/) (2026)
- [Online Draft Co-Training for Speculative Decoding in Large-Scale, Long-Context RL Post-Training](https://mlsanity.com/paper/2609.07108/) (2026)
- [DominoTree: Conditional Tree-Structured Drafting with Domino for Speculative Decoding](https://mlsanity.com/paper/2607.08642/) (2026)
- [ReTrace: Rejected-Trajectory Conditioning for Speculative Decoding](https://mlsanity.com/paper/2608.29748/) (2026)
- [DFlow: Enabling Verifier Information Flow in Block Diffusion Speculative Decoding](https://mlsanity.com/paper/2609.06498/) (2026)
- [When Parallel Drafter Meets Parallel Speculative Decoding](https://mlsanity.com/paper/2609.27396/) (2026)
- [CURE: Local Uncertainty Repair for Block-Parallel Speculative Decoding](https://mlsanity.com/paper/2608.00531/) (2026)
- [Beyond Parallel Blindness: Information Floors and Model Gaps in Block Drafting](https://mlsanity.com/paper/2608.27339/) (2026)
- [Carryover Drafting: Recycling Rejected States for Speculative Decoding](https://mlsanity.com/paper/2609.14717/) (2026)
- [TreeSpark: Calibrated, Load-Adaptive Draft Trees for Semi-Autoregressive Speculative Decoding](https://mlsanity.com/paper/2609.22098/) (2026)
- [H-Spec: Parallel Speculative Decoding Without a Drafter-Side KV Cache](https://mlsanity.com/paper/2609.24197/) (2026)
- [Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding](https://mlsanity.com/paper/2609.36173/) (2026)
- [Fully Rotation-Equivariant Spectral-Spatial Learning for Multispectral Object Detection](https://mlsanity.com/paper/2607.05148/) (2026)
- [Ceiling-Clipped Acceptance Histograms Indicate Stranded Speed-up in Block-Diffusion Speculative Decoding](https://mlsanity.com/paper/2608.30427/) (2026)
- [From Position Risks to Block Survival: Faster Generation for Diffusion Language Models](https://mlsanity.com/paper/2609.33390/) (2026)
- [Tsubame: Tree Replay for Diffusion-Based Speculative Decoding](https://mlsanity.com/paper/2609.33652/) (2026)
- [Reciprocal Guidance: Orchestrating Draft and Verify Budgets for Advancing the Diffusion-AR Self-Speculation Frontier](https://mlsanity.com/paper/2609.34388/) (2026)
- [LongSpark: Efficient speculative decoding with a fixed-cost parallel drafter](https://mlsanity.com/paper/2609.37029/) (2026)
- [DScale: Scaling Block-Diffusion Speculative Decoding with Adaptive Verification](https://mlsanity.com/paper/2609.37532/) (2026)
- [DEdit: Iterative Draft Editing for Speculative Decoding](https://mlsanity.com/paper/2609.38510/) (2026)
- [UBTree: Parallel Tree Drafting via Unigram and Bigram Models for Speculative Decoding](https://mlsanity.com/paper/2609.39972/) (2026)
- [DRelay: Global Draft Context for Prefix-Aware Parallel Speculative Decoding Repair](https://mlsanity.com/paper/2610.01439/) (2026)
- [D-Loop: Looped Diffusion Drafting for Speculative Decoding](https://mlsanity.com/paper/2610.06011/) (2026)

## Abstract (arXiv)

Speculative decoding accelerates LLM inference by drafting multiple tokens and verifying them in parallel with the target model. However, its practical speedup is constrained by the trade-off between draft quality and drafting cost: autoregressive drafters model causal dependencies among draft tokens but incur sequential overhead, while parallel drafters reduce drafting cost but weaken intra-block dependency modeling. In this paper, we propose Domino, a speculative decoding framework that decouples causal dependency modeling from expensive autoregressive draft execution. Domino first uses a parallel draft backbone to produce preliminary draft distributions for the entire block, and then applies a lightweight Domino head to refine them with prefix-dependent causal information. To stabilize teacher-forced causal encoding, we further introduce a base-anchored training curriculum that first strengthens the parallel backbone and then gradually shifts optimization toward the causally corrected final distribution. Experiments on Qwen3 models show that Domino achieves up to (5.49×) end-to-end speedup under the Transformers backend and up to (5.8×) throughput speedup under SGLang serving.