mlsanityData to 14 Oct 2026

Parallel Decoder Transformer: Planner-Conditioned Latent Coordination for Model-Intrinsic Parallel Generation

arXiv 2512.10054 ↗First posted 10 Dec 2025cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Autoregressive language models expose one causal token frontier, even when the requested document contains sections that could be developed concurrently. Existing parallel-generation systems arrange external branches around an otherwise unchanged model. We instead formulate model-intrinsic parallel generation: a single trained architecture owns multiple causal frontiers and produces one next-token distribution for each frontier in every synchronized decoding round. The Parallel Decoder Transformer (PDT) retains a frozen shared lower knowledge trunk and replaces the upper trunk with three independently parameterized physical decoder stacks. A prompt-time set planner produces three unordered continuous outlines, each hard-routed to one decoder as persistent Plan-KV memory, while a finite product-quantized notes bus carries block-delayed latent messages among the decoders. Autoregression is preserved within each lane; same-round lane tokens are conditionally independent given the source, plans, private histories, and previously committed messages. We specify source-grounded supervision for long-form historical exposition with single-owner cited facts and token-aligned cross-lane dependencies, a composite objective, a staged curriculum, and preregistered causal evaluations: plan swap and removal, delayed-message ablation, a parameter-matched self-only control, dependency-token likelihood, and blinded human fact audits. The architecture and evaluation pipeline are implemented; scientific training and held-out evaluation are in progress. This paper presents the theory, design, and falsifiable protocol, not a positive empirical result.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 19 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

13 of 19 references.

References · 13

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,653
  4. 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 843
  5. 2016Sequence-Level Knowledge Distillationcited by 801
  6. 2024EAGLE: Speculative Sampling Requires Rethinking Feature Uncertaintycited by 578
  7. 2017Non-Autoregressive Neural Machine Translationcited by 463
  8. 2024Better & Faster Large Language Models via Multi-token Predictioncited by 360
  9. 2023Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generationcited by 105
  10. 2025Hogwild! Inference: Parallel LLM Generation via Concurrent Attentioncited by 32
  11. 2025Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decodingcited by 28
  12. 2024APAR: LLMs Can Do Auto-Parallel Auto-Regressive Decodingcited by 24
1 more
  1. 2025Group Think: Multiple Concurrent Reasoning Agents Collaborating at Token Level Granularitycited by 22

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Why Diffusion Language Models Struggle with Truly Parallel (Non-Autoregressive) Decoding?
  2. 2026Component-Aware Self-Speculative Decoding in Hybrid Language Models
  3. 2026Unlocking Parallelism in Autoregressive Language Models via Speculative Decoding with Progressive Tree Drafting
  4. 2026Mean-Field Parallel Decoding for Discrete Diffusion Language Models
  5. 2026Orthrus: Memory-Efficient Parallel Token Generation via Dual-View Diffusion
  6. 2026LongSpark: Efficient speculative decoding with a fixed-cost parallel drafter
  7. 2025Fast Inference via Hierarchical Speculative Decoding
  8. 2026Plan, Verify and Fill: A Structured Parallel Decoding Approach for Diffusion Language Models