Prism: Efficient Test-Time Scaling via Hierarchical Search and Self-Verification for Discrete Diffusion Language Models
On the map: LLM reasoning → Diffusion reasoning and test-time scaling
also in 1 more
Abstract (arXiv)
Inference-time compute has re-emerged as a practical way to improve LLM reasoning. Most test-time scaling (TTS) algorithms rely on autoregressive decoding, which is ill-suited to discrete diffusion language models (dLLMs) due to their parallel decoding over the entire sequence. As a result, developing effective and efficient TTS methods to unlock dLLMs' full generative potential remains an underexplored challenge. To address this, we propose Prism (Pruning, Remasking, and Integrated Self-verification Method), an efficient TTS framework for dLLMs that (i) performs Hierarchical Trajectory Search (HTS) which dynamically prunes and reallocates compute in an early-to-mid denoising window, (ii) introduces Local branching with partial remasking to explore diverse implementations while preserving high-confidence tokens, and (iii) replaces external verifiers with Self-Verified Feedback (SVF) obtained via self-evaluation prompts on intermediate completions. Across four mathematical reasoning and code generation benchmarks on three dLLMs, including LLaDA 8B Instruct, Dream 7B Instruct, and LLaDA 2.0-mini, our Prism achieves a favorable performance-efficiency trade-off, matching best-of-N performance with substantially fewer function evaluations (NFE). The code is released at https://github.com/viiika/Prism.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 44 of its 47 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
44 of 47 references.
Closest ancestors · 4
Same direction, newest first
- 2025Test-Time Scaling in Diffusion LLMs via Hidden Semi-Autoregressive Experts6 Oct
- 2025RFG: Test-Time Scaling for Diffusion Large Language Model Reasoning with Reward-Free Guidance29 Sep
- 2025Mercury: Ultra-Fast Language Models Based on Diffusion17 Jun
- 2025Remasking Discrete Diffusion Models with Inference-Time Scaling1 Mar
Other references · 40
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2024GPT-4o System Cardcited by 4,467
- 2023Let's Verify Step by Stepcited by 3,598
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Qwen Technical Reportcited by 3,273
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
28 more
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2024Qwen2 Technical Reportcited by 2,076
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2025s1: Simple test-time scalingcited by 1,311
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2025Large Language Diffusion Modelscited by 872
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 712
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
- 2025Dream 7B: Diffusion Large Language Modelscited by 515
- 2022A Continuous Time Framework for Discrete Denoising Modelscited by 437
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 404
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 371
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 173
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 154
- 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 148
- 2025The Diffusion Dualitycited by 124
- 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 83
- 2023Rewarding Chatbots for Real-World Engagement with Millions of Userscited by 58
- 2025Evolving Deeper LLM Thinkingcited by 58
- 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Modelcited by 52
- 2025GenMol: A Drug Discovery Generalist with Discrete Diffusioncited by 47
- 2025Diffusion Language Model Inference with Monte Carlo Tree Searchcited by 3
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughtscited by 3
- 2026S3: Stratified Scaling Search for Test-Time in Diffusion Language Modelscited by 2
- 2026DPRM: A Plug-in Doob h transform-induced Token-Ordering Module for Discrete Diffusion Modelscited by 1
- 2026CaRE Compute-aware Remasking Evaluation Protocol for Masked Diffusion Language Modelscited by 1
- 2026FluxLite: Inference-Time Proposal Control for Discrete Diffusion Modelscited by 1
- 2026Escaping Confidence Trap: Evolutionary Decoding for Mathematical Reasoning in Diffusion LLMscited by 0
- 2026LOCKR: A Hidden-State Trajectory-Guided Planner for Detecting and Repairing Stable-but-Wrong Lock-In in Diffusion Language Modelscited by 0
- 2026FluxLite: Inference-Time Proposal Control for Discrete Diffusion Models28 Sep 2026
- 2026LOCKR: A Hidden-State Trajectory-Guided Planner for Detecting and Repairing Stable-but-Wrong Lock-In in Diffusion Language Models23 Sep 2026
- 2026Escaping Confidence Trap: Evolutionary Decoding for Mathematical Reasoning in Diffusion LLMs1 Aug 2026
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts30 Jun 2026
- 2026CaRE Compute-aware Remasking Evaluation Protocol for Masked Diffusion Language Models4 Jun 2026
- 2026DPRM: A Plug-in Doob h transform-induced Token-Ordering Module for Discrete Diffusion Models27 Apr 2026
- 2026S3: Stratified Scaling Search for Test-Time in Diffusion Language Models7 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026CAI-DLLM: Convergence Aware Inference for Diffusion Language Models
- 2026Temporal Self-Distillation: Faster Inference in Discrete Diffusion Language Models
- 2026UnMaskFork: Test-Time Scaling for Masked Diffusion via Deterministic Action Branching
- 2026Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques
- 2026Self-Distilled Trajectory-Aware Boltzmann Modeling: Bridging the Training-Inference Discrepancy in Diffusion Language Models
- 2025Inference-Time Scaling of Diffusion Language Models via Trajectory Refinement
- 2026Prefix-Denoising Consistency: Test-Time Verification for Diffusion Language Models
- 2026CD4LM: Consistency Distillation and aDaptive Decoding for Diffusion Language Models