mlsanityData to 14 Oct 2026

dMLLM-TTS: Self-Verified and Efficient Test-Time Scaling for Diffusion Multi-Modal Large Language Models

arXiv 2512.19433 ↗First posted 22 Dec 2025cs.CVcited by 2

On the map: LLM reasoning → Diffusion reasoning and test-time scaling

also in 1 more
Abstract (arXiv)

Diffusion Multi-modal Large Language Models (dMLLMs) have recently emerged as a novel architecture unifying image generation and understanding. However, developing effective and efficient Test-Time Scaling (TTS) methods to unlock their full generative potential remains an underexplored challenge. To address this, we propose dMLLM-TTS, a novel framework operating on two complementary scaling axes: (1) trajectory exploration scaling to enhance the diversity of generated hypotheses, and (2) iterative refinement scaling for stable generation. Conventional TTS approaches typically perform linear search across these two dimensions, incurring substantial computational costs of O(NT) and requiring an external verifier for best-of-N selection. To overcome these limitations, we propose two innovations. First, we design an efficient hierarchical search algorithm with O(N+T) complexity that adaptively expands and prunes sampling trajectories. Second, we introduce a self-verified feedback mechanism that leverages the dMLLMs' intrinsic image understanding capabilities to assess text-image alignment, eliminating the need for external verifier. Extensive experiments on the GenEval benchmark across three representative dMLLMs (e.g., Lumina-DiMOO, MMaDA, Muddit) show that our framework substantially improves generation quality while achieving up to 6x greater efficiency than linear search. Project page: https://github.com/Alpha-VLLM/Lumina-DiMOO.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 36 of its 40 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

36 of 40 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025TTS-VAR: A Test-Time Scaling Framework for Visual Auto-Regressive Generation24 Jul
  2. 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflection15 Mar
  3. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer30 Jan
  4. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps16 Jan
  5. 2025A General Framework for Inference-time Scaling and Steering of Diffusion Models12 Jan

Other references · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  7. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  8. 2025Qwen-Image Technical Reportcited by 1,044
  9. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  10. 2025Large Language Diffusion Modelscited by 912
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  12. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
19 more
  1. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  2. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  3. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  4. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
  5. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
  6. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
  7. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 274
  8. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
  9. 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 150
  10. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
  11. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 132
  12. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 96
  13. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 88
  14. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 56
  15. 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Modelcited by 55
  16. 2024Towards Understanding the Working Mechanism of Text-to-Image Diffusion Modelcited by 48
  17. 2025Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modelingcited by 37
  18. 2024aMUSEd: An Open MUSE Reproductioncited by 32
  19. 2025Resurrect Mask AutoRegressive Modeling for Efficient and Scalable Image Generationcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Discrete Diffusion in Large Language and Multimodal Models: A Survey
  2. 2026Diffusion-CAM: Faithful Visual Explanations for dMLLMs
  3. 2026Prism: Efficient Test-Time Scaling via Hierarchical Search and Self-Verification for Discrete Diffusion Language Models
  4. 2025Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesis
  5. 2025A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Models
  6. 2026Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models
  7. 2025DPad: Efficient Diffusion Language Models with Suffix Dropout
  8. 2026Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques