mlsanityData to 14 Oct 2026

BARD: Bridging AutoRegressive and Diffusion Vision-Language Models Via Highly Efficient Progressive Block Merging and Stage-Wise Distillation

arXiv 2604.16514 ↗First posted 15 Apr 2026cs.CV cs.LGcited by 2

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Autoregressive vision-language models (VLMs) deliver strong multimodal capability, but their token-by-token decoding imposes a fundamental inference bottleneck. Diffusion VLMs offer a more parallel decoding paradigm, yet directly converting a pretrained autoregressive VLM into a large-block diffusion VLM (dVLM) often leads to substantial quality degradation. In this work, we present BARD, a simple and effective bridging framework that converts a pretrained autoregressive VLM into a same-architecture, decoding-efficient dVLM. Our approach combines progressive supervised block merging, which gradually enlarges the decoding block size, with stage-wise intra-dVLM distillation from a fixed small-block diffusion anchor to recover performance lost at larger blocks. We further incorporate a mixed noise scheduler to improve robustness and token revision during denoising, and memory-friendly training to enable efficient training on long multimodal sequences. A key empirical finding is that direct autoregressive-to-diffusion distillation is poorly aligned and can even hurt performance, whereas distillation within the diffusion regime is consistently effective. Experimental results show that, with ≤ 4.4M data, BARD-VL transfers strong multimodal capability from Qwen3-VL to a large-block dVLM. Remarkably, BARD-VL establishes a new SOTA among comparable-scale open dVLMs on our evaluation suite at both 4B and 8B scales. At the same time, BARD-VL achieves up to 3× decoding throughput speedup compared to the source model. Code is available at https://github.com/fudan-generative-vision/Bard-VL.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 29 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

26 of 29 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models17 Dec
  2. 2025SDAR-VL: Stable and Efficient Block-wise Diffusion for Vision-Language Understanding16 Dec
  3. 2025LaViDa: A Large Diffusion Language Model for Multimodal Understanding22 May

Other references · 23

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  3. 2025Large Language Diffusion Modelscited by 912
  4. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  5. 2025Dream 7B: Diffusion Large Language Modelscited by 544
  6. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
  7. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 274
  8. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
  9. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
  10. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
  11. 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 139
  12. 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
11 more
  1. 2025Generalized Interpolating Discrete Diffusioncited by 70
  2. 2025FineVision: Open Data Is All You Needcited by 53
  3. 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
  4. 2025Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speedcited by 33
  5. 2025MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Modelscited by 32
  6. 2025Encoder-Decoder Diffusion Language Models for Efficient Training and Inferencecited by 24
  7. 2025From Next-Token to Next-Block: A Principled Adaptation Path for Diffusion LLMscited by 24
  8. 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbonecited by 18
  9. 2025From Denoising to Refining: A Corrective Framework for Vision-Language Diffusion Modelcited by 9
  10. 2026T^star: Progressive Block Scaling for Masked Diffusion Language Models Through Trajectory Aware Reinforcement Learningcited by 5
  11. 2025RIV: Recursive Introspection Mask Diffusion Vision Language Modelcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuning
  2. 2026Fast-dVLM: Efficient Block-Diffusion VLM via Direct Conversion from Autoregressive VLM
  3. 2025WeMMU: Enhanced Bridging of Vision-Language Models and Diffusion Models via Noisy Query Tokens
  4. 2026Retrofitting Linear Attention into Diffusion Language Models
  5. 2026Reliability Challenges in Diffusion Vision-Language Models
  6. 2025Vision-Language-Vision Auto-Encoder: Scalable Knowledge Distillation from Diffusion Models
  7. 2025D3ToM: Decider-Guided Dynamic Token Merging for Accelerating Diffusion MLLMs
  8. 2026Don't Retrain, Align: Adapting Autoregressive LMs to Diffusion LMs via Representation Alignment