BARD: Bridging AutoRegressive and Diffusion Vision-Language Models Via Highly Efficient Progressive Block Merging and Stage-Wise Distillation
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
Autoregressive vision-language models (VLMs) deliver strong multimodal capability, but their token-by-token decoding imposes a fundamental inference bottleneck. Diffusion VLMs offer a more parallel decoding paradigm, yet directly converting a pretrained autoregressive VLM into a large-block diffusion VLM (dVLM) often leads to substantial quality degradation. In this work, we present BARD, a simple and effective bridging framework that converts a pretrained autoregressive VLM into a same-architecture, decoding-efficient dVLM. Our approach combines progressive supervised block merging, which gradually enlarges the decoding block size, with stage-wise intra-dVLM distillation from a fixed small-block diffusion anchor to recover performance lost at larger blocks. We further incorporate a mixed noise scheduler to improve robustness and token revision during denoising, and memory-friendly training to enable efficient training on long multimodal sequences. A key empirical finding is that direct autoregressive-to-diffusion distillation is poorly aligned and can even hurt performance, whereas distillation within the diffusion regime is consistently effective. Experimental results show that, with ≤ 4.4M data, BARD-VL transfers strong multimodal capability from Qwen3-VL to a large-block dVLM. Remarkably, BARD-VL establishes a new SOTA among comparable-scale open dVLMs on our evaluation suite at both 4B and 8B scales. At the same time, BARD-VL achieves up to 3× decoding throughput speedup compared to the source model. Code is available at https://github.com/fudan-generative-vision/Bard-VL.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 29 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
26 of 29 references.
Closest ancestors · 3
Same direction, newest first
- 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models17 Dec
- 2025SDAR-VL: Stable and Efficient Block-wise Diffusion for Vision-Language Understanding16 Dec
- 2025LaViDa: A Large Diffusion Language Model for Multimodal Understanding22 May
Other references · 23
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025Large Language Diffusion Modelscited by 912
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2025Dream 7B: Diffusion Large Language Modelscited by 544
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 274
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
- 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 139
- 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
11 more
- 2025Generalized Interpolating Discrete Diffusioncited by 70
- 2025FineVision: Open Data Is All You Needcited by 53
- 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
- 2025Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speedcited by 33
- 2025MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Modelscited by 32
- 2025Encoder-Decoder Diffusion Language Models for Efficient Training and Inferencecited by 24
- 2025From Next-Token to Next-Block: A Principled Adaptation Path for Diffusion LLMscited by 24
- 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbonecited by 18
- 2025From Denoising to Refining: A Corrective Framework for Vision-Language Diffusion Modelcited by 9
- 2026T^star: Progressive Block Scaling for Masked Diffusion Language Models Through Trajectory Aware Reinforcement Learningcited by 5
- 2025RIV: Recursive Introspection Mask Diffusion Vision Language Modelcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuning
- 2026Fast-dVLM: Efficient Block-Diffusion VLM via Direct Conversion from Autoregressive VLM
- 2025WeMMU: Enhanced Bridging of Vision-Language Models and Diffusion Models via Noisy Query Tokens
- 2026Retrofitting Linear Attention into Diffusion Language Models
- 2026Reliability Challenges in Diffusion Vision-Language Models
- 2025Vision-Language-Vision Auto-Encoder: Scalable Knowledge Distillation from Diffusion Models
- 2025D3ToM: Decider-Guided Dynamic Token Merging for Accelerating Diffusion MLLMs
- 2026Don't Retrain, Align: Adapting Autoregressive LMs to Diffusion LMs via Representation Alignment