ECHO: Efficient Chest X-ray Report Generation with One-step Block Diffusion
Not on the map. Why?
Abstract (arXiv)
Chest X-ray report generation (CXR-RG) has the potential to substantially alleviate radiologists' workload. However, conventional autoregressive vision--language models (VLMs) suffer from high inference latency due to sequential token decoding. Diffusion-based models offer a promising alternative through parallel generation, but they still require multiple denoising iterations. Compressing multi-step denoising to a single step could further reduce latency, but often degrades textual coherence due to the mean-field bias introduced by token-factorized denoisers. To address this challenge, we propose ECHO, an efficient diffusion-based VLM (dVLM) for chest X-ray report generation. ECHO enables stable one-step-per-block inference via a novel Direct Conditional Distillation (DCD) framework, which mitigates the mean-field limitation by constructing unfactorized supervision from on-policy diffusion trajectories to encode joint token dependencies. In addition, we introduce a Response-Asymmetric Diffusion (RAD) training strategy that further improves training efficiency while maintaining model effectiveness. Extensive experiments demonstrate that ECHO surpasses state-of-the-art autoregressive methods, improving RaTE and SemScore by 64.33% and 60.58% respectively, while achieving up to 8× inference speedup with negligible degradation in clinical accuracy.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 53 of its 62 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
53 of 62 references.
References · 53
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Visual Instruction Tuningcited by 7,792
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2025Large Language Diffusion Modelscited by 872
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
38 more
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
- 2025Dream 7B: Diffusion Large Language Modelscited by 515
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 404
- 2025MedGemma Technical Reportcited by 398
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 385
- 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
- 2023Towards Generalist Biomedical AIcited by 286
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
- 2024Capabilities of Gemini Models in Medicinecited by 231
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 217
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2022SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Controlcited by 191
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 172
- 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 168
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 154
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
- 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 128
- 2025Diffusion LLMs Can Do Faster-Than-AR Inference via Discrete Diffusion Forcingcited by 111
- 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decodingcited by 101
- 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 96
- 2024Energy-Based Diffusion Language Models for Text Generationcited by 86
- 2025LaViDa: A Large Diffusion Language Model for Multimodal Understandingcited by 81
- 2024A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretationcited by 79
- 2025FlashDLM: Accelerating Diffusion Language Model Inference via Efficient KV Caching and Guided Diffusioncited by 77
- 2024Beyond Autoregression: Fast LLMs via Self-Distillation Through Timecited by 73
- 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
- 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Modelscited by 61
- 2025dParallel: Learnable Parallel Decoding for dLLMscited by 59
- 2024Speculative Diffusion Decoding: Accelerating Language Generation through Diffusioncited by 57
- 2025DiffuSpec: Unlocking Diffusion Language Models for Speculative Decodingcited by 40
- 2023CXR-LLAVA: a multimodal large language model for interpreting chest X-ray imagescited by 37
- 2026d3LLM: Ultra-Fast Diffusion LLM using Pseudo-Trajectory Distillationcited by 34
- 2025ReXGradient-160K: A Large-Scale Publicly Available Dataset of Chest Radiographs with Free-text Reportscited by 24
- 2025Unifying Autoregressive and Diffusion-Based Sequence Generationcited by 17
- 2025ReDi: Rectified Discrete Flowcited by 13
- 2025LLaDA-MedV: Exploring Large Language Diffusion Models for Biomedical Image Understandingcited by 12
- 2025SDAR-VL: Stable and Efficient Block-wise Diffusion for Vision-Language Understandingcited by 12
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026AnchorDiff: Topology-Aware Masked Diffusion with Confidence-based Rewriting for Radiology Report Generationcited by 2
- 2026Discrete Diffusion Language Models for Interactive Radiology Report Draftingcited by 1
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioningcited by 1
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning2 Jul 2026
- 2026Discrete Diffusion Language Models for Interactive Radiology Report Drafting1 Jul 2026
- 2026AnchorDiff: Topology-Aware Masked Diffusion with Confidence-based Rewriting for Radiology Report Generation16 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024Chest-Diffusion: A Light-Weight Text-to-Image Model for Report-to-CXR Generation
- 2024Diff-CXR: Report-to-CXR generation through a disease-knowledge enhanced diffusion model
- 2024Advancing Text-Driven Chest X-Ray Generation with Policy-Based Reinforcement Learning
- 2026UniX: Unifying Autoregression and Diffusion for Chest X-Ray Understanding and Generation
- 2023Cascaded Latent Diffusion Models for High-Resolution Chest X-ray Synthesis
- 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generation
- 2025Anatomy-Grounded Weakly Supervised Prompt Tuning for Chest X-ray Latent Diffusion Models
- 2026DRRG: A Discrete Diffusion Framework for Radiology Report Generation