UniX: Unifying Autoregression and Diffusion for Chest X-Ray Understanding and Generation
Not on the map. Why?
Abstract (arXiv)
Despite recent progress, medical foundation models still struggle to unify visual understanding and generation, as these tasks have inherently conflicting goals: semantic abstraction versus pixel-level reconstruction. Existing approaches, typically based on parameter-shared autoregressive architectures, frequently lead to compromised performance in one or both tasks. To address this, we present UniX, a next-generation unified medical foundation model for chest X-ray understanding and generation. UniX decouples the two tasks into an autoregressive branch for understanding and a diffusion branch for high-fidelity generation. Crucially, a cross-modal self-attention mechanism is introduced to dynamically guide the generation process with understanding features. Coupled with a rigorous data cleaning pipeline and a multi-stage training strategy, this architecture enables synergistic collaboration between tasks while leveraging the strengths of diffusion models for superior generation. On two representative benchmarks, UniX achieves a 46.1% improvement in understanding performance (Micro-F1) and a 24.2% gain in generation quality (FD-RadDino), using only a quarter of the parameters of LLM-CXR. By achieving performance on par with task-specific models, our work establishes a scalable paradigm for synergistic medical image understanding and generation. Codes and models are available at https://github.com/ZrH42/UniX.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
37 of 48 references.
References · 37
- 2017Attention Is All You Needcited by 59,932
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Neural Discrete Representation Learningcited by 4,650
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
25 more
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
- 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2023Towards Generalist Biomedical AIcited by 286
- 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptationcited by 112
- 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
- 2024FasterDiT: Towards Faster Diffusion Transformers Training without Architecture Modificationcited by 64
- 2024Liquid: Language Models are Scalable and Unified Multi-modal Generatorscited by 62
- 2023LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generationcited by 57
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 47
- 2024SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Foldingcited by 42
- 2023RadEdit: stress-testing biomedical vision models via diffusion image editingcited by 28
- 2024EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learningcited by 22
- 2025Turbo-VAED: Fast and Stable Transfer of Video-VAEs to Mobile Devicescited by 15
- 2025CheXGenBench: A Unified Benchmark For Fidelity, Privacy and Utility of Synthetic Chest Radiographscited by 5
- 2024MoSt-DSA: Modeling Motion and Structural Interactions for Direct Multi-Frame Interpolation in DSA Imagescited by 4
- 2024LKCell: Efficient Cell Nuclei Instance Segmentation with Large Convolution Kernelscited by 3
- 2024GaraMoSt: Parallel Multi-Granularity Motion and Structural Modeling for Efficient Multi-Frame Interpolation in DSA Imagescited by 3
- 2025A DeepSeek-Powered AI System for Automated Chest Radiograph Interpretation in Clinical Practicecited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025VICCA: Visual Interpretation and Comprehension of Chest X-ray Anomalies in Generated Report Without Human Feedback
- 2025A Generative Foundation Model for Chest Radiography
- 2024XReal: Realistic Anatomy and Pathology-Aware X-ray Generation via Controllable Diffusion Model
- 2026ECHO: Efficient Chest X-ray Report Generation with One-step Block Diffusion
- 2026CheXTemporal: A Dataset for Temporally-Grounded Reasoning in Chest Radiography
- 2025Any-to-Any Vision-Language Model for Multimodal X-ray Imaging and Radiological Report Generation
- 2026A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation
- 2026MC-CXR: A Multi-Context Chest X-ray Benchmark for Context-Induced Disruption in Vision-Language Models