mlsanityData to 7 Oct 2026

UniX: Unifying Autoregression and Diffusion for Chest X-Ray Understanding and Generation

arXiv 2601.11522 ↗First posted 16 Jan 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Despite recent progress, medical foundation models still struggle to unify visual understanding and generation, as these tasks have inherently conflicting goals: semantic abstraction versus pixel-level reconstruction. Existing approaches, typically based on parameter-shared autoregressive architectures, frequently lead to compromised performance in one or both tasks. To address this, we present UniX, a next-generation unified medical foundation model for chest X-ray understanding and generation. UniX decouples the two tasks into an autoregressive branch for understanding and a diffusion branch for high-fidelity generation. Crucially, a cross-modal self-attention mechanism is introduced to dynamically guide the generation process with understanding features. Coupled with a rigorous data cleaning pipeline and a multi-stage training strategy, this architecture enables synergistic collaboration between tasks while leveraging the strengths of diffusion models for superior generation. On two representative benchmarks, UniX achieves a 46.1% improvement in understanding performance (Micro-F1) and a 24.2% gain in generation quality (FD-RadDino), using only a quarter of the parameters of LLM-CXR. By achieving performance on par with task-specific models, our work establishes a scalable paradigm for synergistic medical image understanding and generation. Codes and models are available at https://github.com/ZrH42/UniX.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

37 of 48 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  7. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  8. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  9. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  10. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  12. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
25 more
  1. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  2. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  3. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  4. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
  5. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
  6. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  7. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
  8. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
  9. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
  10. 2023Towards Generalist Biomedical AIcited by 286
  11. 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptationcited by 112
  12. 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
  13. 2024FasterDiT: Towards Faster Diffusion Transformers Training without Architecture Modificationcited by 64
  14. 2024Liquid: Language Models are Scalable and Unified Multi-modal Generatorscited by 62
  15. 2023LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generationcited by 57
  16. 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 47
  17. 2024SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Foldingcited by 42
  18. 2023RadEdit: stress-testing biomedical vision models via diffusion image editingcited by 28
  19. 2024EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learningcited by 22
  20. 2025Turbo-VAED: Fast and Stable Transfer of Video-VAEs to Mobile Devicescited by 15
  21. 2025CheXGenBench: A Unified Benchmark For Fidelity, Privacy and Utility of Synthetic Chest Radiographscited by 5
  22. 2024MoSt-DSA: Modeling Motion and Structural Interactions for Direct Multi-Frame Interpolation in DSA Imagescited by 4
  23. 2024LKCell: Efficient Cell Nuclei Instance Segmentation with Large Convolution Kernelscited by 3
  24. 2024GaraMoSt: Parallel Multi-Granularity Motion and Structural Modeling for Efficient Multi-Frame Interpolation in DSA Imagescited by 3
  25. 2025A DeepSeek-Powered AI System for Automated Chest Radiograph Interpretation in Clinical Practicecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025VICCA: Visual Interpretation and Comprehension of Chest X-ray Anomalies in Generated Report Without Human Feedback
  2. 2025A Generative Foundation Model for Chest Radiography
  3. 2024XReal: Realistic Anatomy and Pathology-Aware X-ray Generation via Controllable Diffusion Model
  4. 2026ECHO: Efficient Chest X-ray Report Generation with One-step Block Diffusion
  5. 2026CheXTemporal: A Dataset for Temporally-Grounded Reasoning in Chest Radiography
  6. 2025Any-to-Any Vision-Language Model for Multimodal X-ray Imaging and Radiological Report Generation
  7. 2026A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation
  8. 2026MC-CXR: A Multi-Context Chest X-ray Benchmark for Context-Induced Disruption in Vision-Language Models