# Longitudinal NSCLC Treatment Progression via Multimodal Generative Models

arXiv: https://arxiv.org/abs/2603.06147 · HTML: https://mlsanity.com/paper/2603.06147/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 13 of its 27 references that are in the map.
- First posted on arXiv 6 Mar 2026.

## Builds on (most cited first, 13 of 13)

- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applications](https://mlsanity.com/paper/2408.02686/) (2024)
- [TADM: Temporally-Aware Diffusion Model for Neurodegenerative Progression on Brain MRI](https://mlsanity.com/paper/2406.12411/) (2024)
- [RadioPathomics: Multimodal Learning in Non-Small Cell Lung Cancer for Adaptive Radiotherapy](https://mlsanity.com/paper/2204.12423/) (2022)
- [A Review on Generative AI Models for Synthetic Medical Text, Time Series, and Longitudinal Data](https://mlsanity.com/paper/2411.12274/) (2024)
- [A Deep Learning Approach for Overall Survival Prediction in Lung Cancer with Missing Values](https://mlsanity.com/paper/2307.11465/) (2023)
- [Doctor-in-the-Loop: An Explainable, Multi-View Deep Learning Framework for Predicting Pathological Response in Non-Small Cell Lung Cancer](https://mlsanity.com/paper/2502.17503/) (2025)
- [MARIA: a Multimodal Transformer Model for Incomplete Healthcare Data](https://mlsanity.com/paper/2412.14810/) (2024)
- [Whole-Body Image-to-Image Translation for a Virtual Scanner in a Healthcare Digital Twin](https://mlsanity.com/paper/2503.15555/) (2025)
- [Can Foundation Models Really Segment Tumors? A Benchmarking Odyssey in Lung CT Imaging](https://mlsanity.com/paper/2505.01239/) (2025)
- [Context-Gated Cross-Modal Perception with Visual Mamba for PET-CT Lung Tumor Segmentation](https://mlsanity.com/paper/2510.27508/) (2025)
- [Multimodal Doctor-in-the-Loop: A Clinically-Guided Explainable Framework for Predicting Pathological Response in Non-Small Cell Lung Cancer](https://mlsanity.com/paper/2505.01390/) (2025)
- [Beyond a Single Mode: GAN Ensembles for Diverse Medical Data Generation](https://mlsanity.com/paper/2503.24258/) (2025)

## Abstract (arXiv)

Predicting tumor evolution during radiotherapy is a clinically critical challenge, particularly when longitudinal changes are driven by both anatomy and treatment. In this work, we introduce a Virtual Treatment (VT) framework that formulates non-small cell lung cancer (NSCLC) progression as a dose-aware multimodal conditional image-to-image translation problem. Given a CT scan, baseline clinical variables, and a specified radiation dose increment, VT aims to synthesize plausible follow-up CT images reflecting treatment-induced anatomical changes. We evaluate the proposed framework on a longitudinal dataset of 222 stage III NSCLC patients, comprising 895 CT scans acquired during radiotherapy under irregular clinical schedules. The generative process is conditioned on delivered dose increments together with demographic and tumor-related clinical variables. Representative GAN-based and diffusion-based models are benchmarked across 2D and 2.5D configurations. Quantitative and qualitative results indicate that diffusion-based models benefit more consistently from multimodal, dose-aware conditioning and produce more stable and anatomically plausible tumor evolution trajectories than GAN-based baselines, supporting the potential of VT as a tool for in-silico treatment monitoring and adaptive radiotherapy research in NSCLC.