mlsanityData to 7 Oct 2026

Longitudinal NSCLC Treatment Progression via Multimodal Generative Models

arXiv 2603.06147 ↗First posted 6 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Predicting tumor evolution during radiotherapy is a clinically critical challenge, particularly when longitudinal changes are driven by both anatomy and treatment. In this work, we introduce a Virtual Treatment (VT) framework that formulates non-small cell lung cancer (NSCLC) progression as a dose-aware multimodal conditional image-to-image translation problem. Given a CT scan, baseline clinical variables, and a specified radiation dose increment, VT aims to synthesize plausible follow-up CT images reflecting treatment-induced anatomical changes. We evaluate the proposed framework on a longitudinal dataset of 222 stage III NSCLC patients, comprising 895 CT scans acquired during radiotherapy under irregular clinical schedules. The generative process is conditioned on delivered dose increments together with demographic and tumor-related clinical variables. Representative GAN-based and diffusion-based models are benchmarked across 2D and 2.5D configurations. Quantitative and qualitative results indicate that diffusion-based models benefit more consistently from multimodal, dose-aware conditioning and produce more stable and anatomically plausible tumor evolution trajectories than GAN-based baselines, supporting the potential of VT as a tool for in-silico treatment monitoring and adaptive radiotherapy research in NSCLC.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

13 of 27 references.

References · 13

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2024A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applicationscited by 25
  3. 2024TADM: Temporally-Aware Diffusion Model for Neurodegenerative Progression on Brain MRIcited by 18
  4. 2022RadioPathomics: Multimodal Learning in Non-Small Cell Lung Cancer for Adaptive Radiotherapycited by 10
  5. 2024A Review on Generative AI Models for Synthetic Medical Text, Time Series, and Longitudinal Datacited by 10
  6. 2023A Deep Learning Approach for Overall Survival Prediction in Lung Cancer with Missing Valuescited by 9
  7. 2025Doctor-in-the-Loop: An Explainable, Multi-View Deep Learning Framework for Predicting Pathological Response in Non-Small Cell Lung Cancercited by 7
  8. 2024MARIA: a Multimodal Transformer Model for Incomplete Healthcare Datacited by 5
  9. 2025Whole-Body Image-to-Image Translation for a Virtual Scanner in a Healthcare Digital Twincited by 5
  10. 2025Can Foundation Models Really Segment Tumors? A Benchmarking Odyssey in Lung CT Imagingcited by 4
  11. 2025Context-Gated Cross-Modal Perception with Visual Mamba for PET-CT Lung Tumor Segmentationcited by 3
  12. 2025Multimodal Doctor-in-the-Loop: A Clinically-Guided Explainable Framework for Predicting Pathological Response in Non-Small Cell Lung Cancercited by 2
1 more
  1. 2025Beyond a Single Mode: GAN Ensembles for Diverse Medical Data Generationcited by 1

Built on by

Not cited yet.