Data-Efficient Unsupervised Interpolation Without Any Intermediate Frame for 4D Medical Images
Not on the map. Why?
Abstract (arXiv)
4D medical images, which represent 3D images with temporal information, are crucial in clinical practice for capturing dynamic changes and monitoring long-term disease progression. However, acquiring 4D medical images poses challenges due to factors such as radiation exposure and imaging duration, necessitating a balance between achieving high temporal resolution and minimizing adverse effects. Given these circumstances, not only is data acquisition challenging, but increasing the frame rate for each dataset also proves difficult. To address this challenge, this paper proposes a simple yet effective Unsupervised Volumetric Interpolation framework, UVI-Net. This framework facilitates temporal interpolation without the need for any intermediate frames, distinguishing it from the majority of other existing unsupervised methods. Experiments on benchmark datasets demonstrate significant improvements across diverse evaluation metrics compared to unsupervised and supervised baselines. Remarkably, our approach achieves this superior performance even when trained with a dataset as small as one, highlighting its exceptional robustness and efficiency in scenarios with sparse supervision. This positions UVI-Net as a compelling alternative for 4D medical imaging, particularly in settings where data availability is limited. The source code is available at https://github.com/jungeun122333/UVI-Net.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 38 of its 78 references that are in the map. First posted on arXiv 1 Apr 2024.
Builds on
38 of 78 references.
References · 38
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2017Video Enhancement with Task-Oriented Flowcited by 612
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
- 2020Softmax Splatting for Video Frame Interpolationcited by 276
- 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
26 more
- 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
- 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2021XVFI: eXtreme Video Frame Interpolationcited by 123
- 2017Quicksilver: Fast Predictive Image Registration - a Deep Learning Approachcited by 113
- 2019Recursive Cascaded Networks for Unsupervised Medical Image Registrationcited by 105
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 97
- 2016Medical Image Synthesis with Context-Aware Generative Adversarial Networkscited by 91
- 2020CycleMorph: Cycle Consistent Unsupervised Deformable Image Registrationcited by 78
- 2021Deep Animation Video Interpolation in the Wildcited by 65
- 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
- 2018PhaseNet for Video Frame Interpolationcited by 61
- 2021DiffuseMorph: Unsupervised Deformable Image Registration Using Diffusion Modelcited by 57
- 2019Unsupervised Video Interpolation Using Cycle Consistencycited by 44
- 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
- 2022TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolationcited by 37
- 2018Unpaired Brain MR-to-CT Synthesis using a Structure-Constrained CycleGANcited by 31
- 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
- 2022Exploring Motion Ambiguity and Alignment for High-Quality Video Frame Interpolationcited by 17
- 2018Devon: Deformable Volume Network for Learning Optical Flowcited by 16
- 2018Deep Learning based Inter-Modality Image Registration Supervised by Intra-Modality Similaritycited by 16
- 2020A Spatiotemporal Volumetric Interpolation Network for 4D Dynamic Medical Imagecited by 16
- 2021Unsupervised Landmark Detection Based Spatiotemporal Motion Estimation for 4D Dynamic Medical Imagescited by 9
- 2021Enhanced Correlation Matching based Video Frame Interpolationcited by 7
- 2023Fourier-Net+: Leveraging Band-Limited Representation for Efficient 3D Medical Image Registrationcited by 4
Built on by
Citing papers per year: 2024: 4; 2025: 5; 2026: 6.
15 papers.
Sort:
By area:
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
- 2025FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imagingcited by 5
- 2026MRI Contrast Enhancement Kinetics World Modelcited by 4
- 2024CPT-Interp: Continuous sPatial and Temporal Motion Modeling for 4D Medical Image Interpolationcited by 3
- 2025Temporal Differential Fields for 4D Motion Modeling via Image-to-Video Synthesiscited by 3
- 2024Temporal and Spatial Super Resolution with Latent Diffusion Model in Medical MRI imagescited by 1
- 2025A Diffusion-Driven Temporal Super-Resolution and Spatial Consistency Enhancement Framework for 4D MRI imagingcited by 1
- 20264DLoG: Generative Modeling of Neurodegenerative Brain Anatomy with 4D Longitudinal Diffusion Modelcited by 1
- 2024Continuous sPatial-Temporal Deformable Image Registration (CPT-DIR) for motion modelling in radiotherapy: beyond classic voxel-based methodscited by 0
- 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domaincited by 0
- 2025Test Time Training for 4D Medical Image Interpolationcited by 0
- 2026Deep Slice Interpolation for Reducing Through-Plane Anisotropy and Noise in Head CTcited by 0
- 2026Phase-Aligned Finite-Fourier Periodic Deformation for 4D Medical Image Interpolation25 Aug 2026
- 2026Low-Rank Velocity Fields as a Structural Prior for Unsupervised 4D Medical Image Interpolation25 Aug 2026
- 2026Towards Voxel Spacing Consistency for Medical Image Segmentation30 Jun 2026
- 2026Deep Slice Interpolation for Reducing Through-Plane Anisotropy and Noise in Head CT8 Jun 2026
- 20264DLoG: Generative Modeling of Neurodegenerative Brain Anatomy with 4D Longitudinal Diffusion Model24 Apr 2026
- 2026MRI Contrast Enhancement Kinetics World Model22 Feb 2026
- 2025FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imaging6 Jul 2025
- 2025A Diffusion-Driven Temporal Super-Resolution and Spatial Consistency Enhancement Framework for 4D MRI imaging4 Jun 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025Temporal Differential Fields for 4D Motion Modeling via Image-to-Video Synthesis22 May 2025
- 2025Test Time Training for 4D Medical Image Interpolation4 Feb 2025
- 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domain25 Nov 2024
3 more
- 2024Temporal and Spatial Super Resolution with Latent Diffusion Model in Medical MRI images29 Oct 2024
- 2024CPT-Interp: Continuous sPatial and Temporal Motion Modeling for 4D Medical Image Interpolation24 May 2024
- 2024Continuous sPatial-Temporal Deformable Image Registration (CPT-DIR) for motion modelling in radiotherapy: beyond classic voxel-based methods1 May 2024
- 2025FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imagingcited by 5
- 2024Temporal and Spatial Super Resolution with Latent Diffusion Model in Medical MRI imagescited by 1
- 20264DLoG: Generative Modeling of Neurodegenerative Brain Anatomy with 4D Longitudinal Diffusion Modelcited by 1
- 20264DLoG: Generative Modeling of Neurodegenerative Brain Anatomy with 4D Longitudinal Diffusion Model24 Apr 2026
- 2025FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imaging6 Jul 2025
- 2024Temporal and Spatial Super Resolution with Latent Diffusion Model in Medical MRI images29 Oct 2024
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
- 2026MRI Contrast Enhancement Kinetics World Modelcited by 4
- 2024CPT-Interp: Continuous sPatial and Temporal Motion Modeling for 4D Medical Image Interpolationcited by 3
- 2025Temporal Differential Fields for 4D Motion Modeling via Image-to-Video Synthesiscited by 3
- 2025A Diffusion-Driven Temporal Super-Resolution and Spatial Consistency Enhancement Framework for 4D MRI imagingcited by 1
- 2024Continuous sPatial-Temporal Deformable Image Registration (CPT-DIR) for motion modelling in radiotherapy: beyond classic voxel-based methodscited by 0
- 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domaincited by 0
- 2025Test Time Training for 4D Medical Image Interpolationcited by 0
- 2026Deep Slice Interpolation for Reducing Through-Plane Anisotropy and Noise in Head CTcited by 0
- 2026Towards Voxel Spacing Consistency for Medical Image Segmentationcited by 0
- 2026Low-Rank Velocity Fields as a Structural Prior for Unsupervised 4D Medical Image Interpolationcited by 0
- 2026Phase-Aligned Finite-Fourier Periodic Deformation for 4D Medical Image Interpolationcited by 0
- 2026Phase-Aligned Finite-Fourier Periodic Deformation for 4D Medical Image Interpolation25 Aug 2026
- 2026Low-Rank Velocity Fields as a Structural Prior for Unsupervised 4D Medical Image Interpolation25 Aug 2026
- 2026Towards Voxel Spacing Consistency for Medical Image Segmentation30 Jun 2026
- 2026Deep Slice Interpolation for Reducing Through-Plane Anisotropy and Noise in Head CT8 Jun 2026
- 2026MRI Contrast Enhancement Kinetics World Model22 Feb 2026
- 2025A Diffusion-Driven Temporal Super-Resolution and Spatial Consistency Enhancement Framework for 4D MRI imaging4 Jun 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025Temporal Differential Fields for 4D Motion Modeling via Image-to-Video Synthesis22 May 2025
- 2025Test Time Training for 4D Medical Image Interpolation4 Feb 2025
- 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domain25 Nov 2024
- 2024CPT-Interp: Continuous sPatial and Temporal Motion Modeling for 4D Medical Image Interpolation24 May 2024
- 2024Continuous sPatial-Temporal Deformable Image Registration (CPT-DIR) for motion modelling in radiotherapy: beyond classic voxel-based methods1 May 2024