# Model-Based and Data-Driven Strategies in Medical Image Computing

arXiv: https://arxiv.org/abs/1909.10391 · HTML: https://mlsanity.com/paper/1909.10391/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Sep 2019.

## Built on by (most cited first, 16 of 16)

- [Unified Focal loss: Generalising Dice and cross entropy-based losses to handle class imbalanced medical image segmentation](https://mlsanity.com/paper/2102.04525/) (2021)
- [Learning a Model-Driven Variational Network for Deformable Image Registration](https://mlsanity.com/paper/2105.12227/) (2021)
- [Generative Myocardial Motion Tracking via Latent Space Exploration with Biomechanics-informed Prior](https://mlsanity.com/paper/2206.03830/) (2022)
- [A Geometry-Informed Deep Learning Framework for Ultra-Sparse 3D Tomographic Image Reconstruction](https://mlsanity.com/paper/2105.11692/) (2021)
- [Automatic detection of glaucoma via fundus imaging and artificial intelligence: A review](https://mlsanity.com/paper/2204.05591/) (2022)
- [Decoder-Only Image Registration](https://mlsanity.com/paper/2402.03585/) (2024)
- [OpenMedIA: Open-Source Medical Image Analysis Toolbox and Benchmark under Heterogeneous AI Computing Platforms](https://mlsanity.com/paper/2208.05616/) (2022)
- [Recurrent Inference Machine for Medical Image Registration](https://mlsanity.com/paper/2406.13413/) (2024)
- [Bone Surface Reconstruction and Clinical Features Estimation from Sparse Landmarks and Statistical Shape Models: A feasibility study on the femur](https://mlsanity.com/paper/2107.03292/) (2021)
- [End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformers](https://mlsanity.com/paper/2307.00873/) (2023)
- [SoK: Memorisation in machine learning](https://mlsanity.com/paper/2311.03075/) (2023)
- [Decoding the human brain tissue response to radiofrequency excitation using a biophysical-model-free deep MRI on a chip framework](https://mlsanity.com/paper/2408.08376/) (2024)
- [Improving Instance Optimization in Deformable Image Registration with Gradient Projection](https://mlsanity.com/paper/2410.15767/) (2024)
- [Dynamic multi feature-class Gaussian process models](https://mlsanity.com/paper/2112.04495/) (2021)
- [DeepArt: A Benchmark to Advance Fidelity Research in AI-Generated Content](https://mlsanity.com/paper/2312.10407/) (2023)
- [Adapting Frozen Mono-modal Backbones for Multi-modal Registration via Contrast-Agnostic Instance Optimization](https://mlsanity.com/paper/2603.26393/) (2026)

## Abstract (arXiv)

Model-based approaches for image reconstruction, analysis and interpretation have made significant progress over the last decades. Many of these approaches are based on either mathematical, physical or biological models. A challenge for these approaches is the modelling of the underlying processes (e.g. the physics of image acquisition or the patho-physiology of a disease) with appropriate levels of detail and realism. With the availability of large amounts of imaging data and machine learning (in particular deep learning) techniques, data-driven approaches have become more widespread for use in different tasks in reconstruction, analysis and interpretation. These approaches learn statistical models directly from labelled or unlabeled image data and have been shown to be very powerful for extracting clinically useful information from medical imaging. While these data-driven approaches often outperform traditional model-based approaches, their clinical deployment often poses challenges in terms of robustness, generalization ability and interpretability. In this article, we discuss what developments have motivated the shift from model-based approaches towards data-driven strategies and what potential problems are associated with the move towards purely data-driven approaches, in particular deep learning. We also discuss some of the open challenges for data-driven approaches, e.g. generalization to new unseen data (e.g. transfer learning), robustness to adversarial attacks and interpretability. Finally, we conclude with a discussion on how these approaches may lead to the development of more closely coupled imaging pipelines that are optimized in an end-to-end fashion.