mlsanityData to 7 Oct 2026

Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Future

arXiv 2108.04543 ↗First posted 10 Aug 2021cs.LG cs.CV physics.med-phcited by 18

Not on the map. Why?

Abstract (arXiv)

In this article, we perform a review of the state-of-the-art of hybrid machine learning in medical imaging. We start with a short summary of the general developments of the past in machine learning and how general and specialized approaches have been in competition in the past decades. A particular focus will be the theoretical and experimental evidence pro and contra hybrid modelling. Next, we inspect several new developments regarding hybrid machine learning with a particular focus on so-called known operator learning and how hybrid approaches gain more and more momentum across essentially all applications in medical imaging and medical image analysis. As we will point out by numerous examples, hybrid models are taking over in image reconstruction and analysis. Even domains such as physical simulation and scanner and acquisition design are being addressed using machine learning grey box modelling approaches. Towards the end of the article, we will investigate a few future directions and point out relevant areas in which hybrid modelling, meta learning, and other domains will likely be able to drive the state-of-the-art ahead.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 71 of its 146 references that are in the map. First posted on arXiv 10 Aug 2021.

Builds on

71 of 146 references.

References · 71

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  5. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  6. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  7. 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
  8. 2015Spatial Transformer Networkscited by 1,423
  9. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
  10. 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
  11. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  12. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
38 more
  1. 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
  2. 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
  3. 2020State of the Art on Neural Renderingcited by 276
  4. 2017Learned Primal-dual Reconstructioncited by 251
  5. 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
  6. 2017Image reconstruction by domain transform manifold learningcited by 231
  7. 2018Deep Learning: A Critical Appraisalcited by 214
  8. 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
  9. 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 201
  10. 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
  11. 2017Quicksilver: Fast Predictive Image Registration - a Deep Learning Approachcited by 113
  12. 2018Distribution Matching Losses Can Hallucinate Features in Medical Image Translationcited by 99
  13. 2018NETT: Solving Inverse Problems with Deep Neural Networkscited by 89
  14. 2020Meta-Learning Symmetries by Reparameterizationcited by 75
  15. 2019Neural Point Cloud Rendering via Multi-Plane Projectioncited by 60
  16. 2018DeepDRR -- A Catalyst for Machine Learning in Fluoroscopy-guided Procedurescited by 55
  17. 2019Learning Symbolic Physics with Graph Networkscited by 52
  18. 2019Voxel2Mesh: 3D Mesh Model Generation from Volumetric Datacited by 52
  19. 2020Active MR k-space Sampling with Reinforcement Learningcited by 45
  20. 2020TorchRadon: Fast Differentiable Routines for Computed Tomographycited by 44
  21. 2018RenderNet: A deep convolutional network for differentiable rendering from 3D shapescited by 42
  22. 2020Kohn-Sham equations as regularizer: building prior knowledge into machine-learned physicscited by 36
  23. 2018A Gentle Introduction to Deep Learning in Medical Image Processingcited by 34
  24. 2020Unpaired Deep Learning for Accelerated MRI using Optimal Transport Driven CycleGANcited by 28
  25. 2017Learning Filterbanks from Raw Speech for Phone Recognitioncited by 25
  26. 2019Learning with Known Operators reduces Maximum Training Error Boundscited by 25
  27. 2016SYSTRAN's Pure Neural Machine Translation Systemscited by 24
  28. 2019PYRO-NN: Python Reconstruction Operators in Neural Networkscited by 24
  29. 2016An Artificial Agent for Robust Image Registrationcited by 23
  30. 2018Approximation and Estimation for High-Dimensional Deep Learning Networkscited by 22
  31. 2021The Impact of Machine Learning on 2D/3D Registration for Image-guided Interventions: A Systematic Review and Perspectivecited by 22
  32. 2020Generalizing Spatial Transformers to Projective Geometry with Applications to 2D/3D Registrationcited by 21
  33. 2019Neural Voxel Renderer: Learning an Accurate and Controllable Rendering Toolcited by 20
  34. 2020Tensor Networks for Medical Image Classificationcited by 20
  35. 2019Extreme Relative Pose Network under Hybrid Representationscited by 19
  36. 2020MRI Image Reconstruction via Learning Optimization Using Neural ODEscited by 14
  37. 2017Encoding CNN Activations for Writer Recognitioncited by 13
  38. 2019HARK Side of Deep Learning -- From Grad Student Descent to Automated Machine Learningcited by 13

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 6; 2023: 1; 2024: 2; 2025: 5; 2026: 4.

18 papers.

Sort:

By area:

  1. 2022Model-Based Deep Learning: On the Intersection of Deep Learning and Optimizationcited by 50
  2. 2022Neural Integral Equationscited by 23
  3. 2023Word class representations spontaneously emerge in a deep neural network trained on next word predictioncited by 9
  4. 2022Neural Network based Formation of Cognitive Maps of Semantic Spaces and the Emergence of Abstract Conceptscited by 8
  5. 2025A Scoping Review of Machine Learning Applications in Power System Protection and Disturbance Managementcited by 7
  6. 2022Classification at the Accuracy Limit -- Facing the Problem of Data Ambiguitycited by 6
  7. 2022Data Models for Dataset Drift Controls in Machine Learning With Optical Imagescited by 5
  8. 2024Physics-Informed Machine Learning Towards A Real-Time Spacecraft Thermal Simulatorcited by 2
  9. 2025Locally Adaptive Conformal Inference for Operator Modelscited by 2
  10. 2024Data-driven Modeling in Metrology -- A Short Introduction, Current Developments and Future Perspectivescited by 1
  11. 2025Filter2Noise: A Framework for Interpretable and Zero-Shot Low-Dose CT Image Denoisingcited by 1
  12. 2025Physics-informed GNN for medium-high voltage AC power flow with edge-aware attention and line search correction operatorcited by 1
6 more
  1. 2026Beating the Style Detector: Three Hours of Agentic Research on the AI-Text Arms Racecited by 1
  2. 2026A Deep Risk Estimator for Known Operator Learningcited by 1
  3. 2022AutoSpeed: A Linked Autoencoder Approach for Pulse-Echo Speed-of-Sound Imaging for Medical Ultrasoundcited by 0
  4. 2025Multimodal Neural Operators for Real-Time Biomechanical Modelling of Traumatic Brain Injurycited by 0
  5. 2026Faster Thermal Profiling of a Lunar Rover with Machine Learning Adapted Finite Difference Modelcited by 0
  6. 2026Agentic Autoresearch for CT Reconstructioncited by 0