T-AutoML: Automated Machine Learning for Lesion Segmentation using Transformers in 3D Medical Imaging
Not on the map. Why?
Abstract (arXiv)
Lesion segmentation in medical imaging has been an important topic in clinical research. Researchers have proposed various detection and segmentation algorithms to address this task. Recently, deep learning-based approaches have significantly improved the performance over conventional methods. However, most state-of-the-art deep learning methods require the manual design of multiple network components and training strategies. In this paper, we propose a new automated machine learning algorithm, T-AutoML, which not only searches for the best neural architecture, but also finds the best combination of hyper-parameters and data augmentation strategies simultaneously. The proposed method utilizes the modern transformer model, which is introduced to adapt to the dynamic length of the search space embedding and can significantly improve the ability of the search. We validate T-AutoML on several large-scale public lesion segmentation data-sets and achieve state-of-the-art performance.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 50 of its 82 references that are in the map. First posted on arXiv 15 Nov 2021.
Builds on
50 of 82 references.
References · 50
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2018DARTS: Differentiable Architecture Searchcited by 1,782
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
- 2018Regularized Evolution for Image Classifier Architecture Searchcited by 902
38 more
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
- 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 666
- 2020Image Segmentation Using Deep Learning: A Surveycited by 659
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
- 2018FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Searchcited by 480
- 2019Single Path One-Shot Neural Architecture Search with Uniform Samplingcited by 411
- 2020Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentationcited by 326
- 20183D MRI brain tumor segmentation using autoencoder regularizationcited by 324
- 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
- 2019NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detectioncited by 289
- 2019Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentationcited by 258
- 2020A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promisescited by 230
- 2020BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Modelscited by 187
- 2016The Importance of Skip Connections in Biomedical Image Segmentationcited by 126
- 2020BRP-NAS: Prediction-based NAS using GCNscited by 109
- 2019Exploring Randomly Wired Neural Networks for Image Recognitioncited by 103
- 2020APQ: Joint Search for Network Architecture, Pruning and Quantization Policycited by 98
- 2018Searching for Efficient Multi-Scale Architectures for Dense Image Predictioncited by 96
- 2019AutoGAN: Neural Architecture Search for Generative Adversarial Networkscited by 94
- 2017Neural Optimizer Search with Reinforcement Learningcited by 82
- 20183D Semi-Supervised Learning with Uncertainty-Aware Multi-View Co-Trainingcited by 57
- 2019SpineNet: Learning Scale-Permuted Backbone for Recognition and Localizationcited by 50
- 2019C2FNAS: Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentationcited by 49
- 2018RA-UNet: A hybrid deep attention-aware network to extract liver and tumor in CT scanscited by 41
- 20173D Anisotropic Hybrid Network: Transferring Convolutional Features from 2D Images to 3D Anisotropic Volumescited by 38
- 2019SqueezeNAS: Fast neural architecture search for faster semantic segmentationcited by 31
- 2020Volumetric Attention for 3D Medical Image Segmentation and Detectioncited by 29
- 2019V-NAS: Neural Architecture Search for Volumetric Medical Image Segmentationcited by 27
- 2019One Network to Segment Them All: A General, Lightweight System for Accurate 3D Medical Image Segmentationcited by 24
- 2019Scalable Neural Architecture Search for 3D Medical Image Segmentationcited by 20
- 2017Liver lesion segmentation informed by joint liver segmentationcited by 18
- 2017Automatic Liver Segmentation Using an Adversarial Image-to-Image Networkcited by 17
- 2020Learning to Rank Learning Curvescited by 16
- 2020Searching Learning Strategy with Reinforcement Learning for 3D Medical Image Segmentationcited by 16
- 2019Resource Optimized Neural Architecture Search for 3D Medical Image Segmentationcited by 13
- 2018AutoLoss: Learning Discrete Schedules for Alternate Optimizationcited by 12
- 2020UXNet: Searching Multi-level Feature Aggregation for 3D Medical Image Segmentationcited by 11
- 2020HyperSTAR: Task-Aware Hyperparameters for Deep Networkscited by 9
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 4; 2025: 2.
11 papers.
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 20223D Vision with Transformers: A Surveycited by 21
- 2022Automated Learning for Deformable Medical Image Registration by Jointly Optimizing Network Architectures and Objective Functionscited by 8
- 2024SegICL: A Multimodal In-context Learning Framework for Enhanced Segmentation in Medical Imagingcited by 5
- 2024HResFormer: Hybrid Residual Transformer for Volumetric Medical Image Segmentationcited by 4
- 2025Auto-nnU-Net: Towards Automated Medical Image Segmentationcited by 3
- 2023Improving diagnosis and prognosis of lung cancer using vision transformers: A scoping reviewcited by 2
- 2024A review of handcrafted and deep radiomics in neurological diseases: transitioning from oncology to clinical neuroimagingcited by 2
- 2023AutoML Systems For Medical Imagingcited by 1
- 2024Data augmentation with automated machine learning: approaches and performance comparison with classical data augmentation methodscited by 1
- 2025Multi-Disease-Aware Training Strategy for Cardiac MR Image Segmentationcited by 0
- 2025Auto-nnU-Net: Towards Automated Medical Image Segmentation22 May 2025
- 2025Multi-Disease-Aware Training Strategy for Cardiac MR Image Segmentation23 Mar 2025
- 2024HResFormer: Hybrid Residual Transformer for Volumetric Medical Image Segmentation16 Dec 2024
- 2024A review of handcrafted and deep radiomics in neurological diseases: transitioning from oncology to clinical neuroimaging18 Jul 2024
- 2024SegICL: A Multimodal In-context Learning Framework for Enhanced Segmentation in Medical Imaging25 Mar 2024
- 2024Data augmentation with automated machine learning: approaches and performance comparison with classical data augmentation methods13 Mar 2024
- 2023Improving diagnosis and prognosis of lung cancer using vision transformers: A scoping review6 Sep 2023
- 2023AutoML Systems For Medical Imaging7 Jun 2023
- 20223D Vision with Transformers: A Survey8 Aug 2022
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives2 Jun 2022
- 2022Automated Learning for Deformable Medical Image Registration by Jointly Optimizing Network Architectures and Objective Functions14 Mar 2022