mlsanityData to 7 Oct 2026

T-AutoML: Automated Machine Learning for Lesion Segmentation using Transformers in 3D Medical Imaging

arXiv 2111.07535 ↗First posted 15 Nov 2021eess.IV cs.CV cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

Lesion segmentation in medical imaging has been an important topic in clinical research. Researchers have proposed various detection and segmentation algorithms to address this task. Recently, deep learning-based approaches have significantly improved the performance over conventional methods. However, most state-of-the-art deep learning methods require the manual design of multiple network components and training strategies. In this paper, we propose a new automated machine learning algorithm, T-AutoML, which not only searches for the best neural architecture, but also finds the best combination of hyper-parameters and data augmentation strategies simultaneously. The proposed method utilizes the modern transformer model, which is introduced to adapt to the dynamic length of the search space embedding and can significantly improve the ability of the search. We validate T-AutoML on several large-scale public lesion segmentation data-sets and achieve state-of-the-art performance.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 50 of its 82 references that are in the map. First posted on arXiv 15 Nov 2021.

Builds on

50 of 82 references.

References · 50

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  5. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  6. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  7. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
  8. 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
  9. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  10. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  11. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
  12. 2018Regularized Evolution for Image Classifier Architecture Searchcited by 902
38 more
  1. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
  2. 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 666
  3. 2020Image Segmentation Using Deep Learning: A Surveycited by 659
  4. 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
  5. 2018FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Searchcited by 480
  6. 2019Single Path One-Shot Neural Architecture Search with Uniform Samplingcited by 411
  7. 2020Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentationcited by 326
  8. 20183D MRI brain tumor segmentation using autoencoder regularizationcited by 324
  9. 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
  10. 2019NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detectioncited by 289
  11. 2019Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentationcited by 258
  12. 2020A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promisescited by 230
  13. 2020BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Modelscited by 187
  14. 2016The Importance of Skip Connections in Biomedical Image Segmentationcited by 126
  15. 2020BRP-NAS: Prediction-based NAS using GCNscited by 109
  16. 2019Exploring Randomly Wired Neural Networks for Image Recognitioncited by 103
  17. 2020APQ: Joint Search for Network Architecture, Pruning and Quantization Policycited by 98
  18. 2018Searching for Efficient Multi-Scale Architectures for Dense Image Predictioncited by 96
  19. 2019AutoGAN: Neural Architecture Search for Generative Adversarial Networkscited by 94
  20. 2017Neural Optimizer Search with Reinforcement Learningcited by 82
  21. 20183D Semi-Supervised Learning with Uncertainty-Aware Multi-View Co-Trainingcited by 57
  22. 2019SpineNet: Learning Scale-Permuted Backbone for Recognition and Localizationcited by 50
  23. 2019C2FNAS: Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentationcited by 49
  24. 2018RA-UNet: A hybrid deep attention-aware network to extract liver and tumor in CT scanscited by 41
  25. 20173D Anisotropic Hybrid Network: Transferring Convolutional Features from 2D Images to 3D Anisotropic Volumescited by 38
  26. 2019SqueezeNAS: Fast neural architecture search for faster semantic segmentationcited by 31
  27. 2020Volumetric Attention for 3D Medical Image Segmentation and Detectioncited by 29
  28. 2019V-NAS: Neural Architecture Search for Volumetric Medical Image Segmentationcited by 27
  29. 2019One Network to Segment Them All: A General, Lightweight System for Accurate 3D Medical Image Segmentationcited by 24
  30. 2019Scalable Neural Architecture Search for 3D Medical Image Segmentationcited by 20
  31. 2017Liver lesion segmentation informed by joint liver segmentationcited by 18
  32. 2017Automatic Liver Segmentation Using an Adversarial Image-to-Image Networkcited by 17
  33. 2020Learning to Rank Learning Curvescited by 16
  34. 2020Searching Learning Strategy with Reinforcement Learning for 3D Medical Image Segmentationcited by 16
  35. 2019Resource Optimized Neural Architecture Search for 3D Medical Image Segmentationcited by 13
  36. 2018AutoLoss: Learning Discrete Schedules for Alternate Optimizationcited by 12
  37. 2020UXNet: Searching Multi-level Feature Aggregation for 3D Medical Image Segmentationcited by 11
  38. 2020HyperSTAR: Task-Aware Hyperparameters for Deep Networkscited by 9

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 2; 2024: 4; 2025: 2.

11 papers.