MULAN: Multitask Universal Lesion Analysis Network for Joint Lesion Detection, Tagging, and Segmentation
Not on the map. Why?
Abstract (arXiv)
When reading medical images such as a computed tomography (CT) scan, radiologists generally search across the image to find lesions, characterize and measure them, and then describe them in the radiological report. To automate this process, we propose a multitask universal lesion analysis network (MULAN) for joint detection, tagging, and segmentation of lesions in a variety of body parts, which greatly extends existing work of single-task lesion analysis on specific body parts. MULAN is based on an improved Mask R-CNN framework with three head branches and a 3D feature fusion strategy. It achieves the state-of-the-art accuracy in the detection and tagging tasks on the DeepLesion dataset, which contains 32K lesions in the whole body. We also analyze the relationship between the three tasks and show that tag predictions can improve detection accuracy via a score refinement layer.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 6; 2023: 9; 2024: 5; 2025: 7; 2026: 4.
39 papers.
Sort:
By area:
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2024Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomographycited by 31
- 2024The ULS23 Challenge: a Baseline Model and Benchmark Dataset for 3D Universal Lesion Segmentation in Computed Tomographycited by 26
- 2022SATr: Slice Attention with Transformer for Universal Lesion Detectioncited by 17
- 2021Weakly-Supervised Universal Lesion Segmentation with Regional Level Set Losscited by 16
- 2023CancerUniT: Towards a Single Unified Model for Effective Detection, Segmentation, and Diagnosis of Eight Major Cancers Using a Large Collection of CT Scanscited by 15
- 2021Asymmetric 3D Context Fusion for Universal Lesion Detectioncited by 14
- 2021Lesion Segmentation and RECIST Diameter Prediction via Click-driven Attention and Dual-path Connectioncited by 8
- 2021Universal Lesion Detection in CT Scans using Neural Network Ensemblescited by 8
- 2022Unsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximizationcited by 7
27 more
- 2021Conditional Training with Bounding Map for Universal Lesion Detectioncited by 5
- 2021RECIST-Net: Lesion detection via grouping keypoints on RECIST-based annotationcited by 4
- 2022View-Disentangled Transformer for Brain Lesion Detectioncited by 4
- 2023Anatomy-Aware Lymph Node Detection in Chest CT using Implicit Station Stratificationcited by 4
- 2024YOLO-MED : Multi-Task Interaction Network for Biomedical Imagescited by 3
- 2024Effective Lymph Nodes Detection in CT Scans Using Location Debiased Query Selection and Contrastive Query Representation in Transformercited by 3
- 2023RECIST Weakly Supervised Lesion Segmentation via Label-Space Co-Trainingcited by 2
- 2021Hetero-Modal Learning and Expansive Consistency Constraints for Semi-Supervised Detection from Multi-Sequence Datacited by 1
- 2022DKMA-ULD: Domain Knowledge augmented Multi-head Attention based Robust Universal Lesion Detectioncited by 1
- 2022Ultrasound Detection of Subquadricipital Recess Distensioncited by 1
- 2023An End-to-End Framework For Universal Lesion Detection With Missing Annotationscited by 1
- 2023Tackling the Incomplete Annotation Issue in Universal Lesion Detection Task By Exploratory Trainingcited by 1
- 2024Optimizing Universal Lesion Segmentation: State Space Model-Guided Hierarchical Networks with Feature Importance Adjustmentcited by 1
- 2025Class Imbalance Correction for Improved Universal Lesion Detection and Tagging in CTcited by 1
- 2022An Efficient Anchor-free Universal Lesion Detection in CT-scanscited by 0
- 2023Integrating features from lymph node stations for metastatic lymph node detectioncited by 0
- 2023Mixed-order self-paced curriculum learning for universal lesion detectioncited by 0
- 2025From Slices to Sequences: Autoregressive Tracking Transformer for Cohesive and Consistent 3D Lymph Node Detection in CT Scanscited by 0
- 2025Correcting Class Imbalances with Self-Training for Improved Universal Lesion Detection and Taggingcited by 0
- 2025Context Aware Grounded Teacher for Source Free Object Detectioncited by 0
- 2025MoMBS: Mixed-order minibatch sampling enhances model training from diverse-quality imagescited by 0
- 2025PDSE: A Multiple Lesion Detector for CT Images using PANet and Deformable Squeeze-and-Excitation Blockcited by 0
- 2025MTMed3D: A Multi-Task Transformer-Based Model for 3D Medical Imagingcited by 0
- 20263DLAND: 3D Lesion Abdominal Anomaly Localization Datasetcited by 0
- 2026Multi-Granularity 3D Kidney Lesion Characterization from CT Volumescited by 0
- 2026A Unified 2D Framework for DeepLesion Detection, Segmentation and Short Report Generationcited by 0
- 2026Lesion Detection in CT with Frozen Self-Distilled Features: SALT, a Spatially Adaptive Label-Guided Temperaturecited by 0
- 2026Lesion Detection in CT with Frozen Self-Distilled Features: SALT, a Spatially Adaptive Label-Guided Temperature5 Aug 2026
- 2026A Unified 2D Framework for DeepLesion Detection, Segmentation and Short Report Generation3 Aug 2026
- 2026Multi-Granularity 3D Kidney Lesion Characterization from CT Volumes3 Jun 2026
- 20263DLAND: 3D Lesion Abdominal Anomaly Localization Dataset13 Feb 2026
- 2025MTMed3D: A Multi-Task Transformer-Based Model for 3D Medical Imaging15 Nov 2025
- 2025PDSE: A Multiple Lesion Detector for CT Images using PANet and Deformable Squeeze-and-Excitation Block4 Jun 2025
- 2025MoMBS: Mixed-order minibatch sampling enhances model training from diverse-quality images24 May 2025
- 2025Context Aware Grounded Teacher for Source Free Object Detection21 Apr 2025
- 2025Class Imbalance Correction for Improved Universal Lesion Detection and Tagging in CT8 Apr 2025
- 2025Correcting Class Imbalances with Self-Training for Improved Universal Lesion Detection and Tagging7 Apr 2025
- 2025From Slices to Sequences: Autoregressive Tracking Transformer for Cohesive and Consistent 3D Lymph Node Detection in CT Scans11 Mar 2025
- 2024The ULS23 Challenge: a Baseline Model and Benchmark Dataset for 3D Universal Lesion Segmentation in Computed Tomography7 Jun 2024
27 more
- 2024Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomography28 May 2024
- 2024Optimizing Universal Lesion Segmentation: State Space Model-Guided Hierarchical Networks with Feature Importance Adjustment26 Apr 2024
- 2024Effective Lymph Nodes Detection in CT Scans Using Location Debiased Query Selection and Contrastive Query Representation in Transformer4 Apr 2024
- 2024YOLO-MED : Multi-Task Interaction Network for Biomedical Images1 Mar 2024
- 2023Tackling the Incomplete Annotation Issue in Universal Lesion Detection Task By Exploratory Training23 Sep 2023
- 2023Anatomy-Aware Lymph Node Detection in Chest CT using Implicit Station Stratification28 Jul 2023
- 2023An End-to-End Framework For Universal Lesion Detection With Missing Annotations27 Mar 2023
- 2023RECIST Weakly Supervised Lesion Segmentation via Label-Space Co-Training1 Mar 2023
- 2023Mixed-order self-paced curriculum learning for universal lesion detection9 Feb 2023
- 2023CancerUniT: Towards a Single Unified Model for Effective Detection, Segmentation, and Diagnosis of Eight Major Cancers Using a Large Collection of CT Scans28 Jan 2023
- 2023Integrating features from lymph node stations for metastatic lymph node detection9 Jan 2023
- 2023PACO: Parts and Attributes of Common Objects4 Jan 2023
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection2 Jan 2023
- 2022Ultrasound Detection of Subquadricipital Recess Distension22 Nov 2022
- 2022View-Disentangled Transformer for Brain Lesion Detection20 Sep 2022
- 2022Unsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximization20 Apr 2022
- 2022An Efficient Anchor-free Universal Lesion Detection in CT-scans30 Mar 2022
- 2022DKMA-ULD: Domain Knowledge augmented Multi-head Attention based Robust Universal Lesion Detection14 Mar 2022
- 2022SATr: Slice Attention with Transformer for Universal Lesion Detection13 Mar 2022
- 2021Universal Lesion Detection in CT Scans using Neural Network Ensembles9 Nov 2021
- 2021Asymmetric 3D Context Fusion for Universal Lesion Detection17 Sep 2021
- 2021RECIST-Net: Lesion detection via grouping keypoints on RECIST-based annotation19 Jul 2021
- 2021Recent advances and clinical applications of deep learning in medical image analysis27 May 2021
- 2021Lesion Segmentation and RECIST Diameter Prediction via Click-driven Attention and Dual-path Connection5 May 2021
- 2021Weakly-Supervised Universal Lesion Segmentation with Regional Level Set Loss3 May 2021
- 2021Hetero-Modal Learning and Expansive Consistency Constraints for Semi-Supervised Detection from Multi-Sequence Data24 Mar 2021
- 2021Conditional Training with Bounding Map for Universal Lesion Detection23 Mar 2021
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2024Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomographycited by 31
- 2024The ULS23 Challenge: a Baseline Model and Benchmark Dataset for 3D Universal Lesion Segmentation in Computed Tomographycited by 26
- 2022SATr: Slice Attention with Transformer for Universal Lesion Detectioncited by 17
- 2021Weakly-Supervised Universal Lesion Segmentation with Regional Level Set Losscited by 16
- 2023CancerUniT: Towards a Single Unified Model for Effective Detection, Segmentation, and Diagnosis of Eight Major Cancers Using a Large Collection of CT Scanscited by 15
- 2021Asymmetric 3D Context Fusion for Universal Lesion Detectioncited by 14
- 2021Lesion Segmentation and RECIST Diameter Prediction via Click-driven Attention and Dual-path Connectioncited by 8
- 2021Universal Lesion Detection in CT Scans using Neural Network Ensemblescited by 8
- 2022Unsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximizationcited by 7
12 most cited of 38 All 38 (JSON)
- 2026Lesion Detection in CT with Frozen Self-Distilled Features: SALT, a Spatially Adaptive Label-Guided Temperature5 Aug 2026
- 2026A Unified 2D Framework for DeepLesion Detection, Segmentation and Short Report Generation3 Aug 2026
- 2026Multi-Granularity 3D Kidney Lesion Characterization from CT Volumes3 Jun 2026
- 20263DLAND: 3D Lesion Abdominal Anomaly Localization Dataset13 Feb 2026
- 2025MTMed3D: A Multi-Task Transformer-Based Model for 3D Medical Imaging15 Nov 2025
- 2025PDSE: A Multiple Lesion Detector for CT Images using PANet and Deformable Squeeze-and-Excitation Block4 Jun 2025
- 2025MoMBS: Mixed-order minibatch sampling enhances model training from diverse-quality images24 May 2025
- 2025Context Aware Grounded Teacher for Source Free Object Detection21 Apr 2025
- 2025Class Imbalance Correction for Improved Universal Lesion Detection and Tagging in CT8 Apr 2025
- 2025Correcting Class Imbalances with Self-Training for Improved Universal Lesion Detection and Tagging7 Apr 2025
- 2025From Slices to Sequences: Autoregressive Tracking Transformer for Cohesive and Consistent 3D Lymph Node Detection in CT Scans11 Mar 2025
- 2024The ULS23 Challenge: a Baseline Model and Benchmark Dataset for 3D Universal Lesion Segmentation in Computed Tomography7 Jun 2024
12 newest of 38 All 38 (JSON)