A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and Decision Making in Medical Imaging
Not on the map. Why?
Abstract (arXiv)
Harmonizing the analysis of data, especially of 3-D image volumes, consisting of different number of slices and annotated per volume, is a significant problem in training and using deep neural networks in various applications, including medical imaging. Moreover, unifying the decision making of the networks over different input datasets is crucial for the generation of rich data-driven knowledge and for trusted usage in the applications. This paper presents a new deep neural architecture, named RACNet, which includes routing and feature alignment steps and effectively handles different input lengths and single annotations of the 3-D image inputs, whilst providing highly accurate decisions. In addition, through latent variable extraction from the trained RACNet, a set of anchors are generated providing further insight on the network's decision making. These can be used to enrich and unify data-driven knowledge extracted from different datasets. An extensive experimental study illustrates the above developments, focusing on COVID-19 diagnosis through analysis of 3-D chest CT scans from databases generated in different countries and medical centers.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 27 of its 60 references that are in the map. First posted on arXiv 1 Mar 2023.
Builds on
27 of 60 references.
References · 27
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 282
- 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
- 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
- 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
- 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
- 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
- 2016Multiple Instance Learning: A Survey of Problem Characteristics and Applicationscited by 163
- 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
- 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
- 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
15 more
- 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
- 2020COVID-CT-Dataset: A CT Scan Dataset about COVID-19cited by 93
- 2019Bi-Directional ConvLSTM U-Net with Densley Connected Convolutionscited by 82
- 2018Aff-Wild2: Extending the Aff-Wild Database for Affect Recognitioncited by 80
- 2020Deep Transparent Prediction through Latent Representation Analysiscited by 72
- 2021MIA-COV19D: COVID-19 Detection through 3-D Chest CT Image Analysiscited by 72
- 2019Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Datasetcited by 39
- 2018Photorealistic Facial Synthesis in the Dimensional Affect Spacecited by 33
- 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
- 2020A Survey on Deep Learning for Neuroimaging-based Brain Disorder Analysiscited by 27
- 2018A Multi-Task Learning & Generation Framework: Valence-Arousal, Action Units & Primary Expressionscited by 25
- 2018Training Deep Neural Networks with Different Datasets In-the-wild: The Emotion Recognition Paradigmcited by 20
- 2018A Multi-component CNN-RNN Approach for Dimensional Emotion Recognition in-the-wildcited by 15
- 2021Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scanscited by 13
- 2021Evolutionary Multi-objective Architecture Search Framework: Application to COVID-19 3D CT Classificationcited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 25; 2025: 7; 2026: 6.
39 papers.
Sort:
- 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
- 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
- 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
- 2024Domain adaptation, Explainability & Fairness in AI for Medical Image Analysis: Diagnosis of COVID-19 based on 3-D Chest CT-scanscited by 30
- 2024COVID-19 Computer-aided Diagnosis through AI-assisted CT Imaging Analysis: Deploying a Medical AI Systemcited by 23
- 2023BTDNet: a Multi-Modal Approach for Brain Tumor Radiogenomic Classificationcited by 20
- 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkitcited by 16
- 2024SAM2CLIP2SAM: Vision Language Model for Segmentation of 3D CT Scans for Covid-19 Detectioncited by 14
- 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarioscited by 13
- 2024Robust COVID-19 Detection in CT Images with CLIPcited by 12
- 2024Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimationcited by 11
- 2024Can Machine Learning Assist in Diagnosis of Primary Immune Thrombocytopenia? A feasibility studycited by 8
27 more
- 2024Rethinking Affect Analysis: A Protocol for Ensuring Fairness and Consistencycited by 7
- 2024Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Stylecited by 6
- 2024Advancing COVID-19 Detection in 3D CT Scanscited by 5
- 2025Multi-Source COVID-19 Detection via Variance Risk Extrapolationcited by 5
- 2024Robust Facial Reactions Generation: An Emotion-Aware Framework with Modality Compensationcited by 4
- 2025Advancing Lung Disease Diagnosis in 3D CT Scanscited by 4
- 2024Domain Adaptation Using Pseudo Labels for COVID-19 Detectioncited by 3
- 2024A Closer Look at Spatial-Slice Features Learning for COVID-19 Detectioncited by 3
- 2024Simple 2D Convolutional Neural Network-based Approach for COVID-19 Detectioncited by 2
- 2025Taming Domain Shift in Multi-source CT-Scan Classification via Input-Space Standardizationcited by 2
- 2024Common Corruptions for Enhancing and Evaluating Robustness in Air-to-Air Visual Object Detectioncited by 1
- 2024Complex Style Image Transformations for Domain Generalization in Medical Imagescited by 1
- 2025Multi Source COVID-19 Detection via Kernel-Density-based Slice Samplingcited by 1
- 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERCcited by 1
- 2024Ensembling and Test Augmentation for Covid-19 Detection and Covid-19 Domain Adaptation from 3D CT-Scanscited by 0
- 2024COVID-19 detection from pulmonary CT scans using a novel EfficientNet with attention mechanismcited by 0
- 2024High-confidence pseudo-labels for domain adaptation in COVID-19 detectioncited by 0
- 2024GANmut: Generating and Modifying Facial Expressionscited by 0
- 2024Multi-Task Learning for Affect Analysiscited by 0
- 2024Emotion Detection through Body Gesture and Facecited by 0
- 2025Stable-Drift: A Patient-Aware Latent Drift Replay Method for Stabilizing Representations in Continual Learningcited by 0
- 2026Halfway to 3D: Ensembling 2.5D and 3D Models for Robust COVID-19 CT Diagnosiscited by 0
- 2026Clinical Priors Guided Lung Disease Detection in 3D CT Scanscited by 0
- 2026Vision-Language Model Based Multi-Expert Fusion for CT Image Classificationcited by 0
- 2026Towards Fair and Robust Volumetric CT Classification via KL-Regularised Group Distributionally Robust Optimisationcited by 0
- 2026Robust Multi-Source Covid-19 Detection in CT Imagescited by 0
- 2026Robust Fair Disease Diagnosis in CT Imagescited by 0
- 2026Robust Fair Disease Diagnosis in CT Images8 Apr 2026
- 2026Robust Multi-Source Covid-19 Detection in CT Images2 Apr 2026
- 2026Towards Fair and Robust Volumetric CT Classification via KL-Regularised Group Distributionally Robust Optimisation16 Mar 2026
- 2026Vision-Language Model Based Multi-Expert Fusion for CT Image Classification16 Mar 2026
- 2026Clinical Priors Guided Lung Disease Detection in 3D CT Scans16 Mar 2026
- 2026Halfway to 3D: Ensembling 2.5D and 3D Models for Robust COVID-19 CT Diagnosis16 Mar 2026
- 2025Stable-Drift: A Patient-Aware Latent Drift Replay Method for Stabilizing Representations in Continual Learning27 Nov 2025
- 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERC6 Aug 2025
- 2025Taming Domain Shift in Multi-source CT-Scan Classification via Input-Space Standardization26 Jul 2025
- 2025Multi Source COVID-19 Detection via Kernel-Density-based Slice Sampling2 Jul 2025
- 2025Advancing Lung Disease Diagnosis in 3D CT Scans1 Jul 2025
- 2025Multi-Source COVID-19 Detection via Variance Risk Extrapolation29 Jun 2025
27 more
- 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarios29 May 2025
- 2024Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Style4 Oct 2024
- 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkit26 Sep 2024
- 2024Rethinking Affect Analysis: A Protocol for Ensuring Fairness and Consistency4 Aug 2024
- 2024Robust Facial Reactions Generation: An Emotion-Aware Framework with Modality Compensation22 Jul 2024
- 2024SAM2CLIP2SAM: Vision Language Model for Segmentation of 3D CT Scans for Covid-19 Detection22 Jul 2024
- 2024Emotion Detection through Body Gesture and Face13 Jul 2024
- 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognition4 Jul 2024
- 2024Multi-Task Learning for Affect Analysis30 Jun 2024
- 2024GANmut: Generating and Modifying Facial Expressions16 Jun 2024
- 2024Complex Style Image Transformations for Domain Generalization in Medical Images1 Jun 2024
- 2024Can Machine Learning Assist in Diagnosis of Primary Immune Thrombocytopenia? A feasibility study31 May 2024
- 2024Common Corruptions for Enhancing and Evaluating Robustness in Air-to-Air Visual Object Detection10 May 2024
- 2024Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimation10 May 2024
- 2024A Closer Look at Spatial-Slice Features Learning for COVID-19 Detection2 Apr 2024
- 2024High-confidence pseudo-labels for domain adaptation in COVID-19 detection20 Mar 2024
- 2024Advancing COVID-19 Detection in 3D CT Scans18 Mar 2024
- 2024COVID-19 detection from pulmonary CT scans using a novel EfficientNet with attention mechanism18 Mar 2024
- 2024Domain Adaptation Using Pseudo Labels for COVID-19 Detection18 Mar 2024
- 2024Ensembling and Test Augmentation for Covid-19 Detection and Covid-19 Domain Adaptation from 3D CT-Scans17 Mar 2024
- 2024Simple 2D Convolutional Neural Network-based Approach for COVID-19 Detection17 Mar 2024
- 2024Robust COVID-19 Detection in CT Images with CLIP13 Mar 2024
- 2024COVID-19 Computer-aided Diagnosis through AI-assisted CT Imaging Analysis: Deploying a Medical AI System10 Mar 2024
- 2024Domain adaptation, Explainability & Fairness in AI for Medical Image Analysis: Diagnosis of COVID-19 based on 3-D Chest CT-scans4 Mar 2024
- 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competition29 Feb 2024
- 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyond2 Jan 2024
- 2023BTDNet: a Multi-Modal Approach for Brain Tumor Radiogenomic Classification5 Oct 2023
- 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
- 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
- 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
- 2024Domain adaptation, Explainability & Fairness in AI for Medical Image Analysis: Diagnosis of COVID-19 based on 3-D Chest CT-scanscited by 30
- 2024COVID-19 Computer-aided Diagnosis through AI-assisted CT Imaging Analysis: Deploying a Medical AI Systemcited by 23
- 2023BTDNet: a Multi-Modal Approach for Brain Tumor Radiogenomic Classificationcited by 20
- 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkitcited by 16
- 2024SAM2CLIP2SAM: Vision Language Model for Segmentation of 3D CT Scans for Covid-19 Detectioncited by 14
- 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarioscited by 13
- 2024Robust COVID-19 Detection in CT Images with CLIPcited by 12
- 2024Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimationcited by 11
- 2024Can Machine Learning Assist in Diagnosis of Primary Immune Thrombocytopenia? A feasibility studycited by 8
12 most cited of 39 All 39 (JSON)
- 2026Robust Fair Disease Diagnosis in CT Images8 Apr 2026
- 2026Robust Multi-Source Covid-19 Detection in CT Images2 Apr 2026
- 2026Towards Fair and Robust Volumetric CT Classification via KL-Regularised Group Distributionally Robust Optimisation16 Mar 2026
- 2026Vision-Language Model Based Multi-Expert Fusion for CT Image Classification16 Mar 2026
- 2026Clinical Priors Guided Lung Disease Detection in 3D CT Scans16 Mar 2026
- 2026Halfway to 3D: Ensembling 2.5D and 3D Models for Robust COVID-19 CT Diagnosis16 Mar 2026
- 2025Stable-Drift: A Patient-Aware Latent Drift Replay Method for Stabilizing Representations in Continual Learning27 Nov 2025
- 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERC6 Aug 2025
- 2025Taming Domain Shift in Multi-source CT-Scan Classification via Input-Space Standardization26 Jul 2025
- 2025Multi Source COVID-19 Detection via Kernel-Density-based Slice Sampling2 Jul 2025
- 2025Advancing Lung Disease Diagnosis in 3D CT Scans1 Jul 2025
- 2025Multi-Source COVID-19 Detection via Variance Risk Extrapolation29 Jun 2025
12 newest of 39 All 39 (JSON)