# MultiFusionNet: Multilayer Multimodal Fusion of Deep Neural Networks for Chest X-Ray Image Classification

arXiv: https://arxiv.org/abs/2401.00728 · HTML: https://mlsanity.com/paper/2401.00728/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 62 references that are in the map.
- First posted on arXiv 1 Jan 2024.

## Builds on (most cited first, 16 of 16)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [Xception: Deep Learning with Depthwise Separable Convolutions](https://mlsanity.com/paper/1610.02357/) (2016)
- [Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning](https://mlsanity.com/paper/1602.07261/) (2016)
- [COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Images](https://mlsanity.com/paper/2003.09871/) (2020)
- [Can AI help in screening Viral and COVID-19 pneumonia?](https://mlsanity.com/paper/2003.13145/) (2020)
- [Covid-19: Automatic detection from X-Ray images utilizing Transfer Learning with Convolutional Neural Networks](https://mlsanity.com/paper/2003.11617/) (2020)
- [Automatic Detection of Coronavirus Disease (COVID-19) Using X-ray Images and Deep Convolutional Neural Networks](https://mlsanity.com/paper/2003.10849/) (2020)
- [CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images](https://mlsanity.com/paper/2004.04931/) (2020)
- [CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection](https://mlsanity.com/paper/2103.05094/) (2021)
- [COVIDGR dataset and COVID-SDNet methodology for predicting COVID-19 based on Chest X-Ray images](https://mlsanity.com/paper/2006.01409/) (2020)
- [Digital twins based on bidirectional LSTM and GAN for modelling the COVID-19 pandemic](https://mlsanity.com/paper/2102.02664/) (2021)
- [Stacked Convolutional Neural Network for Diagnosis of COVID-19 Disease from X-ray Images](https://mlsanity.com/paper/2006.13817/) (2020)
- [Decision and Feature Level Fusion of Deep Features Extracted from Public COVID-19 Data-sets](https://mlsanity.com/paper/2011.08528/) (2020)
- [Evolving Deep Convolutional Neural Network by Hybrid Sine-Cosine and Extreme Learning Machine for Real-time COVID19 Diagnosis from X-Ray Images](https://mlsanity.com/paper/2105.14192/) (2021)

## Built on by (most cited first, 2 of 2)

- [Anatomic Feature Fusion Model for Diagnosing Calcified Pulmonary Nodules on Chest X-Ray](https://mlsanity.com/paper/2508.12562/) (2025)
- [RL-ACRGNet: Reinforcement Learning-Based Chest Radiology Report Generation Network](https://mlsanity.com/paper/2606.02035/) (2026)

## Abstract (arXiv)

Chest X-ray imaging is a critical diagnostic tool for identifying pulmonary diseases. However, manual interpretation of these images is time-consuming and error-prone. Automated systems utilizing convolutional neural networks (CNNs) have shown promise in improving the accuracy and efficiency of chest X-ray image classification. While previous work has mainly focused on using feature maps from the final convolution layer, there is a need to explore the benefits of leveraging additional layers for improved disease classification. Extracting robust features from limited medical image datasets remains a critical challenge. In this paper, we propose a novel deep learning-based multilayer multimodal fusion model that emphasizes extracting features from different layers and fusing them. Our disease detection model considers the discriminatory information captured by each layer. Furthermore, we propose the fusion of different-sized feature maps (FDSFM) module to effectively merge feature maps from diverse layers. The proposed model achieves a significantly higher accuracy of 97.21% and 99.60% for both three-class and two-class classifications, respectively. The proposed multilayer multimodal fusion model, along with the FDSFM module, holds promise for accurate disease classification and can also be extended to other disease classifications in chest X-ray images.