A Novel Deep Learning Approach for Detection of Pneumonia from Chest X-Rays

Authors

  • Andrew Yuan Lynbrook

DOI:

https://doi.org/10.47611/jsrhs.v10i3.1627

Keywords:

deep learning, machine learning, cnn, convolutional neural networks, neural network, neural net, pneumonia, chest x-ray, x-ray, x-rays

Abstract

Current machine learning models for pneumonia detection perform poorly compared to those for other diseases. I aim to use a novel approach to build a model that can improve on performance and be applicable to other diseases.

My approach uses multi-tier neural networks instead of using single convolutional neural networks (CNNs) like what other researchers have done. My multi-tier model consists of three tier-1 Neural Networks (NNs) and one tier-2 NN. For the tier-1 NN, I use 3 selected ImageNet-trained CNNs (ResNet152V2, DenseNet201, and NASNet Hub) as the starting bases, and train each of them via transfer learning. Then, a tier-2 NN is employed to combine the prediction results from the well-trained tier-1 NNs. The tier-2 NN model is trained with the same dataset. It produces the final predictions with substantially improved performance. The dataset used for my model is pre-processed by me, and based on a public chest X-ray dataset from the NIHCC.

My model achieved an AUC score of 76.5%, which is better than each of the tier-1 NNs alone and better than most existing models created by others.

My multi-tier approach accurately detects pneumonia from chest X-rays. It’s practical and it employs incremental learning, meaning it can be continuously improved over time. In the future, I could extend my model from binary classification to multiclass classification, apply it for lung cancer, or even other diseases.

Downloads

Download data is not yet available.

References or Bibliography

Bernadeta Dadonaite and Max Roser (2018) - "Pneumonia". Published online at OurWorldInData.org. Retrieved from: https://ourworldindata.org/pneumonia

Wang, Xiaosong; Peng, Yifan; Lu, Le; Lu, Zhiyong; Bagheri, Mohammadhadi; and Summers, Ronald M. Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. arXiv preprint arXiv:1705.02315, 2017.

Yao, Li; Poblenz, Eric; Dagunts, Dmitry; Covington, Ben; Bernard, Devon; and Lyman, Kevin. Learning to diagnose from scratch by exploiting dependencies among labels. arXiv preprint arXiv:1710.10501, 2017. https://arxiv.org/pdf/1710.10501.pdf

Hassan, ul Muneeb (2018). VGG16 – Convolutional Network for Classification and Detection. https://neurohive.io/en/popular-networks/vgg16

Hashmi MF, Katiyar S, Keskar AG, Bokde ND, Geem ZW. Efficient Pneumonia Detection in Chest Xray Images Using Deep Transfer Learning. Diagnostics (Basel). 2020;10(6):417. Published 2020 Jun 19. doi:10.3390/diagnostics10060417 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7345724/

Adaloglou, Nikolas (2021). Best deep CNN architectures and their principles: from AlexNet to EfficientNet https://theaisummer.com/cnn-architectures

Rajpurkar P, Irvin J, Zhu K, Yang B, et al. CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning. arXiv:1711.05225

Li, Jiawei; Xu, Zixi; Zhang, Yue (2018). Diagnosing Chest X-ray Diseases with Deep Learning. https://cs230.stanford.edu/files_winter_2018/projects/6908505.pdf

Singh, Sanjay & Khamparia, Aditya & Gupta, Deepak & Tiwari, Prayag & Moreira, Catarina & Damasevicius, Robertas & Albuquerque, Victor. (2020). A Novel Transfer Learning Based Approach for Pneumonia Detection in Chest X-ray Images. Applied Sciences. 10. 559. 10.3390/app10020559. https://www.researchgate.net/publication/338543002_A_Novel_Transfer_Learning_Based_Approach_for_Pneumonia_Detection_in_Chest_X-ray_Images

Rahman, Tawsifur & Chowdhury, Muhammad & Khandakar, Amith & Islam, Khandaker & Islam, Khandaker & Mahbub, Zaid & Kadir, Muhammad & Kashem, Saad. (2020). Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-ray. https://www.researchgate.net/publication/340644618_Transfer_Learning_with_Deep_Convolutional_Neural_Network_CNN_for_Pneumonia_Detection_using_Chest_X-ray

Brownlee, Jason (2020). Random Oversampling and Undersampling for Imbalanced Classification. https://machinelearningmastery.com/random-oversampling-and-undersampling-for-imbalanced-classification/

Zhenjia Yue, Liangping Ma, Runfeng Zhang, "Comparison and Validation of Deep Learning Models for the Diagnosis of Pneumonia", Computational Intelligence and Neuroscience, vol. 2020, Article ID 8876798, 8 pages, 2020. https://doi.org/10.1155/2020/8876798

Published

10-10-2021

How to Cite

Yuan, A. (2021). A Novel Deep Learning Approach for Detection of Pneumonia from Chest X-Rays. Journal of Student Research, 10(3). https://doi.org/10.47611/jsrhs.v10i3.1627

Issue

Section

Research Posters