Deep and Lightweight Neural Network for Histopathological Image Classification
DOI:
https://doi.org/10.13052/jmm1550-4646.18619Keywords:
Breast Cancer Classification, Image Classification, BreakHis Dataset, Lightweight Network, medical imageAbstract
Breast cancer is a fatal disease affecting women, and early detection and proper treatment are crucial. Classifying medical images correctly is the first and most important step in the cancer diagnosis stage. Deep learning-based classification methods in various domains demonstrate advances in accuracy.
However, as deep learning improves, the layers of neural networks get deeper, raising challenges, such as overfitting and gradient vanishing. For instance, a medical image is simpler than an ordinary one, making it vulnerable to overfitting issues.
We present breast histopathological classification methods with two deep neural networks, Xception and LightXception with aid of voting schemes over split images. Most deep neural networks classify thousands classes of images, but the breast histopathological image classes are far fewer than those of other image classification tasks. Because the BreakHis dataset is relatively simpler than typical image datasets, such as ImageNet, applying the conventional highly deep neural networks may suffer from the aforementioned overfitting or gradient vanishing problems. Additionally, highly deep neural networks require more resources, leading to high computational costs. Consequently, we propose a new network; LightXception by cutting off layers at the bottom of the Xception network and reducing the number of channels of convolution filters. LightXception has only about 35% of parameters compared to those of the original Xception network with minimal expense on performance. Based on images with 100X magnification factor, the performance comparisons for Xception vs. LightXception are 97.42% vs. 97.31% on classification accuracy, 97.42% vs. 97.42% on recall, and 99.26% vs. 98.67% of precision.
Downloads
References
https://seer.cancer.gov/statfacts/html/breast.html
A. Krizhevsky, I. Sutskever and G. E. Hinton, G. E. Imagenet classification with deep convolutional neural networks. In neural information processing systems, 25:1097–1105, 2012
C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, J and Z. Wojna. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition 2818-2826, 2016.
F. Chollet. Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition, 1251–1258, 2017
K. He, X. Zhang, S. Ren, and Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778, 2016.
C. Szegedy, S. Ioffe, V. Vanhoucke, and V. Alemi. Inception-v4, inception-resnet and the impact of residual connections on learning. In Proceedings of the AAAI Conference on Artificial Intelligence, 31(1), 2017
S. Xie, R. Girshick, P. Dollár, Z. Tu, and K. He. Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, 1492–1500, 2017.
J. Shihadeh, A. Ansari and T. Ozunfunmi. Deep learning based image classification for remote medical diagnosis. In 2018 IEEE Global Humanitarian Technology Conference (GHTC), 1–8, 2018
H. W. Huang, B. W. Y. Hsu, C. H. Lee and V. S. Tseng. Development of a light‐weight deep learning model for cloud applications and remote diagnosis of skin cancers. In The Journal of Dermatology, 48(3):310–316, 2021
M. Tan and Q. Le. Efficientnet: Rethinking model scaling for convolutional neural networks. In International Conference on Machine Learning, 6105–6114, 2019
P. K. Illa, T. S. Kumar and F. S. A. Hussainy. Deep Learning Methods for Lung Cancer Nodule Classification: A Survey. In Journal of Mobile Multimedia, 18(2):421–450, 2021
X. Xu, C. Wang, J. Guo, L. Yang, H. Bai, W. Li, and Z. Yi. DeepLN: a framework for automatic lung nodule detection using multi-resolution CT screening images. In Knowledge-Based Systems, 189:105–128, 2020
M. Tan, F. Wu, B. Yang, J. Ma, D. Kong, Z. Chen and D. Long. Pulmonary nodule detection using hybrid two‐stage 3D CNNs. In Medical physics, 47(8):3376–3388, 2020
F. A. Spanhol, L. S. Oliveira, C. Petitjean and L. Heutte. A dataset for breast cancer histopathological image classification. In IEEE transactions on biomedical engineering, 63(7):1455–1462, 2015.
F. A. Spanhol, L. S. Oliveira, C. Petitjean and L. Heutte. Breast cancer histopathological image classification using convolutional neural networks. In 2016 international joint conference on neural networks (IJCNN), 2560–2567, 2016.
F. A. Spanhol, L. S. Oliveira, P. R. Cavalin, C. Petitjean and L. Heutte. Deep features for breast cancer histopathological image classification. In 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 1868–1873, 2017.
J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng and T. Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. In International conference on machine learning, 647–655, 2014
B. Wei, Z. Han, X. He and Y. Yin. Deep learning model based breast cancer histopathological image classification. In 2017 IEEE 2nd international conference on cloud computing and big data analysis (ICCCBDA), 348–353, 2017.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov and A. Rabinovich. Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition, 1–9, 2015.
A. A. Nahid, M. A. Mehrabi and Y. Kong. Histopathological breast cancer image classification by deep neural network techniques guided by local clustering. In BioMed research international, 2018.
X. Li, X. Shen, Y., Zhou, X. Wang, and T. Q. Li. Classification of breast cancer histopathological images using interleaved DenseNet with SENet (IDSNet). In PloS one, 15(5), 2020.
G. Huang, Z. Liu, L. Van Der Maaten and. K. Q. Weinberger. Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, 4700–4708, 2017.
J. Hu, L, Shen and G. Sun. Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, 7132–7141, 2018
S. H. Kassani, P. H. Kassani, M. J. Wesolowski, K. A. Schneider, K. A and R. Deters. Classification of histopathological biopsy images using ensemble of deep learning networks. In arXiv preprint arXiv:1909.11870, 2019.
K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. In arXiv preprint arXiv:1409.1556, 2014.
A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand and H. Adam. Mobilenets: Efficient convolutional neural networks for mobile vision applications. In arXiv preprint arXiv:1704.04861, 2017.
M. Sandler, A. Howard, M. Zhu, A. Zhmoginov and L. C. Chen, L. C. Mobilenetv2: Inverted residuals and linear bottlenecks. in Proceedings of the IEEE conference on computer vision and pattern recognition, 4510–4520, 2018
