With the continuous development of medical informatics and digital diagnosis,the classification of tuberculosis(TB)cases from computed tomography(CT)images of the lung based on deep learning is an important guiding ai...With the continuous development of medical informatics and digital diagnosis,the classification of tuberculosis(TB)cases from computed tomography(CT)images of the lung based on deep learning is an important guiding aid in clinical diagnosis and treatment.Due to its potential application in medical image classification,this task has received extensive research attention.Existing related neural network techniques are still challenging in terms of feature extraction of global contextual information of images and network complexity in achieving image classification.To address these issues,this paper proposes a lightweight medical image classification network based on a combination of Transformer and convolutional neural network(CNN)for the classification of TB cases from lung CT.The method mainly consists of a fusion of the CNN module and the Transformer module,exploiting the advantages of both in order to accomplish a more accurate classification task.On the one hand,the CNN branch supplements the Transformer branch with basic local feature information in the low level;on the other hand,in the middle and high levels of the model,the CNN branch can also provide the Transformer architecture with different local and global feature information to the Transformer architecture to enhance the ability of the model to obtain feature information and improve the accuracy of image classification.A shortcut is used in each module of the network to solve the problem of poor model results due to gradient divergence and to optimize the effectiveness of TB classification.The proposed lightweight model can well solve the problem of long training time in the process of TB classification of lung CT and improve the speed of classification.The proposed method was validated on a CT image data set provided by the First Hospital of Lanzhou University.The experimental results show that the proposed lightweight classification network for TB based on CT medical images of lungs can fully extract the feature information of the input images and obtain high-accuracy classification results.展开更多
Tuberculosis is a dangerous disease to human life,and we need a lot of attempts to stop and reverse it.Significantly,in theCOVID-19 pandemic,access to medical services for tuberculosis has become very difficult.The la...Tuberculosis is a dangerous disease to human life,and we need a lot of attempts to stop and reverse it.Significantly,in theCOVID-19 pandemic,access to medical services for tuberculosis has become very difficult.The late detection of tuberculosis could lead to danger to patient health,even death.Vietnamis one of the countries heavily affected by the COVID-19 pandemic,andmany residential areas as well as hospitals have to be isolated for a long time.Reality demands a fast and effective tuberculosis diagnosis solution to deal with the difficulty of accessingmedical services,such as an automatic tuberculosis diagnosis system.In our study,aiming to build that system,we were interested in the tuberculosis diagnosis problem from the chest X-ray images of Vietnamese patients.The chest X-ray image is an important data type to diagnose tuberculosis,and it has also received a lot of attention from deep learning researchers.This paper proposed a novel method for tuberculosis diagnosis and visualization using the deeplearning approach with a large Vietnamese X-ray image dataset.In detail,we designed our custom convolutional neural network for the X-ray image classification task and then analyzed the predicted result to provide visualization as a heat-map.To prove the performance of our network model,we conducted several experiments to compare it to another study and also to evaluate it with the dataset of this research.To support the implementation,we built a specific annotation system for tuberculosis under the requirements of radiologists in the Vietnam National Lung Hospital.A large experiment dataset was also from this hospital,and most of this data was for training the convolutional neural network model.The experiment results were evaluated regarding sensitivity,specificity,and accuracy.We achieved high scores with a training accuracy score of 0.99,and the testing specificity and sensitivity scores were over 0.9.Based on the X-ray image classification result,we visualize prediction results as heat-maps and also analyze them in comparison with annotated symptoms of radiologists.展开更多
文摘With the continuous development of medical informatics and digital diagnosis,the classification of tuberculosis(TB)cases from computed tomography(CT)images of the lung based on deep learning is an important guiding aid in clinical diagnosis and treatment.Due to its potential application in medical image classification,this task has received extensive research attention.Existing related neural network techniques are still challenging in terms of feature extraction of global contextual information of images and network complexity in achieving image classification.To address these issues,this paper proposes a lightweight medical image classification network based on a combination of Transformer and convolutional neural network(CNN)for the classification of TB cases from lung CT.The method mainly consists of a fusion of the CNN module and the Transformer module,exploiting the advantages of both in order to accomplish a more accurate classification task.On the one hand,the CNN branch supplements the Transformer branch with basic local feature information in the low level;on the other hand,in the middle and high levels of the model,the CNN branch can also provide the Transformer architecture with different local and global feature information to the Transformer architecture to enhance the ability of the model to obtain feature information and improve the accuracy of image classification.A shortcut is used in each module of the network to solve the problem of poor model results due to gradient divergence and to optimize the effectiveness of TB classification.The proposed lightweight model can well solve the problem of long training time in the process of TB classification of lung CT and improve the speed of classification.The proposed method was validated on a CT image data set provided by the First Hospital of Lanzhou University.The experimental results show that the proposed lightweight classification network for TB based on CT medical images of lungs can fully extract the feature information of the input images and obtain high-accuracy classification results.
基金funded by the Project KC-4.0.14/19-25“Research on Building a Support System for Diagnosis and Prediction Geo-Spatial Epidemiology of Pulmonary Tuberculosis by Chest X-Ray Images in Vietnam”.
文摘Tuberculosis is a dangerous disease to human life,and we need a lot of attempts to stop and reverse it.Significantly,in theCOVID-19 pandemic,access to medical services for tuberculosis has become very difficult.The late detection of tuberculosis could lead to danger to patient health,even death.Vietnamis one of the countries heavily affected by the COVID-19 pandemic,andmany residential areas as well as hospitals have to be isolated for a long time.Reality demands a fast and effective tuberculosis diagnosis solution to deal with the difficulty of accessingmedical services,such as an automatic tuberculosis diagnosis system.In our study,aiming to build that system,we were interested in the tuberculosis diagnosis problem from the chest X-ray images of Vietnamese patients.The chest X-ray image is an important data type to diagnose tuberculosis,and it has also received a lot of attention from deep learning researchers.This paper proposed a novel method for tuberculosis diagnosis and visualization using the deeplearning approach with a large Vietnamese X-ray image dataset.In detail,we designed our custom convolutional neural network for the X-ray image classification task and then analyzed the predicted result to provide visualization as a heat-map.To prove the performance of our network model,we conducted several experiments to compare it to another study and also to evaluate it with the dataset of this research.To support the implementation,we built a specific annotation system for tuberculosis under the requirements of radiologists in the Vietnam National Lung Hospital.A large experiment dataset was also from this hospital,and most of this data was for training the convolutional neural network model.The experiment results were evaluated regarding sensitivity,specificity,and accuracy.We achieved high scores with a training accuracy score of 0.99,and the testing specificity and sensitivity scores were over 0.9.Based on the X-ray image classification result,we visualize prediction results as heat-maps and also analyze them in comparison with annotated symptoms of radiologists.
