BACKGROUND Hepatocellular carcinoma(HCC)is a prevalent and life-threatening cancer with increasing incidence worldwide.High Ki-67 risk stratification is closely associated with higher recurrence rates and worse outcom...BACKGROUND Hepatocellular carcinoma(HCC)is a prevalent and life-threatening cancer with increasing incidence worldwide.High Ki-67 risk stratification is closely associated with higher recurrence rates and worse outcomes following curative therapies in patients with HCC.However,the performance of radiomic and deep transfer learning(DTL)models derived from biparametric magnetic resonance imaging(bpMRI)in predicting Ki-67 risk stratification and recurrence-free survival(RFS)in patients with HCC remains limited.AIM To develop a nomogram model integrating bpMRI-based radiomic and DTL signatures for predicting Ki-67 risk stratification and RFS in patients with HCC.METHODS This study included 198 patients with histopathologically confirmed HCC who underwent preoperative bpMRI.Ki-67 risk stratification was categorized as high(>20%)or low(≤20%)according to immunohistochemical staining.Radiomic and DTL signatures were extracted from the T2-weighted and arterial-phase images and combined through a random forest algorithm to establish radiomic and DTL models,respectively.Multivariate regression analysis identified clinical risk factors for high Ki-67 risk stratification,and a predictive nomogram model was developed.RESULTS A nonsmooth margin and the absence of an enhanced capsule were independent factors for high Ki-67 risk stratification.The area under the curve(AUC)of the clinical model was 0.77,while those of the radiomic and DTL models were 0.81 and 0.87,respectively,for the prediction of high Ki-67 risk stratification,and the nomogram model achieved a better AUC of 0.92.The median RFS times for patients with high and low Ki-67 risk stratification were 33.00 months and 66.73 months,respectively(P<0.001).Additionally,patients who were predicted to have high Ki-67 risk stratification by the nomogram model had a lower median RFS than those who were predicted to have low Ki-67 risk stratification(33.53 vs 66.74 months,P=0.007).CONCLUSION Our developed nomogram model demonstrated good performance in predicting Ki-67 risk stratification and predicting survival outcomes in patients with HCC.展开更多
The integration of IoT and Deep Learning(DL)has significantly advanced real-time health monitoring and predictive maintenance in prognostic and health management(PHM).Electrocardiograms(ECGs)are widely used for cardio...The integration of IoT and Deep Learning(DL)has significantly advanced real-time health monitoring and predictive maintenance in prognostic and health management(PHM).Electrocardiograms(ECGs)are widely used for cardiovascular disease(CVD)diagnosis,but fluctuating signal patterns make classification challenging.Computer-assisted automated diagnostic tools that enhance ECG signal categorization using sophisticated algorithms and machine learning are helping healthcare practitioners manage greater patient populations.With this motivation,the study proposes a DL framework leveraging the PTB-XL ECG dataset to improve CVD diagnosis.Deep Transfer Learning(DTL)techniques extract features,followed by feature fusion to eliminate redundancy and retain the most informative features.Utilizing the African Vulture Optimization Algorithm(AVOA)for feature selection is more effective than the standard methods,as it offers an ideal balance between exploration and exploitation that results in an optimal set of features,improving classification performance while reducing redundancy.Various machine learning classifiers,including Support Vector Machine(SVM),eXtreme Gradient Boosting(XGBoost),Adaptive Boosting(AdaBoost),and Extreme Learning Machine(ELM),are used for further classification.Additionally,an ensemble model is developed to further improve accuracy.Experimental results demonstrate that the proposed model achieves the highest accuracy of 96.31%,highlighting its effectiveness in enhancing CVD diagnosis.展开更多
Aerodynamic evaluation under multi-condition is indispensable for the design of aircraft,and the requirement for mass data still means a high cost.To address this problem,we propose a novel point-cloud multi-condition...Aerodynamic evaluation under multi-condition is indispensable for the design of aircraft,and the requirement for mass data still means a high cost.To address this problem,we propose a novel point-cloud multi-condition aerodynamics transfer learning(PCMCA-TL)framework that enables aerodynamic prediction in data-scarce sce-narios by transferring knowledge from well-learned scenarios.We modified the PointNeXt segmentation archi-tecture to a PointNeXtReg+regression model,including a working condition input module.The model is first pre-trained on a public dataset with 2000 shapes but only one working condition and then fine-tuned on a multi-condition small-scale spaceplane dataset.The effectiveness of the PCMCA-TL framework is verified by comparing the pressure coefficients predicted by direct training,pre-training,and TL models.Furthermore,by comparing the aerodynamic force coefficients calculated by predicted pressure coefficients in seconds with the correspond-ing CFD results obtained in hours,the accuracy highlights the development potential of deep transfer learning in aerodynamic evaluation.展开更多
Pneumonia ranks as a leading cause of mortality, particularly in children aged five and under. Detecting this disease typically requires radiologists to examine chest X-rays and report their findings to physicians, a ...Pneumonia ranks as a leading cause of mortality, particularly in children aged five and under. Detecting this disease typically requires radiologists to examine chest X-rays and report their findings to physicians, a task susceptible to human error. The application of Deep Transfer Learning (DTL) for the identification of pneumonia through chest X-rays is hindered by a shortage of available images, which has led to less than optimal DTL performance and issues with overfitting. Overfitting is characterized by a model’s learning that is too closely fitted to the training data, reducing its effectiveness on unseen data. The problem of overfitting is especially prevalent in medical image processing due to the high costs and extensive time required for image annotation, as well as the challenge of collecting substantial datasets that also respect patient privacy concerning infectious diseases such as pneumonia. To mitigate these challenges, this paper introduces the use of conditional generative adversarial networks (CGAN) to enrich the pneumonia dataset with 2690 synthesized X-ray images of the minority class, aiming to even out the dataset distribution for improved diagnostic performance. Subsequently, we applied four modified lightweight deep transfer learning models such as Xception, MobileNetV2, MobileNet, and EfficientNetB0. These models have been fine-tuned and evaluated, demonstrating remarkable detection accuracies of 99.26%, 98.23%, 97.06%, and 94.55%, respectively, across fifty epochs. The experimental results validate that the models we have proposed achieve high detection accuracy rates, with the best model reaching up to 99.26% effectiveness, outperforming other models in the diagnosis of pneumonia from X-ray images.展开更多
Mobile technology is developing significantly.Mobile phone technologies have been integrated into the healthcare industry to help medical practitioners.Typically,computer vision models focus on image detection and cla...Mobile technology is developing significantly.Mobile phone technologies have been integrated into the healthcare industry to help medical practitioners.Typically,computer vision models focus on image detection and classification issues.MobileNetV2 is a computer vision model that performs well on mobile devices,but it requires cloud services to process biometric image information and provide predictions to users.This leads to increased latency.Processing biometrics image datasets on mobile devices will make the prediction faster,but mobiles are resource-restricted devices in terms of storage,power,and computational speed.Hence,a model that is small in size,efficient,and has good prediction quality for biometrics image classification problems is required.Quantizing pre-trained CNN(PCNN)MobileNetV2 architecture combined with a Support Vector Machine(SVM)compacts the model representation and reduces the computational cost and memory requirement.This proposed novel approach combines quantized pre-trained CNN(PCNN)MobileNetV2 architecture with a Support Vector Machine(SVM)to represent models efficiently with low computational cost and memory.Our contributions include evaluating three CNN models for ocular disease identification in transfer learning and deep feature plus SVM approaches,showing the superiority of deep features from MobileNetV2 and SVM classification models,comparing traditional methods,exploring six ocular diseases and normal classification with 20,111 images postdata augmentation,and reducing the number of trainable models.The model is trained on ocular disorder retinal fundus image datasets according to the severity of six age-related macular degeneration(AMD),one of the most common eye illnesses,Cataract,Diabetes,Glaucoma,Hypertension,andMyopia with one class Normal.From the experiment outcomes,it is observed that the suggested MobileNetV2-SVM model size is compressed.The testing accuracy for MobileNetV2-SVM,InceptionV3,and MobileNetV2 is 90.11%,86.88%,and 89.76%respectively while MobileNetV2-SVM,InceptionV3,and MobileNetV2 accuracy are observed to be 92.59%,83.38%,and 90.16%,respectively.The proposed novel technique can be used to classify all biometric medical image datasets on mobile devices.展开更多
Background The prognosis and survival of patients with lung cancer are likely to deteriorate with metastasis.Using deep-learning in the detection of lymph node metastasis can facilitate the noninvasive calculation of ...Background The prognosis and survival of patients with lung cancer are likely to deteriorate with metastasis.Using deep-learning in the detection of lymph node metastasis can facilitate the noninvasive calculation of the likelihood of such metastasis,thereby providing clinicians with crucial information to enhance diagnostic precision and ultimately improve patient survival and prognosis.Methods In total,623 eligible patients were recruited from two medical institutions.Seven deep learning models,namely Alex,GoogLeNet,Resnet18,Resnet101,Vgg16,Vgg19,and MobileNetv3(small),were utilized to extract deep image histological features.The dimensionality of the extracted features was then reduced using the Spearman correlation coefficient(r≥0.9)and Least Absolute Shrinkage and Selection Operator.Eleven machine learning methods,namely Support Vector Machine,K-nearest neighbor,Random Forest,Extra Trees,XGBoost,LightGBM,Naive Bayes,AdaBoost,Gradient Boosting Decision Tree,Linear Regression,and Multilayer Perceptron,were employed to construct classification prediction models for the filtered final features.The diagnostic performances of the models were assessed using various metrics,including accuracy,area under the receiver operating characteristic curve,sensitivity,specificity,positive predictive value,and negative predictive value.Calibration and decision-curve analyses were also performed.Results The present study demonstrated that using deep radiomic features extracted from Vgg16,in conjunction with a prediction model constructed via a linear regression algorithm,effectively distinguished the status of mediastinal lymph nodes in patients with lung cancer.The performance of the model was evaluated based on various metrics,including accuracy,area under the receiver operating characteristic curve,sensitivity,specificity,positive predictive value,and negative predictive value,which yielded values of 0.808,0.834,0.851,0.745,0.829,and 0.776,respectively.The validation set of the model was assessed using clinical decision curves,calibration curves,and confusion matrices,which collectively demonstrated the model's stability and accuracy.Conclusion In this study,information on the deep radiomics of Vgg16 was obtained from computed tomography images,and the linear regression method was able to accurately diagnose mediastinal lymph node metastases in patients with lung cancer.展开更多
This paper investigates the problem of data scarcity in spectrum prediction.A cognitive radio equipment may frequently switch the target frequency as the electromagnetic environment changes.The previously trained mode...This paper investigates the problem of data scarcity in spectrum prediction.A cognitive radio equipment may frequently switch the target frequency as the electromagnetic environment changes.The previously trained model for prediction often cannot maintain a good performance when facing small amount of historical data of the new target frequency.Moreover,the cognitive radio equipment usually implements the dynamic spectrum access in real time which means the time to recollect the data of the new task frequency band and retrain the model is very limited.To address the above issues,we develop a crossband data augmentation framework for spectrum prediction by leveraging the recent advances of generative adversarial network(GAN)and deep transfer learning.Firstly,through the similarity measurement,we pre-train a GAN model using the historical data of the frequency band that is the most similar to the target frequency band.Then,through the data augmentation by feeding the small amount of the target data into the pre-trained GAN,temporal-spectral residual network is further trained using deep transfer learning and the generated data with high similarity from GAN.Finally,experiment results demonstrate the effectiveness of the proposed framework.展开更多
In recent years,the field of deep learning has played an important role towards automatic detection and classification of diseases in vegetables and fruits.This in turn has helped in improving the quality and producti...In recent years,the field of deep learning has played an important role towards automatic detection and classification of diseases in vegetables and fruits.This in turn has helped in improving the quality and production of vegetables and fruits.Citrus fruits arewell known for their taste and nutritional values.They are one of the natural and well known sources of vitamin C and planted worldwide.There are several diseases which severely affect the quality and yield of citrus fruits.In this paper,a new deep learning based technique is proposed for citrus disease classification.Two different pre-trained deep learning models have been used in this work.To increase the size of the citrus dataset used in this paper,image augmentation techniques are used.Moreover,to improve the visual quality of images,hybrid contrast stretching has been adopted.In addition,transfer learning is used to retrain the pre-trainedmodels and the feature set is enriched by using feature fusion.The fused feature set is optimized using a meta-heuristic algorithm,the Whale Optimization Algorithm(WOA).The selected features are used for the classification of six different diseases of citrus plants.The proposed technique attains a classification accuracy of 95.7%with superior results when compared with recent techniques.展开更多
Spectrum prediction is a promising technology to infer future spectrum state by exploiting inherent patterns of historical spectrum data.In practice,for a given spectrum band of interest,when facing relatively scarce ...Spectrum prediction is a promising technology to infer future spectrum state by exploiting inherent patterns of historical spectrum data.In practice,for a given spectrum band of interest,when facing relatively scarce historical data,spectrum prediction based on traditional learning methods does not work well.Thus,this paper proposes a cross-band spectrum prediction model based on transfer learning.Firstly,by analysing service activities and computing the distances between various frequency points based on Dynamic Time Warping,the similarity between spectrum bands has been verified.Next,the features,which mainly affect the performance of transfer learning in the crossband spectrum prediction,are explored by leveraging transfer component analysis.Then,the effectiveness of transfer learning for the cross-band spectrum prediction has been demonstrated.Further,experimental results with real-world spectrum data demonstrate that the performance of the proposed model is better than the state-of-theart models when the historical spectrum data is limited.展开更多
The state of health(SOH)is a critical factor in evaluating the performance of the lithium-ion batteries(LIBs).Due to various end-user behaviors,the LIBs exhibit different degradation modes,which makes it challenging t...The state of health(SOH)is a critical factor in evaluating the performance of the lithium-ion batteries(LIBs).Due to various end-user behaviors,the LIBs exhibit different degradation modes,which makes it challenging to estimate the SOHs in a personalized way.In this article,we present a novel particle swarm optimization-assisted deep domain adaptation(PSO-DDA)method to estimate the SOH of LIBs in a personalized manner,where a new domain adaptation strategy is put forward to reduce cross-domain distribution discrepancy.The standard PSO algorithm is exploited to automatically adjust the chosen hyperparameters of developed DDA-based method.The proposed PSODDA method is validated by extensive experiments on two LIB datasets with different battery chemistry materials,ambient temperatures and charge-discharge configurations.Experimental results indicate that the proposed PSO-DDA method surpasses the convolutional neural network-based method and the standard DDA-based method.The Py Torch implementation of the proposed PSO-DDA method is available at https://github.com/mxt0607/PSO-DDA.展开更多
The identification of DNA binding proteins(DNABPs)is considered a major challenge in genome annotation because they are linked to several important applied and research applications of cellular functions e.g.,in the s...The identification of DNA binding proteins(DNABPs)is considered a major challenge in genome annotation because they are linked to several important applied and research applications of cellular functions e.g.,in the study of the biological,biophysical,and biochemical effects of antibiotics,drugs,and steroids on DNA.This paper presents an efficient approach for DNABPs identification based on deep transfer learning,named“DTLM-DBP.”Two transfer learning methods are used in the identification process.The first is based on the pre-trained deep learning model as a feature’s extractor and classifier.Two different pre-trained Convolutional Neural Networks(CNN),AlexNet 8 and VGG 16,are tested and compared.The second method uses the deep learning model as a feature’s extractor only and two different classifiers for the identification process.Two classifiers,Support Vector Machine(SVM)and Random Forest(RF),are tested and compared.The proposed approach is tested using different DNA proteins datasets.The performance of the identification process is evaluated in terms of identification accuracy,sensitivity,specificity and MCC,with four available DNA proteins datasets:PDB1075,PDB186,PDNA-543,and PDNA-316.The results show that the RF classifier,with VGG-Net pre-trained deep transfer learning features,gives the highest performance.DTLM-DBP was compared with other published methods and it provides a considerable improvement in the performance of DNABPs identification.展开更多
Colorectal carcinoma(CRC)is one such dispersed cancer globally and also prominent one in causing cancer-based death.Conventionally,pathologists execute CRC diagnosis through visible scrutinizing under the microscope t...Colorectal carcinoma(CRC)is one such dispersed cancer globally and also prominent one in causing cancer-based death.Conventionally,pathologists execute CRC diagnosis through visible scrutinizing under the microscope the resected tissue samples,stained and fixed through Haematoxylin and Eosin(H&E).The advancement of graphical processing systems has resulted in high potentiality for deep learning(DL)techniques in interpretating visual anatomy from high resolution medical images.This study develops a slime mould algorithm with deep transfer learning enabled colorectal cancer detection and classification(SMADTL-CCDC)algorithm.The presented SMADTL-CCDC technique intends to appropriately recognize the occurrence of colorectal cancer.To accomplish this,the SMADTLCCDC model initially undergoes pre-processing to improve the input image quality.In addition,a dense-EfficientNet technique was employed to extract feature vectors from the pre-processed images.Moreover,SMA with Discrete Hopfield neural network(DHNN)method was applied for the recognition and classification of colorectal cancer.The utilization of SMA assists in appropriately selecting the parameters involved in the DHNN approach.A wide range of experiments was implemented on benchmark datasets to assess the classification performance.A comprehensive comparative study highlighted the better performance of the SMADTL-CDC model over the recent approaches.展开更多
Osteosarcoma is a type of malignant bone tumor that is reported across the globe.Recent advancements in Machine Learning(ML)and Deep Learning(DL)models enable the detection and classification of malignancies in biomed...Osteosarcoma is a type of malignant bone tumor that is reported across the globe.Recent advancements in Machine Learning(ML)and Deep Learning(DL)models enable the detection and classification of malignancies in biomedical images.In this regard,the current study introduces a new Biomedical Osteosarcoma Image Classification using Elephant Herd Optimization and Deep Transfer Learning(BOIC-EHODTL)model.The presented BOIC-EHODTL model examines the biomedical images to diagnose distinct kinds of osteosarcoma.At the initial stage,Gabor Filter(GF)is applied as a pre-processing technique to get rid of the noise from images.In addition,Adam optimizer with MixNet model is also employed as a feature extraction technique to generate feature vectors.Then,EHOalgorithm is utilized along with Adaptive Neuro-Fuzzy Classifier(ANFC)model for recognition and categorization of osteosarcoma.EHO algorithm is utilized to fine-tune the parameters involved in ANFC model which in turn helps in accomplishing improved classification results.The design of EHO with ANFC model for classification of osteosarcoma is the novelty of current study.In order to demonstrate the improved performance of BOIC-EHODTL model,a comprehensive comparison was conducted between the proposed and existing models upon benchmark dataset and the results confirmed the better performance of BOIC-EHODTL model over recent methodologies.展开更多
Humankind is facing another deadliest pandemic of all times in history,caused by COVID-19.Apart from this challenging pandemic,World Health Organization(WHO)considers tuberculosis(TB)as a preeminent infectious disease...Humankind is facing another deadliest pandemic of all times in history,caused by COVID-19.Apart from this challenging pandemic,World Health Organization(WHO)considers tuberculosis(TB)as a preeminent infectious disease due to its high infection rate.Generally,both TB and COVID-19 severely affect the lungs,thus hardening the job of medical practitioners who can often misidentify these diseases in the current situation.Therefore,the time of need calls for an immediate and meticulous automatic diagnostic tool that can accurately discriminate both diseases.As one of the preliminary smart health systems that examine three clinical states(COVID-19,TB,and normal cases),this study proposes an amalgam of image filtering,data-augmentation technique,transfer learning-based approach,and advanced deep-learning classifiers to effectively segregate these diseases.It first employed a generative adversarial network(GAN)and Crimmins speckle removal filter on X-ray images to overcome the issue of limited data and noise.Each pre-processed image is then converted into red,green,and blue(RGB)and Commission Internationale de l’Elcairage(CIE)color spaces from which deep fused features are formed by extracting relevant features using DenseNet121 and ResNet50.Each feature extractor extracts 1000 most useful features which are then fused and finally fed to two variants of recurrent neural network(RNN)classifiers for precise discrimination of threeclinical states.Comparative analysis showed that the proposed Bi-directional long-short-term-memory(Bi-LSTM)model dominated the long-short-termmemory(LSTM)network by attaining an overall accuracy of 98.22%for the three-class classification task,whereas LSTM hardly achieved 94.22%accuracy on the test dataset.展开更多
At present days,object detection and tracking concepts have gained more importance among researchers and business people.Presently,deep learning(DL)approaches have been used for object tracking as it increases the per...At present days,object detection and tracking concepts have gained more importance among researchers and business people.Presently,deep learning(DL)approaches have been used for object tracking as it increases the perfor-mance and speed of the tracking process.This paper presents a novel robust DL based object detection and tracking algorithm using Automated Image Anno-tation with ResNet based Faster regional convolutional neural network(R-CNN)named(AIA-FRCNN)model.The AIA-RFRCNN method performs image anno-tation using a Discriminative Correlation Filter(DCF)with Channel and Spatial Reliability tracker(CSR)called DCF-CSRT model.The AIA-RFRCNN model makes use of Faster RCNN as an object detector and tracker,which involves region proposal network(RPN)and Fast R-CNN.The RPN is a full convolution network that concurrently predicts the bounding box and score of different objects.The RPN is a trained model used for the generation of the high-quality region proposals,which are utilized by Fast R-CNN for detection process.Besides,Residual Network(ResNet 101)model is used as a shared convolutional neural network(CNN)for the generation of feature maps.The performance of the ResNet 101 model is further improved by the use of Adam optimizer,which tunes the hyperparameters namely learning rate,batch size,momentum,and weight decay.Finally,softmax layer is applied to classify the images.The performance of the AIA-RFRCNN method has been assessed using a benchmark dataset and a detailed comparative analysis of the results takes place.The outcome of the experiments indicated the superior characteristics of the AIA-RFRCNN model under diverse aspects.展开更多
The success of deep transfer learning in fault diagnosis is attributed to the collection of high-quality labeled data from the source domain.However,in engineering scenarios,achieving such high-quality label annotatio...The success of deep transfer learning in fault diagnosis is attributed to the collection of high-quality labeled data from the source domain.However,in engineering scenarios,achieving such high-quality label annotation is difficult and expensive.The incorrect label annotation produces two negative effects:1)the complex decision boundary of diagnosis models lowers the generalization performance on the target domain,and2)the distribution of target domain samples becomes misaligned with the false-labeled samples.To overcome these negative effects,this article proposes a solution called the label recovery and trajectory designable network(LRTDN).LRTDN consists of three parts.First,a residual network with dual classifiers is to learn features from cross-domain samples.Second,an annotation check module is constructed to generate a label anomaly indicator that could modify the abnormal labels of false-labeled samples in the source domain.With the training of relabeled samples,the complexity of diagnosis model is reduced via semi-supervised learning.Third,the adaptation trajectories are designed for sample distributions across domains.This ensures that the target domain samples are only adapted with the pure-labeled samples.The LRTDN is verified by two case studies,in which the diagnosis knowledge of bearings is transferred across different working conditions as well as different yet related machines.The results show that LRTDN offers a high diagnosis accuracy even in the presence of incorrect annotation.展开更多
Background:Pneumothorax is a medical emergency caused by the abnormal accumulation of air in the pleural space—the potential space between the lungs and chest wall.On 2D chest radiographs,pneumothorax occurs within t...Background:Pneumothorax is a medical emergency caused by the abnormal accumulation of air in the pleural space—the potential space between the lungs and chest wall.On 2D chest radiographs,pneumothorax occurs within the thoracic cavity and outside of the mediastinum,and we refer to this area as“lung+space.”While deep learning(DL)has increasingly been utilized to segment pneumothorax lesions in chest radiographs,many existing DL models employ an end-to-end approach.These models directly map chest radiographs to clinician-annotated lesion areas,often neglecting the vital domain knowl-edge that pneumothorax is inherently location-sensitive.Methods:We propose a novel approach that incorporates the lung+space as a constraint during DL model training for pneumothorax segmentation on 2D chest radiographs.To circumvent the need for additional annotations and to prevent potential label leakage on the target task,our method utilizes external datasets and an auxiliary task of lung segmentation.This approach generates a specific constraint of lung+space for each chest radiograph.Furthermore,we have incorporated a discriminator to eliminate unreliable constraints caused by the domain shift between the auxiliary and target datasets.Results:Our results demonstrated considerable improvements,with average performance gains of 4.6%,3.6%,and 3.3%regarding intersection over union,dice similarity coefficient,and Hausdorff distance.These results were con-sistent across six baseline models built on three architectures(U-Net,LinkNet,or PSPNet)and two backbones(VGG-11 or MobileOne-S0).We further con-ducted an ablation study to evaluate the contribution of each component in the proposed method and undertook several robustness studies on hyper-parameter selection to validate the stability of our method.Conclusions:The integration of domain knowledge in DL models for medical applications has often been underemphasized.Our research underscores the significance of incorporating medical domain knowledge about the location-specific nature of pneumothorax to enhance DL-based lesion segmentation and further bolster clinicians'trust in DL tools.Beyond pneumothorax,our approach is promising for other thoracic conditions that possess location-relevant characteristics.展开更多
Gas-insulated switchgear(GIS)plays a critical role in ensuring the reliability of power systems,but partial discharge(PD)is a primary cause of failures within GIS equipment.Traditional PD diagnostic methods rely heavi...Gas-insulated switchgear(GIS)plays a critical role in ensuring the reliability of power systems,but partial discharge(PD)is a primary cause of failures within GIS equipment.Traditional PD diagnostic methods rely heavily on laboratory data,which differ signifi-cantly from that under the complex conditions of field data,leading to a marked drop in recognition accuracy when they are applied to field PD diagnosis.This study addresses the challenge by integrating field data into the training process,utilising a deep transfer learning approach that combines laboratory and field data to improve diagnostic accuracy for GIS PD.The research collected PD data from laboratory models representing five defect types and field data gathered from operational GIS equipment.A deep residual network(ResNet50)was pretrained using laboratory data and fine-tuned with field data through deep transfer learning to optimise the recognition of PD in field conditions.The results show that the proposed model achieves a significantly higher recognition accuracy(93.7%)for field data compared to traditional methods(60%-70%).The integration of deep transfer learning ensures that both low-dimensional general features from labora-tory data and high-dimensional specific features from field data are effectively utilised.This research significantly contributes to improving the diagnostic accuracy of PD in GIS under field conditions,providing a robust method for defect detection in operational equipment.展开更多
The agricultural sector,a cornerstone of economies worldwide,faces significant challenges due to plant diseases,which severely affect crop yield and quality.Early and accurate detection of these diseases is crucial fo...The agricultural sector,a cornerstone of economies worldwide,faces significant challenges due to plant diseases,which severely affect crop yield and quality.Early and accurate detection of these diseases is crucial for effective mitigation strategies.The current methods used often lack accuracy and adaptability,especially in diverse environmental conditions.This study introduces a novel,synergistic approach that integrates deep transfer learning with multimodal techniques,specifically canny edges,colour spectrum intensity analysis,and custom data augmentation strategies.Unlike existing methods that rely solely on pre-trained models,the approach utilised in this study offers an innovative fusion of distinct feature extraction techniques.The canny edges highlighted the structural intricacies of leaf diseases,while colour spectrum intensity analysis enhanced the detection of disease-specific colour markers.The customized data augmentation techniques employed(in the study)was shown to enhance the learning process of the models,resulting in their adaptability to diverse agricultural environments.This integration applied to DenseNet201 and EfficientNetB3,achieved detection accuracies of 99.03%and 98.23%,respectively,surpassing traditional models and setting new benchmarks in plant disease detection.These results demonstrate the effectiveness of the proposed multi-faceted approach and its potential to significantly enhance crop disease management systems.展开更多
The change of working conditions not only makes the data distribution inconsistent,but also increases the diagnosis difficulty of fuzzy samples at the fault boundary.The traditional distance-based deep metric learning...The change of working conditions not only makes the data distribution inconsistent,but also increases the diagnosis difficulty of fuzzy samples at the fault boundary.The traditional distance-based deep metric learning cannot effectively classify the fuzzy samples at the fault boundary.In the traditional transfer learning models,the maximum mean discrepancy(MMD)and joint maximum mean discrepancy only increase the transferability of same-class samples,and neglect the discriminability of different-class samples across different domains.The discriminative joint probability MMD(DJP-MMD)increases the transferability of same-class samples and the discriminability of different-class samples across different domains,but it only considers the global transferability of all fault classes,ignoring the different transferability of each same fault class.Therefore,a Yu norm-based deep transfer metric learning based on weighted DJP-MMD is proposed to further improve the diagnosis accuracy of bearings under variable working conditions.The deep transfer metric learning model adopts the Yu norm-based similarity instead of the distance-based similarity to effectively classify the data samples,especially those at the fault boundary,and uses the weighted DJP-MMD to measure the data distribution discrepancy between the source and target domains to increase the transferability of each same-class samples and discriminability of different-class samples across different domains.Through the fault diagnosis analysis on bearings under variable working conditions,the diagnosis results demonstrate that the proposed deep transfer metric learning model can diagnose bearing faults with higher accuracy,stronger generalization and anti-noise capabilities compared with other fault diagnosis methods based on transfer learning.展开更多
基金Supported by Clinical Trials from the Third Affiliated Hospital of Soochow University,No.2024-156Changzhou Science and Technology Program,No.CJ20244017。
文摘BACKGROUND Hepatocellular carcinoma(HCC)is a prevalent and life-threatening cancer with increasing incidence worldwide.High Ki-67 risk stratification is closely associated with higher recurrence rates and worse outcomes following curative therapies in patients with HCC.However,the performance of radiomic and deep transfer learning(DTL)models derived from biparametric magnetic resonance imaging(bpMRI)in predicting Ki-67 risk stratification and recurrence-free survival(RFS)in patients with HCC remains limited.AIM To develop a nomogram model integrating bpMRI-based radiomic and DTL signatures for predicting Ki-67 risk stratification and RFS in patients with HCC.METHODS This study included 198 patients with histopathologically confirmed HCC who underwent preoperative bpMRI.Ki-67 risk stratification was categorized as high(>20%)or low(≤20%)according to immunohistochemical staining.Radiomic and DTL signatures were extracted from the T2-weighted and arterial-phase images and combined through a random forest algorithm to establish radiomic and DTL models,respectively.Multivariate regression analysis identified clinical risk factors for high Ki-67 risk stratification,and a predictive nomogram model was developed.RESULTS A nonsmooth margin and the absence of an enhanced capsule were independent factors for high Ki-67 risk stratification.The area under the curve(AUC)of the clinical model was 0.77,while those of the radiomic and DTL models were 0.81 and 0.87,respectively,for the prediction of high Ki-67 risk stratification,and the nomogram model achieved a better AUC of 0.92.The median RFS times for patients with high and low Ki-67 risk stratification were 33.00 months and 66.73 months,respectively(P<0.001).Additionally,patients who were predicted to have high Ki-67 risk stratification by the nomogram model had a lower median RFS than those who were predicted to have low Ki-67 risk stratification(33.53 vs 66.74 months,P=0.007).CONCLUSION Our developed nomogram model demonstrated good performance in predicting Ki-67 risk stratification and predicting survival outcomes in patients with HCC.
基金funded by Researchers Supporting ProjectNumber(RSPD2025R947),King Saud University,Riyadh,Saudi Arabia.
文摘The integration of IoT and Deep Learning(DL)has significantly advanced real-time health monitoring and predictive maintenance in prognostic and health management(PHM).Electrocardiograms(ECGs)are widely used for cardiovascular disease(CVD)diagnosis,but fluctuating signal patterns make classification challenging.Computer-assisted automated diagnostic tools that enhance ECG signal categorization using sophisticated algorithms and machine learning are helping healthcare practitioners manage greater patient populations.With this motivation,the study proposes a DL framework leveraging the PTB-XL ECG dataset to improve CVD diagnosis.Deep Transfer Learning(DTL)techniques extract features,followed by feature fusion to eliminate redundancy and retain the most informative features.Utilizing the African Vulture Optimization Algorithm(AVOA)for feature selection is more effective than the standard methods,as it offers an ideal balance between exploration and exploitation that results in an optimal set of features,improving classification performance while reducing redundancy.Various machine learning classifiers,including Support Vector Machine(SVM),eXtreme Gradient Boosting(XGBoost),Adaptive Boosting(AdaBoost),and Extreme Learning Machine(ELM),are used for further classification.Additionally,an ensemble model is developed to further improve accuracy.Experimental results demonstrate that the proposed model achieves the highest accuracy of 96.31%,highlighting its effectiveness in enhancing CVD diagnosis.
基金supported by the Natural Science Foundation of Hunan Province of China(Grant No.2021JJ10045).
文摘Aerodynamic evaluation under multi-condition is indispensable for the design of aircraft,and the requirement for mass data still means a high cost.To address this problem,we propose a novel point-cloud multi-condition aerodynamics transfer learning(PCMCA-TL)framework that enables aerodynamic prediction in data-scarce sce-narios by transferring knowledge from well-learned scenarios.We modified the PointNeXt segmentation archi-tecture to a PointNeXtReg+regression model,including a working condition input module.The model is first pre-trained on a public dataset with 2000 shapes but only one working condition and then fine-tuned on a multi-condition small-scale spaceplane dataset.The effectiveness of the PCMCA-TL framework is verified by comparing the pressure coefficients predicted by direct training,pre-training,and TL models.Furthermore,by comparing the aerodynamic force coefficients calculated by predicted pressure coefficients in seconds with the correspond-ing CFD results obtained in hours,the accuracy highlights the development potential of deep transfer learning in aerodynamic evaluation.
文摘Pneumonia ranks as a leading cause of mortality, particularly in children aged five and under. Detecting this disease typically requires radiologists to examine chest X-rays and report their findings to physicians, a task susceptible to human error. The application of Deep Transfer Learning (DTL) for the identification of pneumonia through chest X-rays is hindered by a shortage of available images, which has led to less than optimal DTL performance and issues with overfitting. Overfitting is characterized by a model’s learning that is too closely fitted to the training data, reducing its effectiveness on unseen data. The problem of overfitting is especially prevalent in medical image processing due to the high costs and extensive time required for image annotation, as well as the challenge of collecting substantial datasets that also respect patient privacy concerning infectious diseases such as pneumonia. To mitigate these challenges, this paper introduces the use of conditional generative adversarial networks (CGAN) to enrich the pneumonia dataset with 2690 synthesized X-ray images of the minority class, aiming to even out the dataset distribution for improved diagnostic performance. Subsequently, we applied four modified lightweight deep transfer learning models such as Xception, MobileNetV2, MobileNet, and EfficientNetB0. These models have been fine-tuned and evaluated, demonstrating remarkable detection accuracies of 99.26%, 98.23%, 97.06%, and 94.55%, respectively, across fifty epochs. The experimental results validate that the models we have proposed achieve high detection accuracy rates, with the best model reaching up to 99.26% effectiveness, outperforming other models in the diagnosis of pneumonia from X-ray images.
文摘Mobile technology is developing significantly.Mobile phone technologies have been integrated into the healthcare industry to help medical practitioners.Typically,computer vision models focus on image detection and classification issues.MobileNetV2 is a computer vision model that performs well on mobile devices,but it requires cloud services to process biometric image information and provide predictions to users.This leads to increased latency.Processing biometrics image datasets on mobile devices will make the prediction faster,but mobiles are resource-restricted devices in terms of storage,power,and computational speed.Hence,a model that is small in size,efficient,and has good prediction quality for biometrics image classification problems is required.Quantizing pre-trained CNN(PCNN)MobileNetV2 architecture combined with a Support Vector Machine(SVM)compacts the model representation and reduces the computational cost and memory requirement.This proposed novel approach combines quantized pre-trained CNN(PCNN)MobileNetV2 architecture with a Support Vector Machine(SVM)to represent models efficiently with low computational cost and memory.Our contributions include evaluating three CNN models for ocular disease identification in transfer learning and deep feature plus SVM approaches,showing the superiority of deep features from MobileNetV2 and SVM classification models,comparing traditional methods,exploring six ocular diseases and normal classification with 20,111 images postdata augmentation,and reducing the number of trainable models.The model is trained on ocular disorder retinal fundus image datasets according to the severity of six age-related macular degeneration(AMD),one of the most common eye illnesses,Cataract,Diabetes,Glaucoma,Hypertension,andMyopia with one class Normal.From the experiment outcomes,it is observed that the suggested MobileNetV2-SVM model size is compressed.The testing accuracy for MobileNetV2-SVM,InceptionV3,and MobileNetV2 is 90.11%,86.88%,and 89.76%respectively while MobileNetV2-SVM,InceptionV3,and MobileNetV2 accuracy are observed to be 92.59%,83.38%,and 90.16%,respectively.The proposed novel technique can be used to classify all biometric medical image datasets on mobile devices.
基金the Science and Technology Funding Project of Hunan Province,China(2023JJ50410)(HX)Key Laboratory of Tumor Precision Medicine,Hunan colleges and Universities Project(2019-379)(QL).
文摘Background The prognosis and survival of patients with lung cancer are likely to deteriorate with metastasis.Using deep-learning in the detection of lymph node metastasis can facilitate the noninvasive calculation of the likelihood of such metastasis,thereby providing clinicians with crucial information to enhance diagnostic precision and ultimately improve patient survival and prognosis.Methods In total,623 eligible patients were recruited from two medical institutions.Seven deep learning models,namely Alex,GoogLeNet,Resnet18,Resnet101,Vgg16,Vgg19,and MobileNetv3(small),were utilized to extract deep image histological features.The dimensionality of the extracted features was then reduced using the Spearman correlation coefficient(r≥0.9)and Least Absolute Shrinkage and Selection Operator.Eleven machine learning methods,namely Support Vector Machine,K-nearest neighbor,Random Forest,Extra Trees,XGBoost,LightGBM,Naive Bayes,AdaBoost,Gradient Boosting Decision Tree,Linear Regression,and Multilayer Perceptron,were employed to construct classification prediction models for the filtered final features.The diagnostic performances of the models were assessed using various metrics,including accuracy,area under the receiver operating characteristic curve,sensitivity,specificity,positive predictive value,and negative predictive value.Calibration and decision-curve analyses were also performed.Results The present study demonstrated that using deep radiomic features extracted from Vgg16,in conjunction with a prediction model constructed via a linear regression algorithm,effectively distinguished the status of mediastinal lymph nodes in patients with lung cancer.The performance of the model was evaluated based on various metrics,including accuracy,area under the receiver operating characteristic curve,sensitivity,specificity,positive predictive value,and negative predictive value,which yielded values of 0.808,0.834,0.851,0.745,0.829,and 0.776,respectively.The validation set of the model was assessed using clinical decision curves,calibration curves,and confusion matrices,which collectively demonstrated the model's stability and accuracy.Conclusion In this study,information on the deep radiomics of Vgg16 was obtained from computed tomography images,and the linear regression method was able to accurately diagnose mediastinal lymph node metastases in patients with lung cancer.
基金This work was supported by the Science and Technology Innovation 2030-Key Project of“New Generation Artificial Intelligence”of China under Grant 2018AAA0102303the Natural Science Foundation for Distinguished Young Scholars of Jiangsu Province(No.BK20190030)the National Natural Science Foundation of China(No.61631020,No.61871398,No.61931011 and No.U20B2038).
文摘This paper investigates the problem of data scarcity in spectrum prediction.A cognitive radio equipment may frequently switch the target frequency as the electromagnetic environment changes.The previously trained model for prediction often cannot maintain a good performance when facing small amount of historical data of the new target frequency.Moreover,the cognitive radio equipment usually implements the dynamic spectrum access in real time which means the time to recollect the data of the new task frequency band and retrain the model is very limited.To address the above issues,we develop a crossband data augmentation framework for spectrum prediction by leveraging the recent advances of generative adversarial network(GAN)and deep transfer learning.Firstly,through the similarity measurement,we pre-train a GAN model using the historical data of the frequency band that is the most similar to the target frequency band.Then,through the data augmentation by feeding the small amount of the target data into the pre-trained GAN,temporal-spectral residual network is further trained using deep transfer learning and the generated data with high similarity from GAN.Finally,experiment results demonstrate the effectiveness of the proposed framework.
文摘In recent years,the field of deep learning has played an important role towards automatic detection and classification of diseases in vegetables and fruits.This in turn has helped in improving the quality and production of vegetables and fruits.Citrus fruits arewell known for their taste and nutritional values.They are one of the natural and well known sources of vitamin C and planted worldwide.There are several diseases which severely affect the quality and yield of citrus fruits.In this paper,a new deep learning based technique is proposed for citrus disease classification.Two different pre-trained deep learning models have been used in this work.To increase the size of the citrus dataset used in this paper,image augmentation techniques are used.Moreover,to improve the visual quality of images,hybrid contrast stretching has been adopted.In addition,transfer learning is used to retrain the pre-trainedmodels and the feature set is enriched by using feature fusion.The fused feature set is optimized using a meta-heuristic algorithm,the Whale Optimization Algorithm(WOA).The selected features are used for the classification of six different diseases of citrus plants.The proposed technique attains a classification accuracy of 95.7%with superior results when compared with recent techniques.
基金supported by the National Key R&D Program of China under Grant 2018AAA0102303 and Grant 2018YFB1801103the National Natural Science Foundation of China (No. 61871398 and No. 61931011)+1 种基金the Natural Science Foundation for Distinguished Young Scholars of Jiangsu Province (No. BK20190030)the Equipment Advanced Research Field Foundation (No. 61403120304)
文摘Spectrum prediction is a promising technology to infer future spectrum state by exploiting inherent patterns of historical spectrum data.In practice,for a given spectrum band of interest,when facing relatively scarce historical data,spectrum prediction based on traditional learning methods does not work well.Thus,this paper proposes a cross-band spectrum prediction model based on transfer learning.Firstly,by analysing service activities and computing the distances between various frequency points based on Dynamic Time Warping,the similarity between spectrum bands has been verified.Next,the features,which mainly affect the performance of transfer learning in the crossband spectrum prediction,are explored by leveraging transfer component analysis.Then,the effectiveness of transfer learning for the cross-band spectrum prediction has been demonstrated.Further,experimental results with real-world spectrum data demonstrate that the performance of the proposed model is better than the state-of-theart models when the historical spectrum data is limited.
基金supported in part by the National Natural Science Foundation of China(92167201,62273264,61933007)。
文摘The state of health(SOH)is a critical factor in evaluating the performance of the lithium-ion batteries(LIBs).Due to various end-user behaviors,the LIBs exhibit different degradation modes,which makes it challenging to estimate the SOHs in a personalized way.In this article,we present a novel particle swarm optimization-assisted deep domain adaptation(PSO-DDA)method to estimate the SOH of LIBs in a personalized manner,where a new domain adaptation strategy is put forward to reduce cross-domain distribution discrepancy.The standard PSO algorithm is exploited to automatically adjust the chosen hyperparameters of developed DDA-based method.The proposed PSODDA method is validated by extensive experiments on two LIB datasets with different battery chemistry materials,ambient temperatures and charge-discharge configurations.Experimental results indicate that the proposed PSO-DDA method surpasses the convolutional neural network-based method and the standard DDA-based method.The Py Torch implementation of the proposed PSO-DDA method is available at https://github.com/mxt0607/PSO-DDA.
基金This paper was funded under the 2020–2021 Industry-International Incentive Grant by Universiti Teknologi Malaysia(Grant Number:Q.K130000.3043.02M12)which was granted to U.Khairuddin,F.Behrooz and R.Yusof.
文摘The identification of DNA binding proteins(DNABPs)is considered a major challenge in genome annotation because they are linked to several important applied and research applications of cellular functions e.g.,in the study of the biological,biophysical,and biochemical effects of antibiotics,drugs,and steroids on DNA.This paper presents an efficient approach for DNABPs identification based on deep transfer learning,named“DTLM-DBP.”Two transfer learning methods are used in the identification process.The first is based on the pre-trained deep learning model as a feature’s extractor and classifier.Two different pre-trained Convolutional Neural Networks(CNN),AlexNet 8 and VGG 16,are tested and compared.The second method uses the deep learning model as a feature’s extractor only and two different classifiers for the identification process.Two classifiers,Support Vector Machine(SVM)and Random Forest(RF),are tested and compared.The proposed approach is tested using different DNA proteins datasets.The performance of the identification process is evaluated in terms of identification accuracy,sensitivity,specificity and MCC,with four available DNA proteins datasets:PDB1075,PDB186,PDNA-543,and PDNA-316.The results show that the RF classifier,with VGG-Net pre-trained deep transfer learning features,gives the highest performance.DTLM-DBP was compared with other published methods and it provides a considerable improvement in the performance of DNABPs identification.
基金the Deanship of Scientific Research(DSR),King Abdulaziz University,Jeddah,under grant No.(FP-000-000-1441).
文摘Colorectal carcinoma(CRC)is one such dispersed cancer globally and also prominent one in causing cancer-based death.Conventionally,pathologists execute CRC diagnosis through visible scrutinizing under the microscope the resected tissue samples,stained and fixed through Haematoxylin and Eosin(H&E).The advancement of graphical processing systems has resulted in high potentiality for deep learning(DL)techniques in interpretating visual anatomy from high resolution medical images.This study develops a slime mould algorithm with deep transfer learning enabled colorectal cancer detection and classification(SMADTL-CCDC)algorithm.The presented SMADTL-CCDC technique intends to appropriately recognize the occurrence of colorectal cancer.To accomplish this,the SMADTLCCDC model initially undergoes pre-processing to improve the input image quality.In addition,a dense-EfficientNet technique was employed to extract feature vectors from the pre-processed images.Moreover,SMA with Discrete Hopfield neural network(DHNN)method was applied for the recognition and classification of colorectal cancer.The utilization of SMA assists in appropriately selecting the parameters involved in the DHNN approach.A wide range of experiments was implemented on benchmark datasets to assess the classification performance.A comprehensive comparative study highlighted the better performance of the SMADTL-CDC model over the recent approaches.
基金The authors extend their appreciation to the Deanship of Scientific Research at King Khalid University for funding this work through Large Groups Project under grant number(42/43)Princess Nourah bint Abdulrahman University Researchers Supporting Project number(PNURSP2022R151)Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia.The authors would like to thank the Deanship of Scientific Research at Umm Al-Qura University for supporting this work by Grant Code:(22UQU4340237DSR16).
文摘Osteosarcoma is a type of malignant bone tumor that is reported across the globe.Recent advancements in Machine Learning(ML)and Deep Learning(DL)models enable the detection and classification of malignancies in biomedical images.In this regard,the current study introduces a new Biomedical Osteosarcoma Image Classification using Elephant Herd Optimization and Deep Transfer Learning(BOIC-EHODTL)model.The presented BOIC-EHODTL model examines the biomedical images to diagnose distinct kinds of osteosarcoma.At the initial stage,Gabor Filter(GF)is applied as a pre-processing technique to get rid of the noise from images.In addition,Adam optimizer with MixNet model is also employed as a feature extraction technique to generate feature vectors.Then,EHOalgorithm is utilized along with Adaptive Neuro-Fuzzy Classifier(ANFC)model for recognition and categorization of osteosarcoma.EHO algorithm is utilized to fine-tune the parameters involved in ANFC model which in turn helps in accomplishing improved classification results.The design of EHO with ANFC model for classification of osteosarcoma is the novelty of current study.In order to demonstrate the improved performance of BOIC-EHODTL model,a comprehensive comparison was conducted between the proposed and existing models upon benchmark dataset and the results confirmed the better performance of BOIC-EHODTL model over recent methodologies.
文摘Humankind is facing another deadliest pandemic of all times in history,caused by COVID-19.Apart from this challenging pandemic,World Health Organization(WHO)considers tuberculosis(TB)as a preeminent infectious disease due to its high infection rate.Generally,both TB and COVID-19 severely affect the lungs,thus hardening the job of medical practitioners who can often misidentify these diseases in the current situation.Therefore,the time of need calls for an immediate and meticulous automatic diagnostic tool that can accurately discriminate both diseases.As one of the preliminary smart health systems that examine three clinical states(COVID-19,TB,and normal cases),this study proposes an amalgam of image filtering,data-augmentation technique,transfer learning-based approach,and advanced deep-learning classifiers to effectively segregate these diseases.It first employed a generative adversarial network(GAN)and Crimmins speckle removal filter on X-ray images to overcome the issue of limited data and noise.Each pre-processed image is then converted into red,green,and blue(RGB)and Commission Internationale de l’Elcairage(CIE)color spaces from which deep fused features are formed by extracting relevant features using DenseNet121 and ResNet50.Each feature extractor extracts 1000 most useful features which are then fused and finally fed to two variants of recurrent neural network(RNN)classifiers for precise discrimination of threeclinical states.Comparative analysis showed that the proposed Bi-directional long-short-term-memory(Bi-LSTM)model dominated the long-short-termmemory(LSTM)network by attaining an overall accuracy of 98.22%for the three-class classification task,whereas LSTM hardly achieved 94.22%accuracy on the test dataset.
文摘At present days,object detection and tracking concepts have gained more importance among researchers and business people.Presently,deep learning(DL)approaches have been used for object tracking as it increases the perfor-mance and speed of the tracking process.This paper presents a novel robust DL based object detection and tracking algorithm using Automated Image Anno-tation with ResNet based Faster regional convolutional neural network(R-CNN)named(AIA-FRCNN)model.The AIA-RFRCNN method performs image anno-tation using a Discriminative Correlation Filter(DCF)with Channel and Spatial Reliability tracker(CSR)called DCF-CSRT model.The AIA-RFRCNN model makes use of Faster RCNN as an object detector and tracker,which involves region proposal network(RPN)and Fast R-CNN.The RPN is a full convolution network that concurrently predicts the bounding box and score of different objects.The RPN is a trained model used for the generation of the high-quality region proposals,which are utilized by Fast R-CNN for detection process.Besides,Residual Network(ResNet 101)model is used as a shared convolutional neural network(CNN)for the generation of feature maps.The performance of the ResNet 101 model is further improved by the use of Adam optimizer,which tunes the hyperparameters namely learning rate,batch size,momentum,and weight decay.Finally,softmax layer is applied to classify the images.The performance of the AIA-RFRCNN method has been assessed using a benchmark dataset and a detailed comparative analysis of the results takes place.The outcome of the experiments indicated the superior characteristics of the AIA-RFRCNN model under diverse aspects.
基金the National Key R&D Program of China(2022YFB3402100)the National Science Fund for Distinguished Young Scholars of China(52025056)+4 种基金the National Natural Science Foundation of China(52305129)the China Postdoctoral Science Foundation(2023M732789)the China Postdoctoral Innovative Talents Support Program(BX20230290)the Open Foundation of Hunan Provincial Key Laboratory of Health Maintenance for Mechanical Equipment(2022JXKF JJ01)the Fundamental Research Funds for Central Universities。
文摘The success of deep transfer learning in fault diagnosis is attributed to the collection of high-quality labeled data from the source domain.However,in engineering scenarios,achieving such high-quality label annotation is difficult and expensive.The incorrect label annotation produces two negative effects:1)the complex decision boundary of diagnosis models lowers the generalization performance on the target domain,and2)the distribution of target domain samples becomes misaligned with the false-labeled samples.To overcome these negative effects,this article proposes a solution called the label recovery and trajectory designable network(LRTDN).LRTDN consists of three parts.First,a residual network with dual classifiers is to learn features from cross-domain samples.Second,an annotation check module is constructed to generate a label anomaly indicator that could modify the abnormal labels of false-labeled samples in the source domain.With the training of relabeled samples,the complexity of diagnosis model is reduced via semi-supervised learning.Third,the adaptation trajectories are designed for sample distributions across domains.This ensures that the target domain samples are only adapted with the pure-labeled samples.The LRTDN is verified by two case studies,in which the diagnosis knowledge of bearings is transferred across different working conditions as well as different yet related machines.The results show that LRTDN offers a high diagnosis accuracy even in the presence of incorrect annotation.
文摘Background:Pneumothorax is a medical emergency caused by the abnormal accumulation of air in the pleural space—the potential space between the lungs and chest wall.On 2D chest radiographs,pneumothorax occurs within the thoracic cavity and outside of the mediastinum,and we refer to this area as“lung+space.”While deep learning(DL)has increasingly been utilized to segment pneumothorax lesions in chest radiographs,many existing DL models employ an end-to-end approach.These models directly map chest radiographs to clinician-annotated lesion areas,often neglecting the vital domain knowl-edge that pneumothorax is inherently location-sensitive.Methods:We propose a novel approach that incorporates the lung+space as a constraint during DL model training for pneumothorax segmentation on 2D chest radiographs.To circumvent the need for additional annotations and to prevent potential label leakage on the target task,our method utilizes external datasets and an auxiliary task of lung segmentation.This approach generates a specific constraint of lung+space for each chest radiograph.Furthermore,we have incorporated a discriminator to eliminate unreliable constraints caused by the domain shift between the auxiliary and target datasets.Results:Our results demonstrated considerable improvements,with average performance gains of 4.6%,3.6%,and 3.3%regarding intersection over union,dice similarity coefficient,and Hausdorff distance.These results were con-sistent across six baseline models built on three architectures(U-Net,LinkNet,or PSPNet)and two backbones(VGG-11 or MobileOne-S0).We further con-ducted an ablation study to evaluate the contribution of each component in the proposed method and undertook several robustness studies on hyper-parameter selection to validate the stability of our method.Conclusions:The integration of domain knowledge in DL models for medical applications has often been underemphasized.Our research underscores the significance of incorporating medical domain knowledge about the location-specific nature of pneumothorax to enhance DL-based lesion segmentation and further bolster clinicians'trust in DL tools.Beyond pneumothorax,our approach is promising for other thoracic conditions that possess location-relevant characteristics.
基金Key Program of Joint Funds of the National Natural Science Foundation of China,Grant/Award Number:U22B20118。
文摘Gas-insulated switchgear(GIS)plays a critical role in ensuring the reliability of power systems,but partial discharge(PD)is a primary cause of failures within GIS equipment.Traditional PD diagnostic methods rely heavily on laboratory data,which differ signifi-cantly from that under the complex conditions of field data,leading to a marked drop in recognition accuracy when they are applied to field PD diagnosis.This study addresses the challenge by integrating field data into the training process,utilising a deep transfer learning approach that combines laboratory and field data to improve diagnostic accuracy for GIS PD.The research collected PD data from laboratory models representing five defect types and field data gathered from operational GIS equipment.A deep residual network(ResNet50)was pretrained using laboratory data and fine-tuned with field data through deep transfer learning to optimise the recognition of PD in field conditions.The results show that the proposed model achieves a significantly higher recognition accuracy(93.7%)for field data compared to traditional methods(60%-70%).The integration of deep transfer learning ensures that both low-dimensional general features from labora-tory data and high-dimensional specific features from field data are effectively utilised.This research significantly contributes to improving the diagnostic accuracy of PD in GIS under field conditions,providing a robust method for defect detection in operational equipment.
文摘The agricultural sector,a cornerstone of economies worldwide,faces significant challenges due to plant diseases,which severely affect crop yield and quality.Early and accurate detection of these diseases is crucial for effective mitigation strategies.The current methods used often lack accuracy and adaptability,especially in diverse environmental conditions.This study introduces a novel,synergistic approach that integrates deep transfer learning with multimodal techniques,specifically canny edges,colour spectrum intensity analysis,and custom data augmentation strategies.Unlike existing methods that rely solely on pre-trained models,the approach utilised in this study offers an innovative fusion of distinct feature extraction techniques.The canny edges highlighted the structural intricacies of leaf diseases,while colour spectrum intensity analysis enhanced the detection of disease-specific colour markers.The customized data augmentation techniques employed(in the study)was shown to enhance the learning process of the models,resulting in their adaptability to diverse agricultural environments.This integration applied to DenseNet201 and EfficientNetB3,achieved detection accuracies of 99.03%and 98.23%,respectively,surpassing traditional models and setting new benchmarks in plant disease detection.These results demonstrate the effectiveness of the proposed multi-faceted approach and its potential to significantly enhance crop disease management systems.
基金funded by the National Natural Science Foundation of China(Grant No.51775391).
文摘The change of working conditions not only makes the data distribution inconsistent,but also increases the diagnosis difficulty of fuzzy samples at the fault boundary.The traditional distance-based deep metric learning cannot effectively classify the fuzzy samples at the fault boundary.In the traditional transfer learning models,the maximum mean discrepancy(MMD)and joint maximum mean discrepancy only increase the transferability of same-class samples,and neglect the discriminability of different-class samples across different domains.The discriminative joint probability MMD(DJP-MMD)increases the transferability of same-class samples and the discriminability of different-class samples across different domains,but it only considers the global transferability of all fault classes,ignoring the different transferability of each same fault class.Therefore,a Yu norm-based deep transfer metric learning based on weighted DJP-MMD is proposed to further improve the diagnosis accuracy of bearings under variable working conditions.The deep transfer metric learning model adopts the Yu norm-based similarity instead of the distance-based similarity to effectively classify the data samples,especially those at the fault boundary,and uses the weighted DJP-MMD to measure the data distribution discrepancy between the source and target domains to increase the transferability of each same-class samples and discriminability of different-class samples across different domains.Through the fault diagnosis analysis on bearings under variable working conditions,the diagnosis results demonstrate that the proposed deep transfer metric learning model can diagnose bearing faults with higher accuracy,stronger generalization and anti-noise capabilities compared with other fault diagnosis methods based on transfer learning.
