This paper examines whether the parametric regression model is correctly specified for both source and target data and whether the regression pattern in the source domain aligns with that of the target domain.This eva...This paper examines whether the parametric regression model is correctly specified for both source and target data and whether the regression pattern in the source domain aligns with that of the target domain.This evaluation is a critical prerequisite for applying model-based transfer learning methods under covariate shift assumptions.Traditional regression model checks and twosample regression tests are insufficient to address this issue.To overcome these limitations,the authors propose a novel adaptive-to-regression test statistic that is asymptotically distribution-free.Under the null hypothesis,the test follows a chi-square weak limit,preserving the significance level and enabling critical value determination without resampling techniques.Additionally,the authors systematically analyze the test's power performance,highlighting its sensitivity to different sub-local alternatives that deviate from the null hypothesis.Numerical studies,including simulations,assess finite-sample performance,and a real-world data example is provided for illustration.展开更多
Scene recognition is a critical component of computer vision,powering applications from autonomous vehicles to surveillance systems.However,its development is often constrained by a heavy reliance on large,expensively...Scene recognition is a critical component of computer vision,powering applications from autonomous vehicles to surveillance systems.However,its development is often constrained by a heavy reliance on large,expensively annotated datasets.This research presents a novel,efficient approach that leveragesmulti-model transfer learning from pre-trained deep neural networks—specifically DenseNet201 and Visual Geometry Group(VGG)—to overcome this limitation.Ourmethod significantly reduces dependency on vast labeled data while achieving high accuracy.Evaluated on the Aerial Image Dataset(AID)dataset,the model attained a validation accuracy of 93.6%with a loss of 0.35,demonstrating robust performance with minimal training data.These results underscore the viability of our approach for real-time,data-efficient scene recognition,offering a practical and cost-effective advancement for the field.展开更多
Deep transfer learning has achieved significant success in anomaly detection over the past decade,but data acquisition challenges in practical engineering hinder high-quality feature representation for few-shot learni...Deep transfer learning has achieved significant success in anomaly detection over the past decade,but data acquisition challenges in practical engineering hinder high-quality feature representation for few-shot learning tasks.To address this issue,a novel time-frequency-assisted deep feature enhancement(TFE)mechanism is proposed.Unlike traditional methods that integrate time-frequency analysis with deep neural networks,TFE employs a wavelet scattering transform to establish a parallel time-frequency feature space,where a dual interaction strategy facilitates collaboration between deep feature and time-frequency spaces through two operations:1)Enhancement,where a frequency-importance-driven contrastive learning(FICL)network transfers physically-aware information from wavelet scattering features to deep features,and 2)Feedback,which uses a detection rule adaptation module to minimize bias in wavelet scattering features based on deep feature performance.TFE is applied to a domain-adversarial anomaly detection framework and,through alternating training,significantly enhances both deep feature discriminative power and few-shot anomaly detection.Theoretical analysis confirms that the proposed dual interaction strategy reduces the upper bound of classification error.Experiments on benchmark datasets and a real-world industrial dataset from a large steel factory demonstrate TFE's superior performance and highlight the importance of frequency saliency in transfer learning.Thus,collaboration is shown to outperform integration for few-shot transfer learning in anomaly detection.展开更多
Metal additive manufacturing(AM)technology has promising applications across many fields due to its near-net-shape advantages.The quality of the as-built component is closely linked to the temperature evolution during...Metal additive manufacturing(AM)technology has promising applications across many fields due to its near-net-shape advantages.The quality of the as-built component is closely linked to the temperature evolution during the metal AM process,which exhibits strong nonlinearities,localized high gradients,and rapid cooling rates.Therefore,real-time prediction of the temperature field is essential for effective online process control to achieve high fabrication quality,which poses surprising challenges for numerical methods,as traditional methods suffer from the inherent time-consuming nature of fine time-space discretizations.In this study,we proposed an isothermal surface imaging and transfer learning framework for fast prediction of isothermal surfaces,which are further used to reconstruct the high-dimensional,nonlinear temperature field.It consists of three key parts:physics-guided isothermal surface imaging to reduce the problem dimensionality by transforming the unstructured temperature field into a series of structured grayscale images,a pre-trained hybrid parameter-to-image generative neural network for the isothermal surface prediction in favor of small training samples,and a transfer learning strategy leveraging physical similarity of these isothermal surfaces in the metal AM process to obtain the 3D temperature field.The training samples are generated using a high-fidelity numerical model,which is validated against experimental data.The predicted results from the proposed framework agree well with those from the high-fidelity numerical simulation for a given combination of process parameters,achieving a computational cost measured in seconds.It is expected that the proposed framework could serve as a powerful tool for predicting the temperature field and further facilitating online control of process parameters.展开更多
Cosmic-ray muon sources exhibit distinct scattering angle distributions when interacting with materials of different atomic numbers(Z values),facilitating the identification of various Z-class materials,particularly r...Cosmic-ray muon sources exhibit distinct scattering angle distributions when interacting with materials of different atomic numbers(Z values),facilitating the identification of various Z-class materials,particularly radioactive high-Z nuclear elements.Most traditional identification methods are based on complex statistical iterative reconstruction or simple trajectory approximation.Supervised machine learning methods offer some improvement but rely heavily on prior knowledge of the target materials,significantly limiting their practical applicability in detecting concealed materials.To the best of our knowledge,this is the first study to introduce transfer learning into muon tomography.We propose two lightweight neural network models for fine-tuning and adversarial transfer learning,utilizing muon scattering data of bare materials to predict the Z-class of materials coated by typical shieldings(e.g.,aluminum or polyethylene),simulating practical scenarios such as cargo inspection and arms control.By introducing a novel inverse cumulative distribution-based sampling method,more accurate scattering angle distributions could be obtained from the data,leading to an improvement of nearly 4% in prediction accuracy compared with the traditional random sampling-based training.When applied to coated materials with limited labeled or even unlabeled muon tomography data,the proposed method achieved an overall prediction accuracy exceeding 96%,with high-Z materials reaching nearly 99%.The simulation results indicate that transfer learning improves the prediction accuracy by approximately 10% compared to direct prediction without transfer.This study demonstrates the effectiveness of transfer learning in overcoming the physical challenges associated with limited labeled/unlabeled data and highlights the promising potential of transfer learning in the field of muon tomography.展开更多
In the era of materials genome engineering,data-driven machine learning has become a powerful tool for accelerating the re-search and development of metallic materials.However,the predictive accuracy and generalizatio...In the era of materials genome engineering,data-driven machine learning has become a powerful tool for accelerating the re-search and development of metallic materials.However,the predictive accuracy and generalization ability of traditional machine learning models are often limited by the scarcity and heterogeneity of available data,especially in small-sample scenarios.To address these chal-lenges,transfer learning has emerged as an effective strategy to leverage knowledge from related domains,thereby enhancing model per-formance with limited target data.This review systematically summarizes the fundamental concepts,methodologies,and representative applications of transfer learning in the prediction of metallic materials'properties.Transfer learning can be categorized into feature-based,instance-based,parameter-based,and knowledge-based methods.This work discusses their respective mechanisms,advantages,and limit-ations.Case studies demonstrate that transfer learning can significantly improve prediction accuracy,data efficiency,and model inter-pretability in tasks such as mechanical property prediction and alloy design.Furthermore,this work highlights emerging trends including hybrid,multi-task,meta,and adaptive transfer learning,which further expand the applicability of these techniques.Finally,this work out-lines future research directions,emphasizing the need for data standardization,algorithmic innovation,multimodal data fusion,and the in-tegration of physical principles to achieve robust,interpretable,and generalizable models.The perspectives presented aim to advance the intelligent design and discovery of metallic materials,promoting efficient knowledge transfer and collaborative innovation in materials science.展开更多
Accurate detection of driver fatigue is essential for improving road safety.This study investigates the effectiveness of using multimodal physiological signals for fatigue detection while incorporating uncertainty qua...Accurate detection of driver fatigue is essential for improving road safety.This study investigates the effectiveness of using multimodal physiological signals for fatigue detection while incorporating uncertainty quantification to enhance the reliability of predictions.Physiological signals,including Electrocardiogram(ECG),Galvanic Skin Response(GSR),and Electroencephalogram(EEG),were transformed into image representations and analyzed using pretrained deep neu-ral networks.The extracted features were classified through a feedforward neural network,and prediction reliability was assessed using uncertainty quantification techniques such as Monte Carlo Dropout(MCD),model ensembles,and combined approaches.Evaluation metrics included standard measures(sensitivity,specificity,precision,and accuracy)along with uncertainty-aware metrics such as uncertainty sensitivity and uncertainty precision.Across all evaluations,ECG-based models consistently demonstrated strong performance.The findings indicate that combining multimodal physi-ological signals,Transfer Learning(TL),and uncertainty quantification can significantly improve both the accuracy and trustworthiness of fatigue detection systems.This approach supports the development of more reliable driver assistance technologies aimed at preventing fatigue-related accidents.展开更多
The current deep learning models for braced excavation cannot predict deformation from the beginning of excavation due to the need for a substantial corpus of sufficient historical data for training purposes.To addres...The current deep learning models for braced excavation cannot predict deformation from the beginning of excavation due to the need for a substantial corpus of sufficient historical data for training purposes.To address this issue,this study proposes a transfer learning model based on a sequence-to-sequence twodimensional(2D)convolutional long short-term memory neural network(S2SCL2D).The model can use the existing data from other adjacent similar excavations to achieve wall deflection prediction once a limited amount of monitoring data from the target excavation has been recorded.In the absence of adjacent excavation data,numerical simulation data from the target project can be employed instead.A weight update strategy is proposed to improve the prediction accuracy by integrating the stochastic gradient masking with an early stopping mechanism.To illustrate the proposed methodology,an excavation project in Hangzhou,China is adopted.The proposed deep transfer learning model,which uses either adjacent excavation data or numerical simulation data as the source domain,shows a significant improvement in performance when compared to the non-transfer learning model.Using the simulation data from the target project even leads to better prediction performance than using the actual monitoring data from other adjacent excavations.The results demonstrate that the proposed model can reasonably predict the deformation with limited data from the target project.展开更多
The development of modern high-altitude wide-swath imaging systems has brought about adaptive quantization bit-depths(10 ~ 16 bits) and large-scale datasets with a single frame approaching I0 GB,posing two major techn...The development of modern high-altitude wide-swath imaging systems has brought about adaptive quantization bit-depths(10 ~ 16 bits) and large-scale datasets with a single frame approaching I0 GB,posing two major technical challenges for thin-cloud removal in large-format aerial images.Firstly,it is difficult to construct a unified model across different bit-depths,resulting in poor model reusability and the need for high retraining costs in new domains.Secondly,traditional neural networks have to segment images into sub-blocks for processing and then splice them,which is prone to generating chromatic artifacts.To address these issues,we propose the Seamless Cloud Elimination Network(SCENet),whose core innovations are as follows:I achieving bit-depth unification through 8-bit standardization of paired images to support unified model training;2 adopting an adaptive transfer learning architecture that freezes encoder weights and fine-tunes decoders to realize efficient domain adaptation and rapid cloud removal;3 innovating a white-balance-aware cross-patch network architecture,which avoids chromatic artifacts during reconstruction while learning cloud features.Experiments show that this method performs excellently on real datasets,and SCENet achieves the highest Peak Signal-to-Noise Ratio(PSNR) compared with eight existing state-of-the-art methods.展开更多
Aerodynamic evaluation under multi-condition is indispensable for the design of aircraft,and the requirement for mass data still means a high cost.To address this problem,we propose a novel point-cloud multi-condition...Aerodynamic evaluation under multi-condition is indispensable for the design of aircraft,and the requirement for mass data still means a high cost.To address this problem,we propose a novel point-cloud multi-condition aerodynamics transfer learning(PCMCA-TL)framework that enables aerodynamic prediction in data-scarce sce-narios by transferring knowledge from well-learned scenarios.We modified the PointNeXt segmentation archi-tecture to a PointNeXtReg+regression model,including a working condition input module.The model is first pre-trained on a public dataset with 2000 shapes but only one working condition and then fine-tuned on a multi-condition small-scale spaceplane dataset.The effectiveness of the PCMCA-TL framework is verified by comparing the pressure coefficients predicted by direct training,pre-training,and TL models.Furthermore,by comparing the aerodynamic force coefficients calculated by predicted pressure coefficients in seconds with the correspond-ing CFD results obtained in hours,the accuracy highlights the development potential of deep transfer learning in aerodynamic evaluation.展开更多
In radiology,magnetic resonance imaging(MRI)is an essential diagnostic tool that provides detailed images of a patient’s anatomical and physiological structures.MRI is particularly effective for detecting soft tissue...In radiology,magnetic resonance imaging(MRI)is an essential diagnostic tool that provides detailed images of a patient’s anatomical and physiological structures.MRI is particularly effective for detecting soft tissue anomalies.Traditionally,radiologists manually interpret these images,which can be labor-intensive and time-consuming due to the vast amount of data.To address this challenge,machine learning,and deep learning approaches can be utilized to improve the accuracy and efficiency of anomaly detection in MRI scans.This manuscript presents the use of the Deep AlexNet50 model for MRI classification with discriminative learning methods.There are three stages for learning;in the first stage,the whole dataset is used to learn the features.In the second stage,some layers of AlexNet50 are frozen with an augmented dataset,and in the third stage,AlexNet50 with an augmented dataset with the augmented dataset.This method used three publicly available MRI classification datasets:Harvard whole brain atlas(HWBA-dataset),the School of Biomedical Engineering of Southern Medical University(SMU-dataset),and The National Institute of Neuroscience and Hospitals brain MRI dataset(NINS-dataset)for analysis.Various hyperparameter optimizers like Adam,stochastic gradient descent(SGD),Root mean square propagation(RMS prop),Adamax,and AdamW have been used to compare the performance of the learning process.HWBA-dataset registers maximum classification performance.We evaluated the performance of the proposed classification model using several quantitative metrics,achieving an average accuracy of 98%.展开更多
Many applications,including security systems,medical diagnostics,and human-computer interfaces,depend on eye gaze recognition.However,due to factors including individual variations,occlusions,and shifting illumination...Many applications,including security systems,medical diagnostics,and human-computer interfaces,depend on eye gaze recognition.However,due to factors including individual variations,occlusions,and shifting illumination conditions,real-world scenarios continue to provide difficulties for accurate and consistent eye gaze recognition.This work is aimed at investigating the potential benefits of employing transfer learning to improve eye gaze detection ability and efficiency.Transfer learning is the process of fine-tuning pre-trained models on smaller,domain-specific datasets after they have been trained on larger datasets.We study several transfer learning algorithms and evaluate their effectiveness on eye gaze identification,including both Regression and Classification tasks,using a range of deep learning architectures,namely AlexNet,Visual Geometry Group(VGG),InceptionV3,and ResNet.In this study,we evaluate the effectiveness of transfer learning-basedmodels against models that were trained fromscratch using eye-gazing datasets on grounds of various performance and loss metrics such as Precision,Accuracy,and Mean Absolute Error.We investigate the effects of different pre-trainedmodels,dataset sizes,and domain gaps on the transfer learning process,and the findings of our study clarify the efficacy of transfer learning for eye gaze detection and offer suggestions for the most successful transfer learning strategies to apply in real-world situations.展开更多
Deep Learning-based systems for Finger vein recognition have gained rising attention in recent years due to improved efficiency and enhanced security.The performance of existing CNN-based methods is limited by the pun...Deep Learning-based systems for Finger vein recognition have gained rising attention in recent years due to improved efficiency and enhanced security.The performance of existing CNN-based methods is limited by the puny generalization of learned features and deficiency of the finger vein image training data.Considering the concerns of existing methods,in this work,a simplified deep transfer learning-based framework for finger-vein recognition is developed using an EfficientNet model of deep learning with a self-attention mechanism.Data augmentation using various geometrical methods is employed to address the problem of training data shortage required for a deep learning model.The proposed model is tested using K-fold cross-validation on three publicly available datasets:HKPU,FVUSM,and SDUMLA.Also,the developed network is compared with other modern deep nets to check its effectiveness.In addition,a comparison of the proposed method with other existing Finger vein recognition(FVR)methods is also done.The experimental results exhibited superior recognition accuracy of the proposed method compared to other existing methods.In addition,the developed method proves to be more effective and less sophisticated at extracting robust features.The proposed EffAttenNet achieves an accuracy of 98.14%on HKPU,99.03%on FVUSM,and 99.50%on SDUMLA databases.展开更多
This study rigorously evaluates the potential of transfer learning in diagnosing retinal eye diseases using advanced models such asYOLOv8,Xception,ConvNeXtTiny,andVGG16.All models were trained on the esteemed RFMiD da...This study rigorously evaluates the potential of transfer learning in diagnosing retinal eye diseases using advanced models such asYOLOv8,Xception,ConvNeXtTiny,andVGG16.All models were trained on the esteemed RFMiD dataset,which includes images classified into six critical categories:Diabetic Retinopathy(DR),Macular Hole(MH),Diabetic Neuropathy(DN),Optic Disc Changes(ODC),Tesselated Fundus(TSLN),and normal cases.The research emphasizes enhancing model performance by prioritizing recall metrics,a crucial strategy aimed at minimizing false negatives in medical diagnostics.To address the challenge of imbalanced data,we implemented effective preprocessing techniques,including cropping,resizing,and data augmentation.The proposed models underwent fine-tuning and were evaluated using established metrics such as accuracy,precision,and recall.The experimental results are compelling,with YOLOv8 achieving the highest recall rates for both normal cases(97.76%)and DR cases(87.10%),demonstrating its reliability in disease screening.In contrast,Xception showed a decline in recall after fine-tuning,particularly in identifying DR and MH cases,highlighting the need for a careful balance between sensitivity and specificity in model training.Notably,both ConvNeXtTiny and VGG16 exhibited significant improvements post-fine-tuning,with VGG16’s recall for normal conditions increasing dramatically from 40.30%to an impressive 89.55%.These findings clearly underscore the potential of utilizing pre-trained models through transfer learning for the effective detection of retinal eye diseases,ultimately contributing to improved patient outcomes in medical diagnostics.展开更多
Microseismic monitoring technology is widely used in tunnel and coal mine safety production.For signals generated by ultra-weak microseismic events,traditional sensors encounter limitations in terms of detection sensi...Microseismic monitoring technology is widely used in tunnel and coal mine safety production.For signals generated by ultra-weak microseismic events,traditional sensors encounter limitations in terms of detection sensitivity.Given the complex engineering environment,automatic multi-classification of microseismic data is highly required.In this study,we use acceleration sensors to collect signals and combine the improved Visual Geometry Group with a convolutional block attention module to obtain a new network structure,termed CNN_BAM,for automatic classification and identification of microseismic events.We use the dataset collected from the Hanjiang-to-Weihe River Diversion Project to train and validate the network model.Results show that the CNN_BAM model exhibits good feature extraction ability,achieving a recognition accuracy of 99.29%,surpassing all its counterparts.The stability and accuracy of the classification algorithm improve remarkably.In addition,through fine-tuning and migration to the Pan Ⅱ Mine Project,the network demonstrates reliable generalization performance.This outcome reflects its adaptability across different projects and promising application prospects.展开更多
Named Entity Recognition(NER)is vital in natural language processing for the analysis of news texts,as it accurately identifies entities such as locations,persons,and organizations,which is crucial for applications li...Named Entity Recognition(NER)is vital in natural language processing for the analysis of news texts,as it accurately identifies entities such as locations,persons,and organizations,which is crucial for applications like news summarization and event tracking.However,NER in the news domain faces challenges due to insufficient annotated data,complex entity structures,and strong context dependencies.To address these issues,we propose a new Chinesenamed entity recognition method that integrates transfer learning with word embeddings.Our approach leverages the ERNIE pre-trained model for transfer learning and obtaining general language representations and incorporates the Soft-lexicon word embedding technique to handle varied entity structures.This dual-strategy enhances the model’s understanding of context and boosts its ability to process complex texts.Experimental results show that our method achieves an F1 score of 94.72% on a news dataset,surpassing baseline methods by 3%–4%,thereby confirming its effectiveness for Chinese-named entity recognition in the news domain.展开更多
Seismic fault identification is a critical step in structural interpretation,reservoir characterization,and well-drilling planning.However,fault identification in deep fault-karst carbonate formations is particularly ...Seismic fault identification is a critical step in structural interpretation,reservoir characterization,and well-drilling planning.However,fault identification in deep fault-karst carbonate formations is particularly challenging due to their deep burial depth and the complex effects of dissolution.Traditional manual interpretation methods are often labor intensive and prone to high uncertainty due to their subjective nature.To address these limitations,this study proposes a transfer learningebased strategy for fault identification in deep fault-karst carbonate formations.The proposed methodology began with the generation of a large volume of synthetic seismic samples based on statistical fault distribution patterns observed in the study area.These synthetic samples were used to pretrain an improved U-Net network architecture,enhanced with an attention mechanism,to create a robust pretrained model.Subsequently,real-world fault labels were manually annotated based on verified fault interpretations and integrated into the training dataset.This combination of synthetic and real-world data was used to fine-tune the pretrained model,significantly improving its fault interpretation accuracy.The experimental results demonstrate that the integration of synthetic and real-world samples effectively enhances the quality of the training dataset.Furthermore,the proposed transfer learning strategy significantly im-proves fault recognition accuracy.By replacing the traditional weighted cross-entropy loss function with the Dice loss function,the model successfully addresses the issue of extreme class imbalance between positive and negative samples.Practical applications confirm that the proposed transfer learning strategy can accurately identify fault structures in deep fault-karst carbonate formations,providing a novel and effective technical approach for fault interpretation in such complex geological settings.展开更多
The COVID-19 pandemic,which was declared by the WHO,had created a global health crisis and disrupted people’s daily lives.A large number of people were affected by the COVID-19 pandemic.Therefore,a diagnostic model n...The COVID-19 pandemic,which was declared by the WHO,had created a global health crisis and disrupted people’s daily lives.A large number of people were affected by the COVID-19 pandemic.Therefore,a diagnostic model needs to be generated which can effectively classify the COVID and non-COVID cases.In this work,our aim is to develop a diagnostic model based on deep features using effectiveness of Chest X-ray(CXR)in distinguishing COVID from non-COVID cases.The proposed diagnostic framework utilizes CXR to diagnose COVID-19 and includes Grad-CAM visualizations for a visual interpretation of predicted images.The model’s performance was evaluated using various metrics,including accuracy,precision,recall,F1-score,and Gmean.Several machine learning models,such as random forest,dense neural network,SVM,twin SVM,extreme learning machine,random vector functional link,and kernel ridge regression,were selected to diagnose COVID-19 cases.Transfer learning was used to extract deep features.For feature extraction many CNN-based models such as Inception V3,MobileNet,ResNet50,VGG16 and Xception models are used.It was evident from the experiments that ResNet50 architecture outperformed all other CNN architectures based on AUC.The TWSVM classifier achieved the highest AUC score of 0.98 based on the ResNet50 feature vector.展开更多
Recognition methods of electromagnetic transients(EMT)have been widely used in power systems with the assumption that training and testing data are drawn from the same probability distribution.However,that assumption ...Recognition methods of electromagnetic transients(EMT)have been widely used in power systems with the assumption that training and testing data are drawn from the same probability distribution.However,that assumption is hard to satisfy in industrial applications because the distribution of measured EMT testing data generally changes over time.The performance of these methods gradually deteriorates with the distribution shift.The phenomenon limits application of EMT recognition methods.Therefore,this paper proposes a transfer learning-based recognition network(TLRN)for EMT to break the limitation.It consists of a feature extractor,EMT recognizer,domain recognizer,and maximum mean discrepancy(MMD).The feature extractor is constructed to learn features of EMT automatically.The domain recognizer and MMD make features learned by the feature extractor domain invariant.Based on domain invariant features,the EMT recognizer achieves accurate EMT recognition,despite the distribution discrepancy between EMT training and testing data.TLRN maintains satisfactory EMT recognition performance by updating periodically with an unsupervised learning strategy.Using EMT datasets measured from different substations,scenario experiments,and experiment comparisons are conducted,and the recognition performance of the proposed TLRN is demonstrated.展开更多
The electromagnetic pulse valve,as a key component in baghouse dust removal systems,plays a crucial role in the performance of the system.However,despite the promising results of intelligent fault diagnosis methods ba...The electromagnetic pulse valve,as a key component in baghouse dust removal systems,plays a crucial role in the performance of the system.However,despite the promising results of intelligent fault diagnosis methods based on extensive data in diagnosing electromagnetic valves,real-world diagnostic scenarios still face numerous challenges.Collecting fault data for electromagnetic pulse valves is not only time-consuming but also costly,making it difficult to obtain sufficient fault data in advance,which poses challenges for small sample fault diagnosis.To address this issue,this paper proposes a fault diagnosis method for electromagnetic pulse valves based on deep transfer learning and simulated data.This method achieves effective transfer from simulated data to real data through four parameter transfer strategies,which combine parameter freezing and fine-tuning operations.Furthermore,this paper identifies a parameter transfer strategy that simultaneously fine-tunes the feature extractor and classifier,and introduces an attention mechanism to integrate fault features,thereby enhancing the correlation and information complementarity among multi-sensor data.The effectiveness of the proposed method is evaluated through two fault diagnosis cases under different operating conditions.In this study,small sample data accounted for 7.9%and 8.2%of the total dataset,and the experimental results showed transfer accuracies of 93.5%and 94.2%,respectively,validating the reliability and effectiveness of the method under small sample conditions.展开更多
基金supported by the Open Research Fund of Key Laboratory of Advanced Theory and Application in Statistics and Data Science(East China Normal University),Ministry of Educationsupported by the National Natural Scientific Foundation of China under Grant No.NSFC12131006the Scientific and Technological Innovation Project of China Academy of Chinese Medical Science under Grant No.CI2023C063YLL。
文摘This paper examines whether the parametric regression model is correctly specified for both source and target data and whether the regression pattern in the source domain aligns with that of the target domain.This evaluation is a critical prerequisite for applying model-based transfer learning methods under covariate shift assumptions.Traditional regression model checks and twosample regression tests are insufficient to address this issue.To overcome these limitations,the authors propose a novel adaptive-to-regression test statistic that is asymptotically distribution-free.Under the null hypothesis,the test follows a chi-square weak limit,preserving the significance level and enabling critical value determination without resampling techniques.Additionally,the authors systematically analyze the test's power performance,highlighting its sensitivity to different sub-local alternatives that deviate from the null hypothesis.Numerical studies,including simulations,assess finite-sample performance,and a real-world data example is provided for illustration.
基金funded by the Deanship of Scientific Research and Libraries,Princess Nourah bint Abdulrahman University,through the Program of Research Project Funding After Publication,grant No.(RPFAP-23-1445).
文摘Scene recognition is a critical component of computer vision,powering applications from autonomous vehicles to surveillance systems.However,its development is often constrained by a heavy reliance on large,expensively annotated datasets.This research presents a novel,efficient approach that leveragesmulti-model transfer learning from pre-trained deep neural networks—specifically DenseNet201 and Visual Geometry Group(VGG)—to overcome this limitation.Ourmethod significantly reduces dependency on vast labeled data while achieving high accuracy.Evaluated on the Aerial Image Dataset(AID)dataset,the model attained a validation accuracy of 93.6%with a loss of 0.35,demonstrating robust performance with minimal training data.These results underscore the viability of our approach for real-time,data-efficient scene recognition,offering a practical and cost-effective advancement for the field.
基金supported in part by the National Natural Science Foundation of China(62472146)the Key Technologies Research Development Joint Foundation of Henan Province of China(225101610001)。
文摘Deep transfer learning has achieved significant success in anomaly detection over the past decade,but data acquisition challenges in practical engineering hinder high-quality feature representation for few-shot learning tasks.To address this issue,a novel time-frequency-assisted deep feature enhancement(TFE)mechanism is proposed.Unlike traditional methods that integrate time-frequency analysis with deep neural networks,TFE employs a wavelet scattering transform to establish a parallel time-frequency feature space,where a dual interaction strategy facilitates collaboration between deep feature and time-frequency spaces through two operations:1)Enhancement,where a frequency-importance-driven contrastive learning(FICL)network transfers physically-aware information from wavelet scattering features to deep features,and 2)Feedback,which uses a detection rule adaptation module to minimize bias in wavelet scattering features based on deep feature performance.TFE is applied to a domain-adversarial anomaly detection framework and,through alternating training,significantly enhances both deep feature discriminative power and few-shot anomaly detection.Theoretical analysis confirms that the proposed dual interaction strategy reduces the upper bound of classification error.Experiments on benchmark datasets and a real-world industrial dataset from a large steel factory demonstrate TFE's superior performance and highlight the importance of frequency saliency in transfer learning.Thus,collaboration is shown to outperform integration for few-shot transfer learning in anomaly detection.
基金funded by the National Natural Science Foundation of China under Grant No.11972086the Fundamental Research Funds for the Central Universities。
文摘Metal additive manufacturing(AM)technology has promising applications across many fields due to its near-net-shape advantages.The quality of the as-built component is closely linked to the temperature evolution during the metal AM process,which exhibits strong nonlinearities,localized high gradients,and rapid cooling rates.Therefore,real-time prediction of the temperature field is essential for effective online process control to achieve high fabrication quality,which poses surprising challenges for numerical methods,as traditional methods suffer from the inherent time-consuming nature of fine time-space discretizations.In this study,we proposed an isothermal surface imaging and transfer learning framework for fast prediction of isothermal surfaces,which are further used to reconstruct the high-dimensional,nonlinear temperature field.It consists of three key parts:physics-guided isothermal surface imaging to reduce the problem dimensionality by transforming the unstructured temperature field into a series of structured grayscale images,a pre-trained hybrid parameter-to-image generative neural network for the isothermal surface prediction in favor of small training samples,and a transfer learning strategy leveraging physical similarity of these isothermal surfaces in the metal AM process to obtain the 3D temperature field.The training samples are generated using a high-fidelity numerical model,which is validated against experimental data.The predicted results from the proposed framework agree well with those from the high-fidelity numerical simulation for a given combination of process parameters,achieving a computational cost measured in seconds.It is expected that the proposed framework could serve as a powerful tool for predicting the temperature field and further facilitating online control of process parameters.
基金supported by the Research Program of State Key Laboratory of Heavy Ion Science and Technology,Institute of Modern Physics,Chinese Academy of Sciences(No.HIST2025CS06)the National Natural Science Foundation of China(Nos.12405402,12475106,12105327,and 12405337)the Guangdong Basic and Applied Basic Research Foundation,China(No.2023B1515120067)。
文摘Cosmic-ray muon sources exhibit distinct scattering angle distributions when interacting with materials of different atomic numbers(Z values),facilitating the identification of various Z-class materials,particularly radioactive high-Z nuclear elements.Most traditional identification methods are based on complex statistical iterative reconstruction or simple trajectory approximation.Supervised machine learning methods offer some improvement but rely heavily on prior knowledge of the target materials,significantly limiting their practical applicability in detecting concealed materials.To the best of our knowledge,this is the first study to introduce transfer learning into muon tomography.We propose two lightweight neural network models for fine-tuning and adversarial transfer learning,utilizing muon scattering data of bare materials to predict the Z-class of materials coated by typical shieldings(e.g.,aluminum or polyethylene),simulating practical scenarios such as cargo inspection and arms control.By introducing a novel inverse cumulative distribution-based sampling method,more accurate scattering angle distributions could be obtained from the data,leading to an improvement of nearly 4% in prediction accuracy compared with the traditional random sampling-based training.When applied to coated materials with limited labeled or even unlabeled muon tomography data,the proposed method achieved an overall prediction accuracy exceeding 96%,with high-Z materials reaching nearly 99%.The simulation results indicate that transfer learning improves the prediction accuracy by approximately 10% compared to direct prediction without transfer.This study demonstrates the effectiveness of transfer learning in overcoming the physical challenges associated with limited labeled/unlabeled data and highlights the promising potential of transfer learning in the field of muon tomography.
基金supported by the National NaturalScience Foundation of China(Nos.52301029 and 52274359)the Fundamental Research Funds for the CentralUniversities,China(No.06500165)+2 种基金the Guangdong Basicand Applied Basic Research Foundation,China(No.2022A1515140006)Young Elite Scientists Sponsorship Program by CAST(No.2023QNRC001)Beijing Young Elite Scientists Sponsorship Program by BMES,China.
文摘In the era of materials genome engineering,data-driven machine learning has become a powerful tool for accelerating the re-search and development of metallic materials.However,the predictive accuracy and generalization ability of traditional machine learning models are often limited by the scarcity and heterogeneity of available data,especially in small-sample scenarios.To address these chal-lenges,transfer learning has emerged as an effective strategy to leverage knowledge from related domains,thereby enhancing model per-formance with limited target data.This review systematically summarizes the fundamental concepts,methodologies,and representative applications of transfer learning in the prediction of metallic materials'properties.Transfer learning can be categorized into feature-based,instance-based,parameter-based,and knowledge-based methods.This work discusses their respective mechanisms,advantages,and limit-ations.Case studies demonstrate that transfer learning can significantly improve prediction accuracy,data efficiency,and model inter-pretability in tasks such as mechanical property prediction and alloy design.Furthermore,this work highlights emerging trends including hybrid,multi-task,meta,and adaptive transfer learning,which further expand the applicability of these techniques.Finally,this work out-lines future research directions,emphasizing the need for data standardization,algorithmic innovation,multimodal data fusion,and the in-tegration of physical principles to achieve robust,interpretable,and generalizable models.The perspectives presented aim to advance the intelligent design and discovery of metallic materials,promoting efficient knowledge transfer and collaborative innovation in materials science.
基金the Australian Research Council Discovery Projects funding scheme(DP190102181,DP210101465).
文摘Accurate detection of driver fatigue is essential for improving road safety.This study investigates the effectiveness of using multimodal physiological signals for fatigue detection while incorporating uncertainty quantification to enhance the reliability of predictions.Physiological signals,including Electrocardiogram(ECG),Galvanic Skin Response(GSR),and Electroencephalogram(EEG),were transformed into image representations and analyzed using pretrained deep neu-ral networks.The extracted features were classified through a feedforward neural network,and prediction reliability was assessed using uncertainty quantification techniques such as Monte Carlo Dropout(MCD),model ensembles,and combined approaches.Evaluation metrics included standard measures(sensitivity,specificity,precision,and accuracy)along with uncertainty-aware metrics such as uncertainty sensitivity and uncertainty precision.Across all evaluations,ECG-based models consistently demonstrated strong performance.The findings indicate that combining multimodal physi-ological signals,Transfer Learning(TL),and uncertainty quantification can significantly improve both the accuracy and trustworthiness of fatigue detection systems.This approach supports the development of more reliable driver assistance technologies aimed at preventing fatigue-related accidents.
基金supported by the National Key Research and Development Program of China(Grant No.2023YFC3009400)the National Natural Science Foundation of China(Grant Nos.42307218 and U2239251).
文摘The current deep learning models for braced excavation cannot predict deformation from the beginning of excavation due to the need for a substantial corpus of sufficient historical data for training purposes.To address this issue,this study proposes a transfer learning model based on a sequence-to-sequence twodimensional(2D)convolutional long short-term memory neural network(S2SCL2D).The model can use the existing data from other adjacent similar excavations to achieve wall deflection prediction once a limited amount of monitoring data from the target excavation has been recorded.In the absence of adjacent excavation data,numerical simulation data from the target project can be employed instead.A weight update strategy is proposed to improve the prediction accuracy by integrating the stochastic gradient masking with an early stopping mechanism.To illustrate the proposed methodology,an excavation project in Hangzhou,China is adopted.The proposed deep transfer learning model,which uses either adjacent excavation data or numerical simulation data as the source domain,shows a significant improvement in performance when compared to the non-transfer learning model.Using the simulation data from the target project even leads to better prediction performance than using the actual monitoring data from other adjacent excavations.The results demonstrate that the proposed model can reasonably predict the deformation with limited data from the target project.
文摘The development of modern high-altitude wide-swath imaging systems has brought about adaptive quantization bit-depths(10 ~ 16 bits) and large-scale datasets with a single frame approaching I0 GB,posing two major technical challenges for thin-cloud removal in large-format aerial images.Firstly,it is difficult to construct a unified model across different bit-depths,resulting in poor model reusability and the need for high retraining costs in new domains.Secondly,traditional neural networks have to segment images into sub-blocks for processing and then splice them,which is prone to generating chromatic artifacts.To address these issues,we propose the Seamless Cloud Elimination Network(SCENet),whose core innovations are as follows:I achieving bit-depth unification through 8-bit standardization of paired images to support unified model training;2 adopting an adaptive transfer learning architecture that freezes encoder weights and fine-tunes decoders to realize efficient domain adaptation and rapid cloud removal;3 innovating a white-balance-aware cross-patch network architecture,which avoids chromatic artifacts during reconstruction while learning cloud features.Experiments show that this method performs excellently on real datasets,and SCENet achieves the highest Peak Signal-to-Noise Ratio(PSNR) compared with eight existing state-of-the-art methods.
基金supported by the Natural Science Foundation of Hunan Province of China(Grant No.2021JJ10045).
文摘Aerodynamic evaluation under multi-condition is indispensable for the design of aircraft,and the requirement for mass data still means a high cost.To address this problem,we propose a novel point-cloud multi-condition aerodynamics transfer learning(PCMCA-TL)framework that enables aerodynamic prediction in data-scarce sce-narios by transferring knowledge from well-learned scenarios.We modified the PointNeXt segmentation archi-tecture to a PointNeXtReg+regression model,including a working condition input module.The model is first pre-trained on a public dataset with 2000 shapes but only one working condition and then fine-tuned on a multi-condition small-scale spaceplane dataset.The effectiveness of the PCMCA-TL framework is verified by comparing the pressure coefficients predicted by direct training,pre-training,and TL models.Furthermore,by comparing the aerodynamic force coefficients calculated by predicted pressure coefficients in seconds with the correspond-ing CFD results obtained in hours,the accuracy highlights the development potential of deep transfer learning in aerodynamic evaluation.
文摘In radiology,magnetic resonance imaging(MRI)is an essential diagnostic tool that provides detailed images of a patient’s anatomical and physiological structures.MRI is particularly effective for detecting soft tissue anomalies.Traditionally,radiologists manually interpret these images,which can be labor-intensive and time-consuming due to the vast amount of data.To address this challenge,machine learning,and deep learning approaches can be utilized to improve the accuracy and efficiency of anomaly detection in MRI scans.This manuscript presents the use of the Deep AlexNet50 model for MRI classification with discriminative learning methods.There are three stages for learning;in the first stage,the whole dataset is used to learn the features.In the second stage,some layers of AlexNet50 are frozen with an augmented dataset,and in the third stage,AlexNet50 with an augmented dataset with the augmented dataset.This method used three publicly available MRI classification datasets:Harvard whole brain atlas(HWBA-dataset),the School of Biomedical Engineering of Southern Medical University(SMU-dataset),and The National Institute of Neuroscience and Hospitals brain MRI dataset(NINS-dataset)for analysis.Various hyperparameter optimizers like Adam,stochastic gradient descent(SGD),Root mean square propagation(RMS prop),Adamax,and AdamW have been used to compare the performance of the learning process.HWBA-dataset registers maximum classification performance.We evaluated the performance of the proposed classification model using several quantitative metrics,achieving an average accuracy of 98%.
文摘Many applications,including security systems,medical diagnostics,and human-computer interfaces,depend on eye gaze recognition.However,due to factors including individual variations,occlusions,and shifting illumination conditions,real-world scenarios continue to provide difficulties for accurate and consistent eye gaze recognition.This work is aimed at investigating the potential benefits of employing transfer learning to improve eye gaze detection ability and efficiency.Transfer learning is the process of fine-tuning pre-trained models on smaller,domain-specific datasets after they have been trained on larger datasets.We study several transfer learning algorithms and evaluate their effectiveness on eye gaze identification,including both Regression and Classification tasks,using a range of deep learning architectures,namely AlexNet,Visual Geometry Group(VGG),InceptionV3,and ResNet.In this study,we evaluate the effectiveness of transfer learning-basedmodels against models that were trained fromscratch using eye-gazing datasets on grounds of various performance and loss metrics such as Precision,Accuracy,and Mean Absolute Error.We investigate the effects of different pre-trainedmodels,dataset sizes,and domain gaps on the transfer learning process,and the findings of our study clarify the efficacy of transfer learning for eye gaze detection and offer suggestions for the most successful transfer learning strategies to apply in real-world situations.
文摘Deep Learning-based systems for Finger vein recognition have gained rising attention in recent years due to improved efficiency and enhanced security.The performance of existing CNN-based methods is limited by the puny generalization of learned features and deficiency of the finger vein image training data.Considering the concerns of existing methods,in this work,a simplified deep transfer learning-based framework for finger-vein recognition is developed using an EfficientNet model of deep learning with a self-attention mechanism.Data augmentation using various geometrical methods is employed to address the problem of training data shortage required for a deep learning model.The proposed model is tested using K-fold cross-validation on three publicly available datasets:HKPU,FVUSM,and SDUMLA.Also,the developed network is compared with other modern deep nets to check its effectiveness.In addition,a comparison of the proposed method with other existing Finger vein recognition(FVR)methods is also done.The experimental results exhibited superior recognition accuracy of the proposed method compared to other existing methods.In addition,the developed method proves to be more effective and less sophisticated at extracting robust features.The proposed EffAttenNet achieves an accuracy of 98.14%on HKPU,99.03%on FVUSM,and 99.50%on SDUMLA databases.
文摘This study rigorously evaluates the potential of transfer learning in diagnosing retinal eye diseases using advanced models such asYOLOv8,Xception,ConvNeXtTiny,andVGG16.All models were trained on the esteemed RFMiD dataset,which includes images classified into six critical categories:Diabetic Retinopathy(DR),Macular Hole(MH),Diabetic Neuropathy(DN),Optic Disc Changes(ODC),Tesselated Fundus(TSLN),and normal cases.The research emphasizes enhancing model performance by prioritizing recall metrics,a crucial strategy aimed at minimizing false negatives in medical diagnostics.To address the challenge of imbalanced data,we implemented effective preprocessing techniques,including cropping,resizing,and data augmentation.The proposed models underwent fine-tuning and were evaluated using established metrics such as accuracy,precision,and recall.The experimental results are compelling,with YOLOv8 achieving the highest recall rates for both normal cases(97.76%)and DR cases(87.10%),demonstrating its reliability in disease screening.In contrast,Xception showed a decline in recall after fine-tuning,particularly in identifying DR and MH cases,highlighting the need for a careful balance between sensitivity and specificity in model training.Notably,both ConvNeXtTiny and VGG16 exhibited significant improvements post-fine-tuning,with VGG16’s recall for normal conditions increasing dramatically from 40.30%to an impressive 89.55%.These findings clearly underscore the potential of utilizing pre-trained models through transfer learning for the effective detection of retinal eye diseases,ultimately contributing to improved patient outcomes in medical diagnostics.
基金supported by the Key Research and Development Plan of Anhui Province(202104a05020059)the Excellent Scientific Research and Innovation Team of Anhui Province(2022AH010003)support from Hefei Comprehensive National Science Center is highly appreciated.
文摘Microseismic monitoring technology is widely used in tunnel and coal mine safety production.For signals generated by ultra-weak microseismic events,traditional sensors encounter limitations in terms of detection sensitivity.Given the complex engineering environment,automatic multi-classification of microseismic data is highly required.In this study,we use acceleration sensors to collect signals and combine the improved Visual Geometry Group with a convolutional block attention module to obtain a new network structure,termed CNN_BAM,for automatic classification and identification of microseismic events.We use the dataset collected from the Hanjiang-to-Weihe River Diversion Project to train and validate the network model.Results show that the CNN_BAM model exhibits good feature extraction ability,achieving a recognition accuracy of 99.29%,surpassing all its counterparts.The stability and accuracy of the classification algorithm improve remarkably.In addition,through fine-tuning and migration to the Pan Ⅱ Mine Project,the network demonstrates reliable generalization performance.This outcome reflects its adaptability across different projects and promising application prospects.
基金funded by Advanced Research Project(30209040702).
文摘Named Entity Recognition(NER)is vital in natural language processing for the analysis of news texts,as it accurately identifies entities such as locations,persons,and organizations,which is crucial for applications like news summarization and event tracking.However,NER in the news domain faces challenges due to insufficient annotated data,complex entity structures,and strong context dependencies.To address these issues,we propose a new Chinesenamed entity recognition method that integrates transfer learning with word embeddings.Our approach leverages the ERNIE pre-trained model for transfer learning and obtaining general language representations and incorporates the Soft-lexicon word embedding technique to handle varied entity structures.This dual-strategy enhances the model’s understanding of context and boosts its ability to process complex texts.Experimental results show that our method achieves an F1 score of 94.72% on a news dataset,surpassing baseline methods by 3%–4%,thereby confirming its effectiveness for Chinese-named entity recognition in the news domain.
基金support provided by the China Postdoctoral Science Foundation(Grant No.2024M763650)the Excellent Young Scientists Fund Program of SINOPEC Petroleum Exploration and Production Research Institute(Grant No.yk2024010).
文摘Seismic fault identification is a critical step in structural interpretation,reservoir characterization,and well-drilling planning.However,fault identification in deep fault-karst carbonate formations is particularly challenging due to their deep burial depth and the complex effects of dissolution.Traditional manual interpretation methods are often labor intensive and prone to high uncertainty due to their subjective nature.To address these limitations,this study proposes a transfer learningebased strategy for fault identification in deep fault-karst carbonate formations.The proposed methodology began with the generation of a large volume of synthetic seismic samples based on statistical fault distribution patterns observed in the study area.These synthetic samples were used to pretrain an improved U-Net network architecture,enhanced with an attention mechanism,to create a robust pretrained model.Subsequently,real-world fault labels were manually annotated based on verified fault interpretations and integrated into the training dataset.This combination of synthetic and real-world data was used to fine-tune the pretrained model,significantly improving its fault interpretation accuracy.The experimental results demonstrate that the integration of synthetic and real-world samples effectively enhances the quality of the training dataset.Furthermore,the proposed transfer learning strategy significantly im-proves fault recognition accuracy.By replacing the traditional weighted cross-entropy loss function with the Dice loss function,the model successfully addresses the issue of extreme class imbalance between positive and negative samples.Practical applications confirm that the proposed transfer learning strategy can accurately identify fault structures in deep fault-karst carbonate formations,providing a novel and effective technical approach for fault interpretation in such complex geological settings.
文摘The COVID-19 pandemic,which was declared by the WHO,had created a global health crisis and disrupted people’s daily lives.A large number of people were affected by the COVID-19 pandemic.Therefore,a diagnostic model needs to be generated which can effectively classify the COVID and non-COVID cases.In this work,our aim is to develop a diagnostic model based on deep features using effectiveness of Chest X-ray(CXR)in distinguishing COVID from non-COVID cases.The proposed diagnostic framework utilizes CXR to diagnose COVID-19 and includes Grad-CAM visualizations for a visual interpretation of predicted images.The model’s performance was evaluated using various metrics,including accuracy,precision,recall,F1-score,and Gmean.Several machine learning models,such as random forest,dense neural network,SVM,twin SVM,extreme learning machine,random vector functional link,and kernel ridge regression,were selected to diagnose COVID-19 cases.Transfer learning was used to extract deep features.For feature extraction many CNN-based models such as Inception V3,MobileNet,ResNet50,VGG16 and Xception models are used.It was evident from the experiments that ResNet50 architecture outperformed all other CNN architectures based on AUC.The TWSVM classifier achieved the highest AUC score of 0.98 based on the ResNet50 feature vector.
基金supported by National Natural Science Foundation of China(51837002).
文摘Recognition methods of electromagnetic transients(EMT)have been widely used in power systems with the assumption that training and testing data are drawn from the same probability distribution.However,that assumption is hard to satisfy in industrial applications because the distribution of measured EMT testing data generally changes over time.The performance of these methods gradually deteriorates with the distribution shift.The phenomenon limits application of EMT recognition methods.Therefore,this paper proposes a transfer learning-based recognition network(TLRN)for EMT to break the limitation.It consists of a feature extractor,EMT recognizer,domain recognizer,and maximum mean discrepancy(MMD).The feature extractor is constructed to learn features of EMT automatically.The domain recognizer and MMD make features learned by the feature extractor domain invariant.Based on domain invariant features,the EMT recognizer achieves accurate EMT recognition,despite the distribution discrepancy between EMT training and testing data.TLRN maintains satisfactory EMT recognition performance by updating periodically with an unsupervised learning strategy.Using EMT datasets measured from different substations,scenario experiments,and experiment comparisons are conducted,and the recognition performance of the proposed TLRN is demonstrated.
基金Supported by National Natural Science Foundation of China(Grant No.51675040)。
文摘The electromagnetic pulse valve,as a key component in baghouse dust removal systems,plays a crucial role in the performance of the system.However,despite the promising results of intelligent fault diagnosis methods based on extensive data in diagnosing electromagnetic valves,real-world diagnostic scenarios still face numerous challenges.Collecting fault data for electromagnetic pulse valves is not only time-consuming but also costly,making it difficult to obtain sufficient fault data in advance,which poses challenges for small sample fault diagnosis.To address this issue,this paper proposes a fault diagnosis method for electromagnetic pulse valves based on deep transfer learning and simulated data.This method achieves effective transfer from simulated data to real data through four parameter transfer strategies,which combine parameter freezing and fine-tuning operations.Furthermore,this paper identifies a parameter transfer strategy that simultaneously fine-tunes the feature extractor and classifier,and introduces an attention mechanism to integrate fault features,thereby enhancing the correlation and information complementarity among multi-sensor data.The effectiveness of the proposed method is evaluated through two fault diagnosis cases under different operating conditions.In this study,small sample data accounted for 7.9%and 8.2%of the total dataset,and the experimental results showed transfer accuracies of 93.5%and 94.2%,respectively,validating the reliability and effectiveness of the method under small sample conditions.