This study presents a framework for predicting geological characteristics based on integrating a stacking classification algorithm(SCA) with a grid search(GS) and K-fold cross validation(K-CV). The SCA includes two le...This study presents a framework for predicting geological characteristics based on integrating a stacking classification algorithm(SCA) with a grid search(GS) and K-fold cross validation(K-CV). The SCA includes two learner layers: a primary learner’s layer and meta-classifier layer. The accuracy of the SCA can be improved by using the GS and K-CV. The GS was developed to match the hyper-parameters and optimise complicated problems. The K-CV is commonly applied to changing the validation set in a training set. In general, a GS is usually combined with K-CV to produce a corresponding evaluation index and select the best hyper-parameters. The torque penetration index(TPI) and field penetration index(FPI) are proposed based on shield parameters to express the geological characteristics. The elbow method(EM) and silhouette coefficient(Si) are employed to determine the types of geological characteristics(K) in a Kmeans++ algorithm. A case study on mixed ground in Guangzhou is adopted to validate the applicability of the developed model. The results show that with the developed framework, the four selected parameters, i.e. thrust, advance rate, cutterhead rotation speed and cutterhead torque, can be used to effectively predict the corresponding geological characteristics.展开更多
Rockburst is a common geological disaster in underground engineering,which seriously threatens the safety of personnel,equipment and property.Utilizing machine learning models to evaluate risk of rockburst is graduall...Rockburst is a common geological disaster in underground engineering,which seriously threatens the safety of personnel,equipment and property.Utilizing machine learning models to evaluate risk of rockburst is gradually becoming a trend.In this study,the integrated algorithms under Gradient Boosting Decision Tree(GBDT)framework were used to evaluate and classify rockburst intensity.First,a total of 301 rock burst data samples were obtained from a case database,and the data were preprocessed using synthetic minority over-sampling technique(SMOTE).Then,the rockburst evaluation models including GBDT,eXtreme Gradient Boosting(XGBoost),Light Gradient Boosting Machine(LightGBM),and Categorical Features Gradient Boosting(CatBoost)were established,and the optimal hyperparameters of the models were obtained through random search grid and five-fold cross-validation.Afterwards,use the optimal hyperparameter configuration to fit the evaluation models,and analyze these models using test set.In order to evaluate the performance,metrics including accuracy,precision,recall,and F1-score were selected to analyze and compare with other machine learning models.Finally,the trained models were used to conduct rock burst risk assessment on rock samples from a mine in Shanxi Province,China,and providing theoretical guidance for the mine's safe production work.The models under the GBDT framework perform well in the evaluation of rockburst levels,and the proposed methods can provide a reliable reference for rockburst risk level analysis and safety management.展开更多
Sustainable forecasting of home energy demand(SFHED)is crucial for promoting energy efficiency,minimizing environmental impact,and optimizing resource allocation.Machine learning(ML)supports SFHED by identifying patte...Sustainable forecasting of home energy demand(SFHED)is crucial for promoting energy efficiency,minimizing environmental impact,and optimizing resource allocation.Machine learning(ML)supports SFHED by identifying patterns and forecasting demand.However,conventional hyperparameter tuning methods often rely solely on minimizing average prediction errors,typically through fixed k-fold cross-validation,which overlooks error variability and limits model robustness.To address this limitation,we propose the Optimized Robust Hyperparameter Tuning for Machine Learning with Enhanced Multi-fold Cross-Validation(ORHT-ML-EMCV)framework.This method integrates statistical analysis of k-fold validation errors by incorporating their mean and variance into the optimization objective,enhancing robustness and generalizability.A weighting factor is introduced to balance accuracy and robustness,and its impact is evaluated across a range of values.A novel Enhanced Multi-Fold Cross-Validation(EMCV)technique is employed to automatically evaluate model performance across varying fold configurations without requiring a predefined k value,thereby reducing sensitivity to data splits.Using three evolutionary algorithms Genetic Algorithm(GA),Particle Swarm Optimization(PSO),and Differential Evolution(DE)we optimize two ensemble models:XGBoost and LightGBM.The optimization process minimizes both mean error and variance,with robustness assessed through cumulative distribution function(CDF)analyses.Experiments on three real-world residential datasets show the proposed method reduces worst-case Root Mean Square Error(RMSE)by up to 19.8%and narrows confidence intervals by up to 25%.Cross-household validations confirm strong generalization,achieving coefficient of determination(R²)of 0.946 and 0.972 on unseen homes.The framework offers a statistically grounded and efficient solution for robust energy forecasting.展开更多
Gully erosion is one of the important problems creating barrier to agricultural development.The present research used the radial basis function neural network(RBFnn)and its ensemble with random sub-space(RSS)and rotat...Gully erosion is one of the important problems creating barrier to agricultural development.The present research used the radial basis function neural network(RBFnn)and its ensemble with random sub-space(RSS)and rotation forest(RTF)ensemble Meta classifiers for the spatial mapping of gully erosion susceptibility(GES)in Hinglo river basin.120 gullies were marked and grouped into four-fold.A total of 23 factors including topographical,hydrological,lithological,and soil physio-chemical properties were effectively used.GES maps were built by RBFnn,RSS-RBFnn,and RTF-RBFnn models.The very high susceptibility zone of RBFnn,RTF-RBFnn and RSS-RBFnn models covered 6.75%,6.72%and 6.57%in Fold-1,6.21%,6.10%and 6.09%in Fold-2,6.26%,6.13%and 6.05%in Fold-3 and 7%,6.975%and 6.42%in Fold-4 of the basin.Receiver operating characteristics(ROC)curve and statistical techniques such as mean-absolute-error(MAE),root-mean-absolute-error(RMSE)and relative gully density area(R-index)methods were used for evaluating the GES maps.The results of the ROC,MAE,RMSE and R-index methods showed that the models of susceptibility to gully erosion have excellent predictive efficiency.The simulation results based on machine learning are satisfactory and outstanding and could be used to forecast the areas vulnerable to gully erosion.展开更多
Brain signal analysis from electroencephalogram(EEG)recordings is the gold standard for diagnosing various neural disorders especially epileptic seizure.Seizure signals are highly chaotic compared to normal brain sign...Brain signal analysis from electroencephalogram(EEG)recordings is the gold standard for diagnosing various neural disorders especially epileptic seizure.Seizure signals are highly chaotic compared to normal brain signals and thus can be identified from EEG recordings.In the current seizure detection and classification landscape,most models primarily focus on binary classification—distinguishing between seizure and non-seizure states.While effective for basic detection,these models fail to address the nuanced stages of seizures and the intervals between them.Accurate identification of per-seizure or interictal stages and the timing between seizures is crucial for an effective seizure alert system.This granularity is essential for improving patient-specific interventions and developing proactive seizure management strategies.This study addresses this gap by proposing a novel AI-based approach for seizure stage classification using a Deep Convolutional Neural Network(DCNN).The developed model goes beyond traditional binary classification by categorizing EEG recordings into three distinct classes,thus providing a more detailed analysis of seizure stages.To enhance the model’s performance,we have optimized the DCNN using two advanced techniques:the Stochastic Gradient Algorithm(SGA)and the evolutionary Genetic Algorithm(GA).These optimization strategies are designed to fine-tune the model’s accuracy and robustness.Moreover,k-fold cross-validation ensures the model’s reliability and generalizability across different data sets.Trained and validated on the Bonn EEG data sets,the proposed optimized DCNN model achieved a test accuracy of 93.2%,demonstrating its ability to accurately classify EEG signals.In summary,the key advancement of the present research lies in addressing the limitations of existing models by providing a more detailed seizure classification system,thus potentially enhancing the effectiveness of real-time seizure prediction and management systems in clinical settings.With its inherent classification performance,the proposed approach represents a significant step forward in improving patient outcomes through advanced AI techniques.展开更多
In real-world applications, datasets frequently contain outliers, which can hinder the generalization ability of machine learning models. Bayesian classifiers, a popular supervised learning method, rely on accurate pr...In real-world applications, datasets frequently contain outliers, which can hinder the generalization ability of machine learning models. Bayesian classifiers, a popular supervised learning method, rely on accurate probability density estimation for classifying continuous datasets. However, achieving precise density estimation with datasets containing outliers poses a significant challenge. This paper introduces a Bayesian classifier that utilizes optimized robust kernel density estimation to address this issue. Our proposed method enhances the accuracy of probability density distribution estimation by mitigating the impact of outliers on the training sample’s estimated distribution. Unlike the conventional kernel density estimator, our robust estimator can be seen as a weighted kernel mapping summary for each sample. This kernel mapping performs the inner product in the Hilbert space, allowing the kernel density estimation to be considered the average of the samples’ mapping in the Hilbert space using a reproducing kernel. M-estimation techniques are used to obtain accurate mean values and solve the weights. Meanwhile, complete cross-validation is used as the objective function to search for the optimal bandwidth, which impacts the estimator. The Harris Hawks Optimisation optimizes the objective function to improve the estimation accuracy. The experimental results show that it outperforms other optimization algorithms regarding convergence speed and objective function value during the bandwidth search. The optimal robust kernel density estimator achieves better fitness performance than the traditional kernel density estimator when the training data contains outliers. The Naïve Bayesian with optimal robust kernel density estimation improves the generalization in the classification with outliers.展开更多
Model validation is the most important part of building a supervised model.For building a model with good generalization performance one must have a sensible data splitting strategy,and this is crucial for model valid...Model validation is the most important part of building a supervised model.For building a model with good generalization performance one must have a sensible data splitting strategy,and this is crucial for model validation.In this study,we con-ducted a comparative study on various reported data splitting methods.The MixSim model was employed to generate nine simulated datasets with different probabilities of mis-classification and variable sample sizes.Then partial least squares for discriminant analysis and support vector machines for classification were applied to these datasets.Data splitting methods tested included variants of cross-validation,bootstrapping,bootstrapped Latin partition,Kennard-Stone algorithm(K-S)and sample set partitioning based on joint X-Y distances algorithm(SPXY).These methods were employed to split the data into training and validation sets.The estimated generalization performances from the validation sets were then compared with the ones obtained from the blind test sets which were generated from the same distribution but were unseen by the train-ing/validation procedure used in model construction.The results showed that the size of the data is the deciding factor for the qualities of the generalization performance estimated from the validation set.We found that there was a significant gap between the performance estimated from the validation set and the one from the test set for the all the data splitting methods employed on small datasets.Such disparity decreased when more samples were available for training/validation,and this is because the models were then moving towards approximations of the central limit theory for the simulated datasets used.We also found that having too many or too few samples in the training set had a negative effect on the estimated model performance,suggesting that it is necessary to have a good balance between the sizes of training set and validation set to have a reliable estimation of model performance.We also found that systematic sampling method such as K-S and SPXY generally had very poor estimation of the model performance,most likely due to the fact that they are designed to take the most representative samples first and thus left a rather poorly representative sample set for model performance estimation.展开更多
A forecasting system of patent application counts is studied in this paper. The optimization model proposed in the research is based on support vector machines （SVM）, in which cross-validation algorithm is used for ...A forecasting system of patent application counts is studied in this paper. The optimization model proposed in the research is based on support vector machines （SVM）, in which cross-validation algorithm is used for preferences selection. Results of data simulation show that the proposed method has higher forecasting precision power and stronger generalization ability than BP neural network and RBF neural network. In addi- tion, it is feasible and effective in forecasting patent application counts.展开更多
This paper investigated the resistance performance of a submersible surface ship(SSS)in different working cases and scales to analyze the hydrodynamic performance characteristics of an SSS at different speeds and divi...This paper investigated the resistance performance of a submersible surface ship(SSS)in different working cases and scales to analyze the hydrodynamic performance characteristics of an SSS at different speeds and diving depths for engineering applications.First,a hydrostatic resistance performance test of the SSS was carried out in a towing tank.Second,the scale effect of the hydrodynamic pressure coefficient and wave-making resistance was analyzed.The differences between the three-dimensional real-scale ship resistance prediction and numerical methods were explained.Finally,the advantages of genetic algorithm(GA)and neural network were combined to predict the resistance of SSS.Back propagation neural network(BPNN)and GA-BPNN were utilized to predict the SSS resistance.We also studied neural network parameter optimization,including connection weights and thresholds,using K-fold cross-validation.The results showed that when a SSS sails at low and medium speeds,the influence of various underwater cases on resistance is not obvious,while at high speeds,the resistance of water surface cases increases sharply with an increase in speed.After improving the weights and thresholds through K-fold cross-validation and GA,the prediction results of BPNN have high consistency with the actual values.The research results can provide a theoretical reference for the optimal design of the resistance of SSS in practical applications.展开更多
Accurate prediction on geological hazards can prevent disaster events in advance and greatly reduce property losses and life casualties.Glacial debris flows are the most serious hazards in southeastern Tibet in China ...Accurate prediction on geological hazards can prevent disaster events in advance and greatly reduce property losses and life casualties.Glacial debris flows are the most serious hazards in southeastern Tibet in China due to their complexity in formation mechanism and the difficulty in prediction.Data collected from 102 glacier debris flow events from 31 gullies since 1970 and regional meteorological data from 1970 to 2019 in ParlungZangbo River Basin in southeastern Tibet were used for Artificial Neural Network(ANN)-based prediction of glacial debris flows.The formation mechanism of glacial debris flows in the ParlungZangbo Basin was systematically analyzed,and the calculations involving the meteorological data and disaster events were conducted by using the statistical methods and two layers fully connected neural networks.The occurrence probabilities and scales of glacial debris flows(small,medium,and large)were predicted,and promising results have been achieved.Through the proposed model calculations,a prediction accuracy of 78.33%was achieved for the scale of glacial debris flows in the study area.The prediction accuracy for both large-and medium-scale debris flows are higher than that for small-scale debris flows.The debris flow scale and the probability of occurrence increase with increasing rainfall and temperature.In addition,the K-fold cross-validation method was used to verify the reliability of the model.The average accuracy of the model calculated under this method is about 93.3%,which validates the proposed model.Practices have proved that the combination of ANN and disaster events can provide sound prediction on geological hazards under complex conditions.展开更多
Given their technical and economic advantages,the application of explosive substances to rock mass excavation is widely used.However,because of serious environmental restraints,there has been an increasing need to use...Given their technical and economic advantages,the application of explosive substances to rock mass excavation is widely used.However,because of serious environmental restraints,there has been an increasing need to use complex tools to control environmental effects due to blast-induced ground vibrations.In the present study,an artificial neural network(ANN)with k-fold cross-validation was applied to a dataset containing 1114 observations that was obtained from published results;furthermore,quantitative and qualitative parameters were considered for ground vibration amplitude prediction.The best ANN model obtained has a maximum coefficient of determination of 0.840 and a mean absolute error of 5.59 and it comprises 17 input parameters,12 neurons in a one-layer hidden layer,and a sigmoid transfer function.Compared with the traditional models,the model obtained using the proposed methodology demonstrated better generalization ability.Furthermore,the proposed methodology offers an ANN model with higher prediction ability.展开更多
The automatic control of cleaning need to be based on the total amount of manure in the house. Therefore, this article established a prediction model for the total amount of manure in a pig house and took the number o...The automatic control of cleaning need to be based on the total amount of manure in the house. Therefore, this article established a prediction model for the total amount of manure in a pig house and took the number of pigs in the house, age, feed intake,feeding time, the time when the ammonia concentration increased the fastest and the daily fixed cleaning time as variable factors for modelling, so that the model could obtain the current manure output according to the real-time input of time. A Backpropagation(BP) neural network was used for training. The cross-validation method was used to select the best hyperparameters, and the genetic algorithm(GA), particle swarm optimization(PSO) algorithm and mind evolutionary algorithm(MEA) were selected to optimize the initial network weights. The results showed that the model could predict the amount of manure in real-time according to the model input. After the cross-validation method determined the hyperparameters, the GA, PSO and MEA were used to optimize the manure prediction model. The GA had the best average performance.展开更多
The process of selecting an artificial intelligence(AI)model to assist clinical diagnosis of a particular pathology and its validation tests is relevant since the values of accuracy,sensitivity and specificity may not...The process of selecting an artificial intelligence(AI)model to assist clinical diagnosis of a particular pathology and its validation tests is relevant since the values of accuracy,sensitivity and specificity may not reflect the behavior of the method in a real environment.Here,we provide helpful considerations to increase the success of using an AI model in clinical practice.展开更多
Diabetes is a chronic disease. In 2019, it was the ninth leading cause of death with an estimated 1.5 million deaths. Poorly controlled, diabetes can lead to serious health problems. That explains why early diagnosis ...Diabetes is a chronic disease. In 2019, it was the ninth leading cause of death with an estimated 1.5 million deaths. Poorly controlled, diabetes can lead to serious health problems. That explains why early diagnosis of diabetes is very important. Several approaches that use Artificial Intelligence, specifically Deep Learning, have been widely used with promising results. The contribution of this paper is in two-folds: 1) Deep Neural Network (DNN) approach is used on Pima Indian dataset to predict diabetes using 10 k-fold cross validation and 89% accuracy is obtained;2) comparative analysis of previous work is provided on diabetes prediction using DNN with the tested model. The results showed that 10 k-fold cross-validation could decrease the efficiency of diabetes prediction models using DNN.展开更多
Unlike the detection of marked on-street parking spaces,detecting unmarked spaces poses significant challenges due to the absence of clear physical demarcation and uneven gaps caused by irregular parking.In urban citi...Unlike the detection of marked on-street parking spaces,detecting unmarked spaces poses significant challenges due to the absence of clear physical demarcation and uneven gaps caused by irregular parking.In urban cities with heavy traffic flow,these challenges can result in traffic disruptions,rear-end collisions,sideswipes,and congestion as drivers struggle to make decisions.We propose a real-time detection system for on-street parking spaces using YOLO models and recommend the most suitable space based on KD-tree search.Lightweight versions of YOLOv5,YOLOv7-tiny,and YOLOv8 with different architectures are trained.Among the models,YOLOv5s with SPPF at the backbone achieved an F1-score of 0.89,which was selected for validation using k-fold cross-validation on our dataset.The Low variance and standard deviation recorded across folds indicate the model’s generalizability,reliability,and stability.Inference with KD-tree using predictions from the YOLO models recorded FPS of 37.9 for YOLOv5,67.2 for YOLOv7-tiny,and 67.0 for YOLOv8.The models successfully detect both marked and unmarked empty parking spaces on test data with varying inference speeds and FPS.These models can be efficiently deployed for real-time applications due to their high FPS,inference speed,and lightweight nature.In comparison with other state-of-the-art models,our models outperform them,further demonstrating their effectiveness.展开更多
Facial expression recognition(FER)is a vital application of image processing technology.In this paper,a FER model based on the residual network is proposed.The proposed model introduces the idea of the DenseNet,in whi...Facial expression recognition(FER)is a vital application of image processing technology.In this paper,a FER model based on the residual network is proposed.The proposed model introduces the idea of the DenseNet,in which the outputs of the residual blocks are not simply added but are linked to the channel dimension.In addition,transfer learning is used to reduce training costs and accelerate training speed.The accuracy and robustness of the proposed FER model were tested by K-fold cross-validation.Experimental results show that the proposed method has competitive performances on FER2013,FER plus(FERPlus),and the real-world affective faces database(RAF-DB).展开更多
Sericulture is the process of cultivating silkworms for the production of silk.High-quality production of silk without mixing with low quality is a great challenge faced in the silk production centers.One of the possi...Sericulture is the process of cultivating silkworms for the production of silk.High-quality production of silk without mixing with low quality is a great challenge faced in the silk production centers.One of the possibilities to overcome this issue is by separating male and female cocoons before extracting silk fibers from the cocoons as male cocoon silk fibers are finer than females.This study proposes a method for the classification of male and female cocoons with the help of X-ray images without destructing the cocoon.The study used popular single hybrid varieties FC1 and FC2 mulberry silkworm cocoons.The shape features of the pupa are considered for the classification process and were obtained without cutting the cocoon.A novel point interpolation method is used for the computation of the width and height of the cocoon.Different dimensionality reduction methods are employed to enhance the performance of the model.The preprocessed features are fed to the powerful ensemble learning method AdaBoost and used logistic regression as the base learner.This model attained a mean accuracy of 96.3%for FC1 and FC2 in cross-validation and 95.3%in FC1 and 95.1%in FC2 for external validation.展开更多
In recent years, the popular multifractal detrended fluctuation analysis （MF-DFA） is extended to two-dimensional （2D） version, which has been applied in some field of image processing. In this paper, based on the ...In recent years, the popular multifractal detrended fluctuation analysis （MF-DFA） is extended to two-dimensional （2D） version, which has been applied in some field of image processing. In this paper, based on the 2D MF-DFA, a novel multifractal estimation method for images, which we called the local multifractal detrended fluctuation analysis （LMF-DFA）, is proposed to recognize and distinguish 20 types of tea breeds. A set of new multifractal descriptors, namely the local multifractal fluctuation exponents is defined to portray the local scaling properties of a surface. After collecting 10 tea leaves for each breed and photographing them to standard images, the LMF-DFA method is used to extract characteristic parameters for the images. Our analysis finds that there are significant differences among the different tea breeds＇ characteristic parameters by analysis of variance. Both the proposed LMF-DFA exponents and another classic parameter, namely the exponent based on capacity measure method have been used as features to distinguish the 20 tea breeds. The comparison results illustrate that the LMF-DFA estimation can differentiate the tea breeds more effectively and provide more satisfactory accuracy.展开更多
基金funded by“The Pearl River Talent Recruitment Program”of Guangdong Province in 2019(Grant No.2019CX01G338)the Research Funding of Shantou University for New Faculty Member(Grant No.NTF19024-2019).
文摘This study presents a framework for predicting geological characteristics based on integrating a stacking classification algorithm(SCA) with a grid search(GS) and K-fold cross validation(K-CV). The SCA includes two learner layers: a primary learner’s layer and meta-classifier layer. The accuracy of the SCA can be improved by using the GS and K-CV. The GS was developed to match the hyper-parameters and optimise complicated problems. The K-CV is commonly applied to changing the validation set in a training set. In general, a GS is usually combined with K-CV to produce a corresponding evaluation index and select the best hyper-parameters. The torque penetration index(TPI) and field penetration index(FPI) are proposed based on shield parameters to express the geological characteristics. The elbow method(EM) and silhouette coefficient(Si) are employed to determine the types of geological characteristics(K) in a Kmeans++ algorithm. A case study on mixed ground in Guangzhou is adopted to validate the applicability of the developed model. The results show that with the developed framework, the four selected parameters, i.e. thrust, advance rate, cutterhead rotation speed and cutterhead torque, can be used to effectively predict the corresponding geological characteristics.
基金Project(52161135301)supported by the International Cooperation and Exchange of the National Natural Science Foundation of ChinaProject(202306370296)supported by China Scholarship Council。
文摘Rockburst is a common geological disaster in underground engineering,which seriously threatens the safety of personnel,equipment and property.Utilizing machine learning models to evaluate risk of rockburst is gradually becoming a trend.In this study,the integrated algorithms under Gradient Boosting Decision Tree(GBDT)framework were used to evaluate and classify rockburst intensity.First,a total of 301 rock burst data samples were obtained from a case database,and the data were preprocessed using synthetic minority over-sampling technique(SMOTE).Then,the rockburst evaluation models including GBDT,eXtreme Gradient Boosting(XGBoost),Light Gradient Boosting Machine(LightGBM),and Categorical Features Gradient Boosting(CatBoost)were established,and the optimal hyperparameters of the models were obtained through random search grid and five-fold cross-validation.Afterwards,use the optimal hyperparameter configuration to fit the evaluation models,and analyze these models using test set.In order to evaluate the performance,metrics including accuracy,precision,recall,and F1-score were selected to analyze and compare with other machine learning models.Finally,the trained models were used to conduct rock burst risk assessment on rock samples from a mine in Shanxi Province,China,and providing theoretical guidance for the mine's safe production work.The models under the GBDT framework perform well in the evaluation of rockburst levels,and the proposed methods can provide a reliable reference for rockburst risk level analysis and safety management.
文摘Sustainable forecasting of home energy demand(SFHED)is crucial for promoting energy efficiency,minimizing environmental impact,and optimizing resource allocation.Machine learning(ML)supports SFHED by identifying patterns and forecasting demand.However,conventional hyperparameter tuning methods often rely solely on minimizing average prediction errors,typically through fixed k-fold cross-validation,which overlooks error variability and limits model robustness.To address this limitation,we propose the Optimized Robust Hyperparameter Tuning for Machine Learning with Enhanced Multi-fold Cross-Validation(ORHT-ML-EMCV)framework.This method integrates statistical analysis of k-fold validation errors by incorporating their mean and variance into the optimization objective,enhancing robustness and generalizability.A weighting factor is introduced to balance accuracy and robustness,and its impact is evaluated across a range of values.A novel Enhanced Multi-Fold Cross-Validation(EMCV)technique is employed to automatically evaluate model performance across varying fold configurations without requiring a predefined k value,thereby reducing sensitivity to data splits.Using three evolutionary algorithms Genetic Algorithm(GA),Particle Swarm Optimization(PSO),and Differential Evolution(DE)we optimize two ensemble models:XGBoost and LightGBM.The optimization process minimizes both mean error and variance,with robustness assessed through cumulative distribution function(CDF)analyses.Experiments on three real-world residential datasets show the proposed method reduces worst-case Root Mean Square Error(RMSE)by up to 19.8%and narrows confidence intervals by up to 25%.Cross-household validations confirm strong generalization,achieving coefficient of determination(R²)of 0.946 and 0.972 on unseen homes.The framework offers a statistically grounded and efficient solution for robust energy forecasting.
文摘Gully erosion is one of the important problems creating barrier to agricultural development.The present research used the radial basis function neural network(RBFnn)and its ensemble with random sub-space(RSS)and rotation forest(RTF)ensemble Meta classifiers for the spatial mapping of gully erosion susceptibility(GES)in Hinglo river basin.120 gullies were marked and grouped into four-fold.A total of 23 factors including topographical,hydrological,lithological,and soil physio-chemical properties were effectively used.GES maps were built by RBFnn,RSS-RBFnn,and RTF-RBFnn models.The very high susceptibility zone of RBFnn,RTF-RBFnn and RSS-RBFnn models covered 6.75%,6.72%and 6.57%in Fold-1,6.21%,6.10%and 6.09%in Fold-2,6.26%,6.13%and 6.05%in Fold-3 and 7%,6.975%and 6.42%in Fold-4 of the basin.Receiver operating characteristics(ROC)curve and statistical techniques such as mean-absolute-error(MAE),root-mean-absolute-error(RMSE)and relative gully density area(R-index)methods were used for evaluating the GES maps.The results of the ROC,MAE,RMSE and R-index methods showed that the models of susceptibility to gully erosion have excellent predictive efficiency.The simulation results based on machine learning are satisfactory and outstanding and could be used to forecast the areas vulnerable to gully erosion.
基金funded by the Researchers Supporting Program at King Saud University(RSPD2024R809).
文摘Brain signal analysis from electroencephalogram(EEG)recordings is the gold standard for diagnosing various neural disorders especially epileptic seizure.Seizure signals are highly chaotic compared to normal brain signals and thus can be identified from EEG recordings.In the current seizure detection and classification landscape,most models primarily focus on binary classification—distinguishing between seizure and non-seizure states.While effective for basic detection,these models fail to address the nuanced stages of seizures and the intervals between them.Accurate identification of per-seizure or interictal stages and the timing between seizures is crucial for an effective seizure alert system.This granularity is essential for improving patient-specific interventions and developing proactive seizure management strategies.This study addresses this gap by proposing a novel AI-based approach for seizure stage classification using a Deep Convolutional Neural Network(DCNN).The developed model goes beyond traditional binary classification by categorizing EEG recordings into three distinct classes,thus providing a more detailed analysis of seizure stages.To enhance the model’s performance,we have optimized the DCNN using two advanced techniques:the Stochastic Gradient Algorithm(SGA)and the evolutionary Genetic Algorithm(GA).These optimization strategies are designed to fine-tune the model’s accuracy and robustness.Moreover,k-fold cross-validation ensures the model’s reliability and generalizability across different data sets.Trained and validated on the Bonn EEG data sets,the proposed optimized DCNN model achieved a test accuracy of 93.2%,demonstrating its ability to accurately classify EEG signals.In summary,the key advancement of the present research lies in addressing the limitations of existing models by providing a more detailed seizure classification system,thus potentially enhancing the effectiveness of real-time seizure prediction and management systems in clinical settings.With its inherent classification performance,the proposed approach represents a significant step forward in improving patient outcomes through advanced AI techniques.
文摘In real-world applications, datasets frequently contain outliers, which can hinder the generalization ability of machine learning models. Bayesian classifiers, a popular supervised learning method, rely on accurate probability density estimation for classifying continuous datasets. However, achieving precise density estimation with datasets containing outliers poses a significant challenge. This paper introduces a Bayesian classifier that utilizes optimized robust kernel density estimation to address this issue. Our proposed method enhances the accuracy of probability density distribution estimation by mitigating the impact of outliers on the training sample’s estimated distribution. Unlike the conventional kernel density estimator, our robust estimator can be seen as a weighted kernel mapping summary for each sample. This kernel mapping performs the inner product in the Hilbert space, allowing the kernel density estimation to be considered the average of the samples’ mapping in the Hilbert space using a reproducing kernel. M-estimation techniques are used to obtain accurate mean values and solve the weights. Meanwhile, complete cross-validation is used as the objective function to search for the optimal bandwidth, which impacts the estimator. The Harris Hawks Optimisation optimizes the objective function to improve the estimation accuracy. The experimental results show that it outperforms other optimization algorithms regarding convergence speed and objective function value during the bandwidth search. The optimal robust kernel density estimator achieves better fitness performance than the traditional kernel density estimator when the training data contains outliers. The Naïve Bayesian with optimal robust kernel density estimation improves the generalization in the classification with outliers.
基金YX and RG thank Wellcome Trust for funding MetaboFlow(Grant 202952/Z/16/Z).
文摘Model validation is the most important part of building a supervised model.For building a model with good generalization performance one must have a sensible data splitting strategy,and this is crucial for model validation.In this study,we con-ducted a comparative study on various reported data splitting methods.The MixSim model was employed to generate nine simulated datasets with different probabilities of mis-classification and variable sample sizes.Then partial least squares for discriminant analysis and support vector machines for classification were applied to these datasets.Data splitting methods tested included variants of cross-validation,bootstrapping,bootstrapped Latin partition,Kennard-Stone algorithm(K-S)and sample set partitioning based on joint X-Y distances algorithm(SPXY).These methods were employed to split the data into training and validation sets.The estimated generalization performances from the validation sets were then compared with the ones obtained from the blind test sets which were generated from the same distribution but were unseen by the train-ing/validation procedure used in model construction.The results showed that the size of the data is the deciding factor for the qualities of the generalization performance estimated from the validation set.We found that there was a significant gap between the performance estimated from the validation set and the one from the test set for the all the data splitting methods employed on small datasets.Such disparity decreased when more samples were available for training/validation,and this is because the models were then moving towards approximations of the central limit theory for the simulated datasets used.We also found that having too many or too few samples in the training set had a negative effect on the estimated model performance,suggesting that it is necessary to have a good balance between the sizes of training set and validation set to have a reliable estimation of model performance.We also found that systematic sampling method such as K-S and SPXY generally had very poor estimation of the model performance,most likely due to the fact that they are designed to take the most representative samples first and thus left a rather poorly representative sample set for model performance estimation.
基金Sponsored by "985" Philosophy and Social Science Innovation Base of the Ministry of Education of China (107008200400024)
文摘A forecasting system of patent application counts is studied in this paper. The optimization model proposed in the research is based on support vector machines （SVM）, in which cross-validation algorithm is used for preferences selection. Results of data simulation show that the proposed method has higher forecasting precision power and stronger generalization ability than BP neural network and RBF neural network. In addi- tion, it is feasible and effective in forecasting patent application counts.
文摘This paper investigated the resistance performance of a submersible surface ship(SSS)in different working cases and scales to analyze the hydrodynamic performance characteristics of an SSS at different speeds and diving depths for engineering applications.First,a hydrostatic resistance performance test of the SSS was carried out in a towing tank.Second,the scale effect of the hydrodynamic pressure coefficient and wave-making resistance was analyzed.The differences between the three-dimensional real-scale ship resistance prediction and numerical methods were explained.Finally,the advantages of genetic algorithm(GA)and neural network were combined to predict the resistance of SSS.Back propagation neural network(BPNN)and GA-BPNN were utilized to predict the SSS resistance.We also studied neural network parameter optimization,including connection weights and thresholds,using K-fold cross-validation.The results showed that when a SSS sails at low and medium speeds,the influence of various underwater cases on resistance is not obvious,while at high speeds,the resistance of water surface cases increases sharply with an increase in speed.After improving the weights and thresholds through K-fold cross-validation and GA,the prediction results of BPNN have high consistency with the actual values.The research results can provide a theoretical reference for the optimal design of the resistance of SSS in practical applications.
基金supported by the National Natural Science Foundation of China(Grant No.41671112)the Sichuan Province Science and Technology Plan Project Key research and development projects(Grant No.18ZDYF0329)the National Natural Science Foundation of China(Grant No.41861134008)。
文摘Accurate prediction on geological hazards can prevent disaster events in advance and greatly reduce property losses and life casualties.Glacial debris flows are the most serious hazards in southeastern Tibet in China due to their complexity in formation mechanism and the difficulty in prediction.Data collected from 102 glacier debris flow events from 31 gullies since 1970 and regional meteorological data from 1970 to 2019 in ParlungZangbo River Basin in southeastern Tibet were used for Artificial Neural Network(ANN)-based prediction of glacial debris flows.The formation mechanism of glacial debris flows in the ParlungZangbo Basin was systematically analyzed,and the calculations involving the meteorological data and disaster events were conducted by using the statistical methods and two layers fully connected neural networks.The occurrence probabilities and scales of glacial debris flows(small,medium,and large)were predicted,and promising results have been achieved.Through the proposed model calculations,a prediction accuracy of 78.33%was achieved for the scale of glacial debris flows in the study area.The prediction accuracy for both large-and medium-scale debris flows are higher than that for small-scale debris flows.The debris flow scale and the probability of occurrence increase with increasing rainfall and temperature.In addition,the K-fold cross-validation method was used to verify the reliability of the model.The average accuracy of the model calculated under this method is about 93.3%,which validates the proposed model.Practices have proved that the combination of ANN and disaster events can provide sound prediction on geological hazards under complex conditions.
基金the support of CERENA–Center for Natural Resources and Environment(strategic project FCT-UID/ECI/04028/2019),Portugal.
文摘Given their technical and economic advantages,the application of explosive substances to rock mass excavation is widely used.However,because of serious environmental restraints,there has been an increasing need to use complex tools to control environmental effects due to blast-induced ground vibrations.In the present study,an artificial neural network(ANN)with k-fold cross-validation was applied to a dataset containing 1114 observations that was obtained from published results;furthermore,quantitative and qualitative parameters were considered for ground vibration amplitude prediction.The best ANN model obtained has a maximum coefficient of determination of 0.840 and a mean absolute error of 5.59 and it comprises 17 input parameters,12 neurons in a one-layer hidden layer,and a sigmoid transfer function.Compared with the traditional models,the model obtained using the proposed methodology demonstrated better generalization ability.Furthermore,the proposed methodology offers an ANN model with higher prediction ability.
基金the National Key Research and Development Program (2018YFD0500704-03)Proiect of Ministry of Agriculture and Rura Affairs (SK201707)。
文摘The automatic control of cleaning need to be based on the total amount of manure in the house. Therefore, this article established a prediction model for the total amount of manure in a pig house and took the number of pigs in the house, age, feed intake,feeding time, the time when the ammonia concentration increased the fastest and the daily fixed cleaning time as variable factors for modelling, so that the model could obtain the current manure output according to the real-time input of time. A Backpropagation(BP) neural network was used for training. The cross-validation method was used to select the best hyperparameters, and the genetic algorithm(GA), particle swarm optimization(PSO) algorithm and mind evolutionary algorithm(MEA) were selected to optimize the initial network weights. The results showed that the model could predict the amount of manure in real-time according to the model input. After the cross-validation method determined the hyperparameters, the GA, PSO and MEA were used to optimize the manure prediction model. The GA had the best average performance.
基金Supported by SEDENA Budgetary Program,No.A022-2021.
文摘The process of selecting an artificial intelligence(AI)model to assist clinical diagnosis of a particular pathology and its validation tests is relevant since the values of accuracy,sensitivity and specificity may not reflect the behavior of the method in a real environment.Here,we provide helpful considerations to increase the success of using an AI model in clinical practice.
文摘Diabetes is a chronic disease. In 2019, it was the ninth leading cause of death with an estimated 1.5 million deaths. Poorly controlled, diabetes can lead to serious health problems. That explains why early diagnosis of diabetes is very important. Several approaches that use Artificial Intelligence, specifically Deep Learning, have been widely used with promising results. The contribution of this paper is in two-folds: 1) Deep Neural Network (DNN) approach is used on Pima Indian dataset to predict diabetes using 10 k-fold cross validation and 89% accuracy is obtained;2) comparative analysis of previous work is provided on diabetes prediction using DNN with the tested model. The results showed that 10 k-fold cross-validation could decrease the efficiency of diabetes prediction models using DNN.
基金supports this paper.Project Nos.NSTC-112-2221-E-324-003 MY3,NSTC-111-2622-E-324-002 and NSTC-112-2221-E-324-011-MY2.
文摘Unlike the detection of marked on-street parking spaces,detecting unmarked spaces poses significant challenges due to the absence of clear physical demarcation and uneven gaps caused by irregular parking.In urban cities with heavy traffic flow,these challenges can result in traffic disruptions,rear-end collisions,sideswipes,and congestion as drivers struggle to make decisions.We propose a real-time detection system for on-street parking spaces using YOLO models and recommend the most suitable space based on KD-tree search.Lightweight versions of YOLOv5,YOLOv7-tiny,and YOLOv8 with different architectures are trained.Among the models,YOLOv5s with SPPF at the backbone achieved an F1-score of 0.89,which was selected for validation using k-fold cross-validation on our dataset.The Low variance and standard deviation recorded across folds indicate the model’s generalizability,reliability,and stability.Inference with KD-tree using predictions from the YOLO models recorded FPS of 37.9 for YOLOv5,67.2 for YOLOv7-tiny,and 67.0 for YOLOv8.The models successfully detect both marked and unmarked empty parking spaces on test data with varying inference speeds and FPS.These models can be efficiently deployed for real-time applications due to their high FPS,inference speed,and lightweight nature.In comparison with other state-of-the-art models,our models outperform them,further demonstrating their effectiveness.
基金supported by the National Natural Science Foundation of China(51105213)。
文摘Facial expression recognition(FER)is a vital application of image processing technology.In this paper,a FER model based on the residual network is proposed.The proposed model introduces the idea of the DenseNet,in which the outputs of the residual blocks are not simply added but are linked to the channel dimension.In addition,transfer learning is used to reduce training costs and accelerate training speed.The accuracy and robustness of the proposed FER model were tested by K-fold cross-validation.Experimental results show that the proposed method has competitive performances on FER2013,FER plus(FERPlus),and the real-world affective faces database(RAF-DB).
基金funded by the Department of Science&Technology(DST)with grant reference number:SEED/WS/2019/135.
文摘Sericulture is the process of cultivating silkworms for the production of silk.High-quality production of silk without mixing with low quality is a great challenge faced in the silk production centers.One of the possibilities to overcome this issue is by separating male and female cocoons before extracting silk fibers from the cocoons as male cocoon silk fibers are finer than females.This study proposes a method for the classification of male and female cocoons with the help of X-ray images without destructing the cocoon.The study used popular single hybrid varieties FC1 and FC2 mulberry silkworm cocoons.The shape features of the pupa are considered for the classification process and were obtained without cutting the cocoon.A novel point interpolation method is used for the computation of the width and height of the cocoon.Different dimensionality reduction methods are employed to enhance the performance of the model.The preprocessed features are fed to the powerful ensemble learning method AdaBoost and used logistic regression as the base learner.This model attained a mean accuracy of 96.3%for FC1 and FC2 in cross-validation and 95.3%in FC1 and 95.1%in FC2 for external validation.
文摘In recent years, the popular multifractal detrended fluctuation analysis （MF-DFA） is extended to two-dimensional （2D） version, which has been applied in some field of image processing. In this paper, based on the 2D MF-DFA, a novel multifractal estimation method for images, which we called the local multifractal detrended fluctuation analysis （LMF-DFA）, is proposed to recognize and distinguish 20 types of tea breeds. A set of new multifractal descriptors, namely the local multifractal fluctuation exponents is defined to portray the local scaling properties of a surface. After collecting 10 tea leaves for each breed and photographing them to standard images, the LMF-DFA method is used to extract characteristic parameters for the images. Our analysis finds that there are significant differences among the different tea breeds＇ characteristic parameters by analysis of variance. Both the proposed LMF-DFA exponents and another classic parameter, namely the exponent based on capacity measure method have been used as features to distinguish the 20 tea breeds. The comparison results illustrate that the LMF-DFA estimation can differentiate the tea breeds more effectively and provide more satisfactory accuracy.
