A new intrusion detection method based on learning vector quantization (LVQ) with low overhead and high efficiency is presented. The computer vision system employs LVQ neural networks as classifier to recognize intr...A new intrusion detection method based on learning vector quantization (LVQ) with low overhead and high efficiency is presented. The computer vision system employs LVQ neural networks as classifier to recognize intrusion. The recognition process includes three stages: (1) feature selection and data normalization processing;(2) learning the training data selected from the feature data set; (3) identifying the intrusion and generating the result report of machine condition classification. Experimental results show that the proposed method is promising in terms of detection accuracy, computational expense and implementation for intrusion detection.展开更多
The prediction of solar radiation is important for several applications in renewable energy research. There are a number of geographical variables which affect solar radiation prediction, the identification of these v...The prediction of solar radiation is important for several applications in renewable energy research. There are a number of geographical variables which affect solar radiation prediction, the identification of these variables for accurate solar radiation prediction is very important. This paper presents a hybrid method for the compression of solar radiation using predictive analysis. The prediction of minute wise solar radiation is performed by using different models of Artificial Neural Networks (ANN), namely Multi-layer perceptron neural network (MLPNN), Cascade feed forward back propagation (CFNN) and Elman back propagation (ELMNN). Root mean square error (RMSE) is used to evaluate the prediction accuracy of the three ANN models used. The information and knowledge gained from the present study could improve the accuracy of analysis concerning climate studies and help in congestion control.展开更多
Multistage Vector Quantization(MSVQ) can achieve very low encoding and storage complexity in comparison to unstructured vector quantization. However, the conventional MSVQ is suboptimal with respect to the overall per...Multistage Vector Quantization(MSVQ) can achieve very low encoding and storage complexity in comparison to unstructured vector quantization. However, the conventional MSVQ is suboptimal with respect to the overall performance measure. This paper proposes a new technology to design the decoder codebook, which is different from the encoder codebook to optimise the overall performance. The performance improvement is achieved with no effect on encoding complexity, both storage and time consuming, but a modest increase in storage complexity of decoder.展开更多
Due to the fact that a memristor with memory properties is an ideal electronic component for implementation of the artificial neural synaptic function,a brand-new tristable locally active memristor model is first prop...Due to the fact that a memristor with memory properties is an ideal electronic component for implementation of the artificial neural synaptic function,a brand-new tristable locally active memristor model is first proposed in this paper.Here,a novel four-dimensional fractional-order memristive cellular neural network(FO-MCNN)model with hidden attractors is constructed to enhance the engineering feasibility of the original CNN model and its performance.Then,its hardware circuit implementation and complicated dynamic properties are investigated on multi-simulation platforms.Subsequently,it is used toward secure communication application scenarios.Taking it as the pseudo-random number generator(PRNG),a new privacy image security scheme is designed based on the adaptive sampling rate compressive sensing(ASR-CS)model.Eventually,the simulation analysis and comparative experiments manifest that the proposed data encryption scheme possesses strong immunity against various security attack models and satisfactory compression performance.展开更多
At present,the acquisition of seismic data is developing toward high-precision and high-density methods.However,complex natural environments and cultural factors in many exploration areas cause difficulties in achievi...At present,the acquisition of seismic data is developing toward high-precision and high-density methods.However,complex natural environments and cultural factors in many exploration areas cause difficulties in achieving uniform and intensive acquisition,which makes complete seismic data collection impossible.Therefore,data reconstruction is required in the processing link to ensure imaging accuracy.Deep learning,as a new field in rapid development,presents clear advantages in feature extraction and modeling.In this study,the convolutional neural network deep learning algorithm is applied to seismic data reconstruction.Based on the convolutional neural network algorithm and combined with the characteristics of seismic data acquisition,two training strategies of supervised and unsupervised learning are designed to reconstruct sparse acquisition seismic records.First,a supervised learning strategy is proposed for labeled data,wherein the complete seismic data are segmented as the input of the training set and are randomly sampled before each training,thereby increasing the number of samples and the richness of features.Second,an unsupervised learning strategy based on large samples is proposed for unlabeled data,and the rolling segmentation method is used to update(pseudo)labels and training parameters in the training process.Through the reconstruction test of simulated and actual data,the deep learning algorithm based on a convolutional neural network shows better reconstruction quality and higher accuracy than compressed sensing based on Curvelet transform.展开更多
Aiming at the reliability analysis of small sample data or implicit structural function,a novel structural reliability analysis model based on support vector machine(SVM)and neural network direct integration method(DN...Aiming at the reliability analysis of small sample data or implicit structural function,a novel structural reliability analysis model based on support vector machine(SVM)and neural network direct integration method(DNN)is proposed.Firstly,SVM with good small sample learning ability is used to train small sample data,fit structural performance functions and establish regular integration regions.Secondly,DNN is approximated the integral function to achieve multiple integration in the integration region.Finally,structural reliability was obtained by DNN.Numerical examples are investigated to demonstrate the effectiveness of the present method,which provides a feasible way for the structural reliability analysis.展开更多
First of all a simple and practical rectangular transform is given,and then thevector quantization technique which is rapidly developing recently is introduced.We combinethe rectangular transform with vector quantizat...First of all a simple and practical rectangular transform is given,and then thevector quantization technique which is rapidly developing recently is introduced.We combinethe rectangular transform with vector quantization technique for image data compression.Thecombination cuts down the dimensions of vector coding.The size of the codebook can reasonablybe reduced.This method can reduce the computation complexity and pick up the vector codingprocess.Experiments using image processing system show that this method is very effective inthe field of image data compression.展开更多
The exponential growth of data necessitates an effective data storage scheme,which helps to effectively manage the large quantity of data.To accomplish this,Deoxyribonucleic Acid(DNA)digital data storage process can b...The exponential growth of data necessitates an effective data storage scheme,which helps to effectively manage the large quantity of data.To accomplish this,Deoxyribonucleic Acid(DNA)digital data storage process can be employed,which encodes and decodes binary data to and from synthesized strands of DNA.Vector quantization(VQ)is a commonly employed scheme for image compression and the optimal codebook generation is an effective process to reach maximum compression efficiency.This article introduces a newDNAComputingwithWater StriderAlgorithm based Vector Quantization(DNAC-WSAVQ)technique for Data Storage Systems.The proposed DNAC-WSAVQ technique enables encoding data using DNA computing and then compresses it for effective data storage.Besides,the DNAC-WSAVQ model initially performsDNA encoding on the input images to generate a binary encoded form.In addition,aWater Strider algorithm with Linde-Buzo-Gray(WSA-LBG)model is applied for the compression process and thereby storage area can be considerably minimized.In order to generate optimal codebook for LBG,the WSA is applied to it.The performance validation of the DNAC-WSAVQ model is carried out and the results are inspected under several measures.The comparative study highlighted the improved outcomes of the DNAC-WSAVQ model over the existing methods.展开更多
Parkinson’s disease(PD)is a debilitating neurological disorder affecting over 10 million people worldwide.PD classification models using voice signals as input are common in the literature.It is believed that using d...Parkinson’s disease(PD)is a debilitating neurological disorder affecting over 10 million people worldwide.PD classification models using voice signals as input are common in the literature.It is believed that using deep learning algorithms further enhances performance;nevertheless,it is challenging due to the nature of small-scale and imbalanced PD datasets.This paper proposed a convolutional neural network-based deep support vector machine(CNN-DSVM)to automate the feature extraction process using CNN and extend the conventional SVM to a DSVM for better classification performance in small-scale PD datasets.A customized kernel function reduces the impact of biased classification towards the majority class(healthy candidates in our consideration).An improved generative adversarial network(IGAN)was designed to generate additional training data to enhance the model’s performance.For performance evaluation,the proposed algorithm achieves a sensitivity of 97.6%and a specificity of 97.3%.The performance comparison is evaluated from five perspectives,including comparisons with different data generation algorithms,feature extraction techniques,kernel functions,and existing works.Results reveal the effectiveness of the IGAN algorithm,which improves the sensitivity and specificity by 4.05%–4.72%and 4.96%–5.86%,respectively;and the effectiveness of the CNN-DSVM algorithm,which improves the sensitivity by 1.24%–57.4%and specificity by 1.04%–163%and reduces biased detection towards the majority class.The ablation experiments confirm the effectiveness of individual components.Two future research directions have also been suggested.展开更多
A large amount of data can partly assure good fitting quality for the trained neural networks.When the quantity of experimental or on-site monitoring data is commonly insufficient and the quality is difficult to contr...A large amount of data can partly assure good fitting quality for the trained neural networks.When the quantity of experimental or on-site monitoring data is commonly insufficient and the quality is difficult to control in engineering practice,numerical simulations can provide a large amount of controlled high quality data.Once the neural networks are trained by such data,they can be used for predicting the properties/responses of the engineering objects instantly,saving the further computing efforts of simulation tools.Correspondingly,a strategy for efficiently transferring the input and output data used and obtained in numerical simulations to neural networks is desirable for engineers and programmers.In this work,we proposed a simple image representation strategy of numerical simulations,where the input and output data are all represented by images.The temporal and spatial information is kept and the data are greatly compressed.In addition,the results are readable for not only computers but also human resources.Some examples are given,indicating the effectiveness of the proposed strategy.展开更多
Heart failure is now widely spread throughout the world.Heart disease affects approximately 48%of the population.It is too expensive and also difficult to cure the disease.This research paper represents machine learni...Heart failure is now widely spread throughout the world.Heart disease affects approximately 48%of the population.It is too expensive and also difficult to cure the disease.This research paper represents machine learning models to predict heart failure.The fundamental concept is to compare the correctness of various Machine Learning(ML)algorithms and boost algorithms to improve models’accuracy for prediction.Some supervised algorithms like K-Nearest Neighbor(KNN),Support Vector Machine(SVM),Decision Trees(DT),Random Forest(RF),Logistic Regression(LR)are considered to achieve the best results.Some boosting algorithms like Extreme Gradient Boosting(XGBoost)and Cat-Boost are also used to improve the prediction using Artificial Neural Networks(ANN).This research also focuses on data visualization to identify patterns,trends,and outliers in a massive data set.Python and Scikit-learns are used for ML.Tensor Flow and Keras,along with Python,are used for ANN model train-ing.The DT and RF algorithms achieved the highest accuracy of 95%among the classifiers.Meanwhile,KNN obtained a second height accuracy of 93.33%.XGBoost had a gratified accuracy of 91.67%,SVM,CATBoost,and ANN had an accuracy of 90%,and LR had 88.33%accuracy.展开更多
Protein Secondary Structure Prediction (PSSP) is considered as one of the major challenging tasks in bioinformatics, so many solutions have been proposed to solve that problem via trying to achieve more accurate predi...Protein Secondary Structure Prediction (PSSP) is considered as one of the major challenging tasks in bioinformatics, so many solutions have been proposed to solve that problem via trying to achieve more accurate prediction results. The goal of this paper is to develop and implement an intelligent based system to predict secondary structure of a protein from its primary amino acid sequence by using five models of Neural Network (NN). These models are Feed Forward Neural Network (FNN), Learning Vector Quantization (LVQ), Probabilistic Neural Network (PNN), Convolutional Neural Network (CNN), and CNN Fine Tuning for PSSP. To evaluate our approaches two datasets have been used. The first one contains 114 protein samples, and the second one contains 1845 protein samples.展开更多
The increasing demand for sustainable construction practices has led to growing interest in recycled aggregate concrete(RAC)as an eco-friendly alternative to conventional concrete.However,predicting its compressive st...The increasing demand for sustainable construction practices has led to growing interest in recycled aggregate concrete(RAC)as an eco-friendly alternative to conventional concrete.However,predicting its compressive strength remains a challenge due to the variability in recycled materials and mix design parameters.This study presents a robust machine learning framework for predicting the compressive strength of recycled aggregate concrete using feedforward neural networks(FFNN),Random Forest(RF),and XGBoost.A literature-derived dataset of 502 samples was enriched via interpolation-based data augmentation and modeled using five distinct optimization techniques within MATLAB’s Neural Net Fitting module:Bayesian Regularization,Levenberg-Marquardt,and three conjugate gradient variants—Powell/Beale Restarts,Fletcher-Powell,and Polak-Ribiere.Hyperparameter tuning,dropout regularization,and early stopping were employed to enhance generalization.Comparative analysis revealed that FFNN outperformed RF and XGBoost,achieving an R2 of 0.9669.To ensure interpretability,accumulated local effects(ALE)along with partial dependence plots(PDP)were utilized.This revealed trends consistent with the pre-existent domain knowledge.This allows estimation of strength from the properties of the mix without extensive lab testing,permitting designers to track the performance and sustainability trends in concrete mix designs while promoting responsible construction and demolition waste utilization.展开更多
This study aims to improve the unconfined compressive strength of soils using additives as well as by predicting the strength behavior of stabilized soils using two artificial-intelligence-based models.The soils used ...This study aims to improve the unconfined compressive strength of soils using additives as well as by predicting the strength behavior of stabilized soils using two artificial-intelligence-based models.The soils used in this study are stabilized using various combinations of cement,lime,and rice husk ash.To predict the results of unconfined compressive strength tests conducted on soils,a comprehensive laboratory dataset comprising 137 soil specimens treated with different combinations of cement,lime,and rice husk ash is used.Two artificial-intelligence-based models including artificial neural networks and support vector machines are used comparatively to predict the strength characteristics of soils treated with cement,lime,and rice husk ash under different conditions.The suggested models predicted the unconfined compressive strength of soils accurately and can be introduced as reliable predictive models in geotechnical engineering.This study demonstrates the better performance of support vector machines in predicting the strength of the investigated soils compared with artificial neural networks.The type of kernel function used in support vector machine models contributed positively to the performance of the proposed models.Moreover,based on sensitivity analysis results,it is discovered that cement and lime contents impose more prominent effects on the unconfined compressive strength values of the investigated soils compared with the other parameters.展开更多
IR spectra play an important role in determining the structure of compounds qualitatively andquantitatively.In general a great number of data are required to exactly show the features ofthe compounds.Regarding various...IR spectra play an important role in determining the structure of compounds qualitatively andquantitatively.In general a great number of data are required to exactly show the features ofthe compounds.Regarding various compounds,there are massive IR spectra.With the basicfeatures of IR spectra being reserved,it is important to compress IR spectra for improving thestorage,index and process of IR spectra.The wavelet neural network(WNN)is a newneural network model based on wavelet analysis.However,its introduction and applica-tion in chemistry have not been reported.In this note,WNN is applied to the compression ofthe IR spectra of polystyrene.The results show that the original spectra can be展开更多
Plastic concrete is an engineering material,which is commonly used for construction of cut-offwalls to prevent water seepage under the dam.This paper aims to explore two machine learning algorithms including artificia...Plastic concrete is an engineering material,which is commonly used for construction of cut-offwalls to prevent water seepage under the dam.This paper aims to explore two machine learning algorithms including artificial neural network (ANN)and support vector machine (SVM)to predict the compressive strength of bentonite/sepiolite plastic concretes.For this purpose,two unique sets of 72 data for compressive strength of bentonite and sepiolite plastic concrete samples (totally 144 data)were prepared by conducting an experimental study.The results confirm the ability of ANN and SVM models in prediction processes.Also,Sensitivity analysis of the best obtained model indicated that cement and silty clay have the maximum and minimum influences on the compressive strength,respectively.In addition, investigation of the effect of measurement error of input variables showed that change in the sand content (amount)and curing time will have the maximum and minimum effects on the output mean absolute percent error (MAPE)of model, respectively.Finally,the influence of different variables on the plastic concrete compressive strength values was evaluated by conducting parametric studies.展开更多
Deep convolutional neural networks(DCNNs)have shown outstanding performance in the fields of computer vision,natural language processing,and complex system analysis.With the improvement of performance with deeper laye...Deep convolutional neural networks(DCNNs)have shown outstanding performance in the fields of computer vision,natural language processing,and complex system analysis.With the improvement of performance with deeper layers,DCNNs incur higher computational complexity and larger storage requirement,making it extremely difficult to deploy DCNNs on resource-limited embedded systems(such as mobile devices or Internet of Things devices).Network quantization efficiently reduces storage space required by DCNNs.However,the performance of DCNNs often drops rapidly as the quantization bit reduces.In this article,we propose a space efficient quantization scheme which uses eight or less bits to represent the original 32-bit weights.We adopt singular value decomposition(SVD)method to decrease the parameter size of fully-connected layers for further compression.Additionally,we propose a weight clipping method based on dynamic boundary to improve the performance when using lower precision.Experimental results demonstrate that our approach can achieve up to approximately 14x compression while preserving almost the same accuracy compared with the full-precision models.The proposed weight clipping method can also significantly improve the performance of DCNNs when lower precision is required.展开更多
The paper deals with a new VQ+DPCM+DCT algorithm based on Self-Organizing Feature Maps(SOFM) algorithm for image coding. In addition. a Frequency sensitive SOFM (FSOFM) has been also devel-oped. Simulation results sh...The paper deals with a new VQ+DPCM+DCT algorithm based on Self-Organizing Feature Maps(SOFM) algorithm for image coding. In addition. a Frequency sensitive SOFM (FSOFM) has been also devel-oped. Simulation results show that a very good visual quality of the coded image at 0.252 bits/pixel is obtained.展开更多
The method of color quantization and the technique of color spatial quantization based onKohonen neural network are presented in this paper.The later is actually a method of matrixquantization.Using Kohonen NN a palet...The method of color quantization and the technique of color spatial quantization based onKohonen neural network are presented in this paper.The later is actually a method of matrixquantization.Using Kohonen NN a palette and a codebook for color spatial quantization canbe easily obtained.Image compression techniques for digital areonautical maps must be cho-sen to allow rapid decompression and display while maximizing the compression ratio and im-age quality.The palette-based compression technique uses a palette and a codebook based onpalette for color spatial quantization as double look-up -tables,making image decompressionand display just a quick and simple process of looking up the two tables.展开更多
基金Supported by the National Natural Science Foundation of China (60573047), Natural Science Foundation of the Science and Technology Committee of Chongqing (8503) and the Applying Basic Research of the Education Committee of Chongqing (KJ060804)
文摘A new intrusion detection method based on learning vector quantization (LVQ) with low overhead and high efficiency is presented. The computer vision system employs LVQ neural networks as classifier to recognize intrusion. The recognition process includes three stages: (1) feature selection and data normalization processing;(2) learning the training data selected from the feature data set; (3) identifying the intrusion and generating the result report of machine condition classification. Experimental results show that the proposed method is promising in terms of detection accuracy, computational expense and implementation for intrusion detection.
文摘The prediction of solar radiation is important for several applications in renewable energy research. There are a number of geographical variables which affect solar radiation prediction, the identification of these variables for accurate solar radiation prediction is very important. This paper presents a hybrid method for the compression of solar radiation using predictive analysis. The prediction of minute wise solar radiation is performed by using different models of Artificial Neural Networks (ANN), namely Multi-layer perceptron neural network (MLPNN), Cascade feed forward back propagation (CFNN) and Elman back propagation (ELMNN). Root mean square error (RMSE) is used to evaluate the prediction accuracy of the three ANN models used. The information and knowledge gained from the present study could improve the accuracy of analysis concerning climate studies and help in congestion control.
文摘Multistage Vector Quantization(MSVQ) can achieve very low encoding and storage complexity in comparison to unstructured vector quantization. However, the conventional MSVQ is suboptimal with respect to the overall performance measure. This paper proposes a new technology to design the decoder codebook, which is different from the encoder codebook to optimise the overall performance. The performance improvement is achieved with no effect on encoding complexity, both storage and time consuming, but a modest increase in storage complexity of decoder.
文摘Due to the fact that a memristor with memory properties is an ideal electronic component for implementation of the artificial neural synaptic function,a brand-new tristable locally active memristor model is first proposed in this paper.Here,a novel four-dimensional fractional-order memristive cellular neural network(FO-MCNN)model with hidden attractors is constructed to enhance the engineering feasibility of the original CNN model and its performance.Then,its hardware circuit implementation and complicated dynamic properties are investigated on multi-simulation platforms.Subsequently,it is used toward secure communication application scenarios.Taking it as the pseudo-random number generator(PRNG),a new privacy image security scheme is designed based on the adaptive sampling rate compressive sensing(ASR-CS)model.Eventually,the simulation analysis and comparative experiments manifest that the proposed data encryption scheme possesses strong immunity against various security attack models and satisfactory compression performance.
基金This study was supported by the National Natural Science Foundation of China under the project‘Research on the Dynamic Location of Receiver Points and Wave Field Separation Technology Based on Deep Learning in OBN Seismic Exploration’(No.42074140).
文摘At present,the acquisition of seismic data is developing toward high-precision and high-density methods.However,complex natural environments and cultural factors in many exploration areas cause difficulties in achieving uniform and intensive acquisition,which makes complete seismic data collection impossible.Therefore,data reconstruction is required in the processing link to ensure imaging accuracy.Deep learning,as a new field in rapid development,presents clear advantages in feature extraction and modeling.In this study,the convolutional neural network deep learning algorithm is applied to seismic data reconstruction.Based on the convolutional neural network algorithm and combined with the characteristics of seismic data acquisition,two training strategies of supervised and unsupervised learning are designed to reconstruct sparse acquisition seismic records.First,a supervised learning strategy is proposed for labeled data,wherein the complete seismic data are segmented as the input of the training set and are randomly sampled before each training,thereby increasing the number of samples and the richness of features.Second,an unsupervised learning strategy based on large samples is proposed for unlabeled data,and the rolling segmentation method is used to update(pseudo)labels and training parameters in the training process.Through the reconstruction test of simulated and actual data,the deep learning algorithm based on a convolutional neural network shows better reconstruction quality and higher accuracy than compressed sensing based on Curvelet transform.
基金National Natural Science Foundation of China(Nos.11262014,11962021 and 51965051)Inner Mongolia Natural Science Foundation,China(No.2019MS05064)+1 种基金Inner Mongolia Earthquake Administration Director Fund Project,China(No.2019YB06)Inner Mongolia University of Technology Foundation,China(No.2020015)。
文摘Aiming at the reliability analysis of small sample data or implicit structural function,a novel structural reliability analysis model based on support vector machine(SVM)and neural network direct integration method(DNN)is proposed.Firstly,SVM with good small sample learning ability is used to train small sample data,fit structural performance functions and establish regular integration regions.Secondly,DNN is approximated the integral function to achieve multiple integration in the integration region.Finally,structural reliability was obtained by DNN.Numerical examples are investigated to demonstrate the effectiveness of the present method,which provides a feasible way for the structural reliability analysis.
文摘First of all a simple and practical rectangular transform is given,and then thevector quantization technique which is rapidly developing recently is introduced.We combinethe rectangular transform with vector quantization technique for image data compression.Thecombination cuts down the dimensions of vector coding.The size of the codebook can reasonablybe reduced.This method can reduce the computation complexity and pick up the vector codingprocess.Experiments using image processing system show that this method is very effective inthe field of image data compression.
基金This research was supported in part by Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(NRF-2021R1A6A1A03039493)in part by the NRF grant funded by the Korea government(MSIT)(NRF-2022R1A2C1004401)in part by the 2022 Yeungnam University Research Grant.
文摘The exponential growth of data necessitates an effective data storage scheme,which helps to effectively manage the large quantity of data.To accomplish this,Deoxyribonucleic Acid(DNA)digital data storage process can be employed,which encodes and decodes binary data to and from synthesized strands of DNA.Vector quantization(VQ)is a commonly employed scheme for image compression and the optimal codebook generation is an effective process to reach maximum compression efficiency.This article introduces a newDNAComputingwithWater StriderAlgorithm based Vector Quantization(DNAC-WSAVQ)technique for Data Storage Systems.The proposed DNAC-WSAVQ technique enables encoding data using DNA computing and then compresses it for effective data storage.Besides,the DNAC-WSAVQ model initially performsDNA encoding on the input images to generate a binary encoded form.In addition,aWater Strider algorithm with Linde-Buzo-Gray(WSA-LBG)model is applied for the compression process and thereby storage area can be considerably minimized.In order to generate optimal codebook for LBG,the WSA is applied to it.The performance validation of the DNAC-WSAVQ model is carried out and the results are inspected under several measures.The comparative study highlighted the improved outcomes of the DNAC-WSAVQ model over the existing methods.
基金The work described in this paper was fully supported by a grant from Hong Kong Metropolitan University(RIF/2021/05).
文摘Parkinson’s disease(PD)is a debilitating neurological disorder affecting over 10 million people worldwide.PD classification models using voice signals as input are common in the literature.It is believed that using deep learning algorithms further enhances performance;nevertheless,it is challenging due to the nature of small-scale and imbalanced PD datasets.This paper proposed a convolutional neural network-based deep support vector machine(CNN-DSVM)to automate the feature extraction process using CNN and extend the conventional SVM to a DSVM for better classification performance in small-scale PD datasets.A customized kernel function reduces the impact of biased classification towards the majority class(healthy candidates in our consideration).An improved generative adversarial network(IGAN)was designed to generate additional training data to enhance the model’s performance.For performance evaluation,the proposed algorithm achieves a sensitivity of 97.6%and a specificity of 97.3%.The performance comparison is evaluated from five perspectives,including comparisons with different data generation algorithms,feature extraction techniques,kernel functions,and existing works.Results reveal the effectiveness of the IGAN algorithm,which improves the sensitivity and specificity by 4.05%–4.72%and 4.96%–5.86%,respectively;and the effectiveness of the CNN-DSVM algorithm,which improves the sensitivity by 1.24%–57.4%and specificity by 1.04%–163%and reduces biased detection towards the majority class.The ablation experiments confirm the effectiveness of individual components.Two future research directions have also been suggested.
基金support from the National Natural Science Foundation of China(NSFC)(52178324).
文摘A large amount of data can partly assure good fitting quality for the trained neural networks.When the quantity of experimental or on-site monitoring data is commonly insufficient and the quality is difficult to control in engineering practice,numerical simulations can provide a large amount of controlled high quality data.Once the neural networks are trained by such data,they can be used for predicting the properties/responses of the engineering objects instantly,saving the further computing efforts of simulation tools.Correspondingly,a strategy for efficiently transferring the input and output data used and obtained in numerical simulations to neural networks is desirable for engineers and programmers.In this work,we proposed a simple image representation strategy of numerical simulations,where the input and output data are all represented by images.The temporal and spatial information is kept and the data are greatly compressed.In addition,the results are readable for not only computers but also human resources.Some examples are given,indicating the effectiveness of the proposed strategy.
基金Taif University Researchers Supporting Project Number(TURSP-2020/73)Taif University,Taif,Saudi Arabia.
文摘Heart failure is now widely spread throughout the world.Heart disease affects approximately 48%of the population.It is too expensive and also difficult to cure the disease.This research paper represents machine learning models to predict heart failure.The fundamental concept is to compare the correctness of various Machine Learning(ML)algorithms and boost algorithms to improve models’accuracy for prediction.Some supervised algorithms like K-Nearest Neighbor(KNN),Support Vector Machine(SVM),Decision Trees(DT),Random Forest(RF),Logistic Regression(LR)are considered to achieve the best results.Some boosting algorithms like Extreme Gradient Boosting(XGBoost)and Cat-Boost are also used to improve the prediction using Artificial Neural Networks(ANN).This research also focuses on data visualization to identify patterns,trends,and outliers in a massive data set.Python and Scikit-learns are used for ML.Tensor Flow and Keras,along with Python,are used for ANN model train-ing.The DT and RF algorithms achieved the highest accuracy of 95%among the classifiers.Meanwhile,KNN obtained a second height accuracy of 93.33%.XGBoost had a gratified accuracy of 91.67%,SVM,CATBoost,and ANN had an accuracy of 90%,and LR had 88.33%accuracy.
文摘Protein Secondary Structure Prediction (PSSP) is considered as one of the major challenging tasks in bioinformatics, so many solutions have been proposed to solve that problem via trying to achieve more accurate prediction results. The goal of this paper is to develop and implement an intelligent based system to predict secondary structure of a protein from its primary amino acid sequence by using five models of Neural Network (NN). These models are Feed Forward Neural Network (FNN), Learning Vector Quantization (LVQ), Probabilistic Neural Network (PNN), Convolutional Neural Network (CNN), and CNN Fine Tuning for PSSP. To evaluate our approaches two datasets have been used. The first one contains 114 protein samples, and the second one contains 1845 protein samples.
基金supported and funded by the Deanship of Scientific Research at Imam Mohammad Ibn Saud Islamic University(IMSIU)(grant number IMSIU-DDRSP2503)。
文摘The increasing demand for sustainable construction practices has led to growing interest in recycled aggregate concrete(RAC)as an eco-friendly alternative to conventional concrete.However,predicting its compressive strength remains a challenge due to the variability in recycled materials and mix design parameters.This study presents a robust machine learning framework for predicting the compressive strength of recycled aggregate concrete using feedforward neural networks(FFNN),Random Forest(RF),and XGBoost.A literature-derived dataset of 502 samples was enriched via interpolation-based data augmentation and modeled using five distinct optimization techniques within MATLAB’s Neural Net Fitting module:Bayesian Regularization,Levenberg-Marquardt,and three conjugate gradient variants—Powell/Beale Restarts,Fletcher-Powell,and Polak-Ribiere.Hyperparameter tuning,dropout regularization,and early stopping were employed to enhance generalization.Comparative analysis revealed that FFNN outperformed RF and XGBoost,achieving an R2 of 0.9669.To ensure interpretability,accumulated local effects(ALE)along with partial dependence plots(PDP)were utilized.This revealed trends consistent with the pre-existent domain knowledge.This allows estimation of strength from the properties of the mix without extensive lab testing,permitting designers to track the performance and sustainability trends in concrete mix designs while promoting responsible construction and demolition waste utilization.
基金The authors of this paper would like to acknowledge the support provided(No.981861)by Golestan University.
文摘This study aims to improve the unconfined compressive strength of soils using additives as well as by predicting the strength behavior of stabilized soils using two artificial-intelligence-based models.The soils used in this study are stabilized using various combinations of cement,lime,and rice husk ash.To predict the results of unconfined compressive strength tests conducted on soils,a comprehensive laboratory dataset comprising 137 soil specimens treated with different combinations of cement,lime,and rice husk ash is used.Two artificial-intelligence-based models including artificial neural networks and support vector machines are used comparatively to predict the strength characteristics of soils treated with cement,lime,and rice husk ash under different conditions.The suggested models predicted the unconfined compressive strength of soils accurately and can be introduced as reliable predictive models in geotechnical engineering.This study demonstrates the better performance of support vector machines in predicting the strength of the investigated soils compared with artificial neural networks.The type of kernel function used in support vector machine models contributed positively to the performance of the proposed models.Moreover,based on sensitivity analysis results,it is discovered that cement and lime contents impose more prominent effects on the unconfined compressive strength values of the investigated soils compared with the other parameters.
文摘IR spectra play an important role in determining the structure of compounds qualitatively andquantitatively.In general a great number of data are required to exactly show the features ofthe compounds.Regarding various compounds,there are massive IR spectra.With the basicfeatures of IR spectra being reserved,it is important to compress IR spectra for improving thestorage,index and process of IR spectra.The wavelet neural network(WNN)is a newneural network model based on wavelet analysis.However,its introduction and applica-tion in chemistry have not been reported.In this note,WNN is applied to the compression ofthe IR spectra of polystyrene.The results show that the original spectra can be
文摘Plastic concrete is an engineering material,which is commonly used for construction of cut-offwalls to prevent water seepage under the dam.This paper aims to explore two machine learning algorithms including artificial neural network (ANN)and support vector machine (SVM)to predict the compressive strength of bentonite/sepiolite plastic concretes.For this purpose,two unique sets of 72 data for compressive strength of bentonite and sepiolite plastic concrete samples (totally 144 data)were prepared by conducting an experimental study.The results confirm the ability of ANN and SVM models in prediction processes.Also,Sensitivity analysis of the best obtained model indicated that cement and silty clay have the maximum and minimum influences on the compressive strength,respectively.In addition, investigation of the effect of measurement error of input variables showed that change in the sand content (amount)and curing time will have the maximum and minimum effects on the output mean absolute percent error (MAPE)of model, respectively.Finally,the influence of different variables on the plastic concrete compressive strength values was evaluated by conducting parametric studies.
基金the National Natural Science Foundation of China(NSFC)under Grant Nos.61772077 and 61370192Beijing Natural Science Foundation of China under Grant No.4192051NSFC under Grant Nos.61428203 and 61572347.
文摘Deep convolutional neural networks(DCNNs)have shown outstanding performance in the fields of computer vision,natural language processing,and complex system analysis.With the improvement of performance with deeper layers,DCNNs incur higher computational complexity and larger storage requirement,making it extremely difficult to deploy DCNNs on resource-limited embedded systems(such as mobile devices or Internet of Things devices).Network quantization efficiently reduces storage space required by DCNNs.However,the performance of DCNNs often drops rapidly as the quantization bit reduces.In this article,we propose a space efficient quantization scheme which uses eight or less bits to represent the original 32-bit weights.We adopt singular value decomposition(SVD)method to decrease the parameter size of fully-connected layers for further compression.Additionally,we propose a weight clipping method based on dynamic boundary to improve the performance when using lower precision.Experimental results demonstrate that our approach can achieve up to approximately 14x compression while preserving almost the same accuracy compared with the full-precision models.The proposed weight clipping method can also significantly improve the performance of DCNNs when lower precision is required.
文摘The paper deals with a new VQ+DPCM+DCT algorithm based on Self-Organizing Feature Maps(SOFM) algorithm for image coding. In addition. a Frequency sensitive SOFM (FSOFM) has been also devel-oped. Simulation results show that a very good visual quality of the coded image at 0.252 bits/pixel is obtained.
文摘The method of color quantization and the technique of color spatial quantization based onKohonen neural network are presented in this paper.The later is actually a method of matrixquantization.Using Kohonen NN a palette and a codebook for color spatial quantization canbe easily obtained.Image compression techniques for digital areonautical maps must be cho-sen to allow rapid decompression and display while maximizing the compression ratio and im-age quality.The palette-based compression technique uses a palette and a codebook based onpalette for color spatial quantization as double look-up -tables,making image decompressionand display just a quick and simple process of looking up the two tables.