A novel model named Multi-scale Gaussian Processes (MGP) is proposed. Motivated by the ideas of multi-scale representations in the wavelet theory, in the new model, a Gaussian process is represented at a scale by a li...A novel model named Multi-scale Gaussian Processes (MGP) is proposed. Motivated by the ideas of multi-scale representations in the wavelet theory, in the new model, a Gaussian process is represented at a scale by a linear basis that is composed of a scale function and its different translations. Finally the distribution of the targets of the given samples can be obtained at different scales. Compared with the standard Gaussian Processes (GP) model, the MGP model can control its complexity conveniently just by adjusting the scale pa-rameter. So it can trade-off the generalization ability and the empirical risk rapidly. Experiments verify the fea-sibility of the MGP model, and exhibit that its performance is superior to the GP model if appropriate scales are chosen.展开更多
The numerical simulation of the fluid flow and the flexible rod(s)interaction is more complicated and has lower efficiency due to the high computational cost.In this paper,a semi-resolved model coupling the computatio...The numerical simulation of the fluid flow and the flexible rod(s)interaction is more complicated and has lower efficiency due to the high computational cost.In this paper,a semi-resolved model coupling the computational fluid dynamics and the flexible rod dynamics is proposed using a two-way domain expansion method.The gov-erning equations of the flexible rod dynamics are discretized and solved by the finite element method,and the fluid flow is simulated by the finite volume method.The interaction between fluids and solid rods is modeled by introducing body force terms into the momentum equations.Referred to the traditional semi-resolved numerical model,an anisotropic Gaussian kernel function method is proposed to specify the interactive forces between flu-ids and solid bodies for non-circle rod cross-sections.A benchmark of the flow passing around a single flexible plate with a rectangular cross-section is used to validate the algorithm.Focused on the engineering applications,a test case of a finite patch of cylinders is implemented to validate the accuracy and efficiency of the coupled model.展开更多
Aiming at the difficulty of fault identification caused by manual extraction of fault features of rotating machinery,a one-dimensional multi-scale convolutional auto-encoder fault diagnosis model is proposed,based on ...Aiming at the difficulty of fault identification caused by manual extraction of fault features of rotating machinery,a one-dimensional multi-scale convolutional auto-encoder fault diagnosis model is proposed,based on the standard convolutional auto-encoder.In this model,the parallel convolutional and deconvolutional kernels of different scales are used to extract the features from the input signal and reconstruct the input signal;then the feature map extracted by multi-scale convolutional kernels is used as the input of the classifier;and finally the parameters of the whole model are fine-tuned using labeled data.Experiments on one set of simulation fault data and two sets of rolling bearing fault data are conducted to validate the proposed method.The results show that the model can achieve 99.75%,99.3%and 100%diagnostic accuracy,respectively.In addition,the diagnostic accuracy and reconstruction error of the one-dimensional multi-scale convolutional auto-encoder are compared with traditional machine learning,convolutional neural networks and a traditional convolutional auto-encoder.The final results show that the proposed model has a better recognition effect for rolling bearing fault data.展开更多
This article addresses the nonlinear state estimation problem where the conventional Gaussian assumption is completely relaxed.Here,the uncertainties in process and measurements are assumed non-Gaussian,such that the ...This article addresses the nonlinear state estimation problem where the conventional Gaussian assumption is completely relaxed.Here,the uncertainties in process and measurements are assumed non-Gaussian,such that the maximum correntropy criterion(MCC)is chosen to replace the conventional minimum mean square error criterion.Furthermore,the MCC is realized using Gaussian as well as Cauchy kernels by defining an appropriate cost function.Simulation results demonstrate the superior estimation accuracy of the developed estimators for two nonlinear estimation problems.展开更多
With the vigorous expansion of nonlinear adaptive filtering with real-valued kernel functions,its counterpart complex kernel adaptive filtering algorithms were also sequentially proposed to solve the complex-valued no...With the vigorous expansion of nonlinear adaptive filtering with real-valued kernel functions,its counterpart complex kernel adaptive filtering algorithms were also sequentially proposed to solve the complex-valued nonlinear problems arising in almost all real-world applications.This paper firstly presents two schemes of the complex Gaussian kernel-based adaptive filtering algorithms to illustrate their respective characteristics.Then the theoretical convergence behavior of the complex Gaussian kernel least mean square(LMS)algorithm is studied by using the fixed dictionary strategy.The simulation results demonstrate that the theoretical curves predicted by the derived analytical models consistently coincide with the Monte Carlo simulation results in both transient and steady-state stages for two introduced complex Gaussian kernel LMS algonthms using non-circular complex data.The analytical models are able to be regard as a theoretical tool evaluating ability and allow to compare with mean square error(MSE)performance among of complex kernel LMS(KLMS)methods according to the specified kernel bandwidth and the length of dictionary.展开更多
Panel data combine cross-section data and time series data. If the cross-section is locations, there is a need to check the correlation among locations. ρ and λ are parameters in generalized spatial model to cover e...Panel data combine cross-section data and time series data. If the cross-section is locations, there is a need to check the correlation among locations. ρ and λ are parameters in generalized spatial model to cover effect of correlation between locations. Value of ρ or λ will influence the goodness of fit model, so it is important to make parameter estimation. The effect of another location is covered by making contiguity matrix until it gets spatial weighted matrix (W). There are some types of W—uniform W, binary W, kernel Gaussian W and some W from real case of economics condition or transportation condition from locations. This study is aimed to compare uniform W and kernel Gaussian W in spatial panel data model using RMSE value. The result of analysis showed that uniform weight had RMSE value less than kernel Gaussian model. Uniform W had stabil value for all the combinations.展开更多
Predicting the power obtained at the output of the photovoltaic(PV)system is fundamental for the optimum use of the PV system.However,it varies at different times of the day depending on intermittent and nonlinear env...Predicting the power obtained at the output of the photovoltaic(PV)system is fundamental for the optimum use of the PV system.However,it varies at different times of the day depending on intermittent and nonlinear environmen-tal conditions including solar irradiation,temperature and the wind speed,Short-term power prediction is vital in PV systems to reconcile generation and demand in terms of the cost and capacity of the reserve.In this study,a Gaussian kernel based Support Vector Regression(SVR)prediction model using multiple input variables is proposed for estimating the maximum power obtained from using per-turb observation method in the different irradiation and the different temperatures for a short-term in the DC-DC boost converter at the PV system.The performance of the kernel-based prediction model depends on the availability of a suitable ker-nel function that matches the learning objective,since an unsuitable kernel func-tion or hyper parameter tuning results in significantly poor performance.In this study for thefirst time in the literature both maximum power is obtained at max-imum power point and short-term maximum power estimation is made.While evaluating the performance of the suggested model,the PV power data simulated at variable irradiations and variable temperatures for one day in the PV system simulated in MATLAB were used.The maximum power obtained from the simu-lated system at maximum irradiance was 852.6 W.The accuracy and the perfor-mance evaluation of suggested forecasting model were identified utilizing the computing error statistics such as root mean square error(RMSE)and mean square error(MSE)values.MSE and RMSE rates which obtained were 4.5566*10-04 and 0.0213 using ANN model.MSE and RMSE rates which obtained were 13.0000*10-04 and 0.0362 using SWD-FFNN model.Using SVR model,1.1548*10-05 MSE and 0.0034 RMSE rates were obtained.In the short-term maximum power prediction,SVR gave higher prediction performance according to ANN and SWD-FFNN.展开更多
In order to extract the richer feature information of ship targets from sea clutter, and address the high dimensional data problem, a method termed as multi-scale fusion kernel sparse preserving projection(MSFKSPP) ba...In order to extract the richer feature information of ship targets from sea clutter, and address the high dimensional data problem, a method termed as multi-scale fusion kernel sparse preserving projection(MSFKSPP) based on the maximum margin criterion(MMC) is proposed for recognizing the class of ship targets utilizing the high-resolution range profile(HRRP). Multi-scale fusion is introduced to capture the local and detailed information in small-scale features, and the global and contour information in large-scale features, offering help to extract the edge information from sea clutter and further improving the target recognition accuracy. The proposed method can maximally preserve the multi-scale fusion sparse of data and maximize the class separability in the reduced dimensionality by reproducing kernel Hilbert space. Experimental results on the measured radar data show that the proposed method can effectively extract the features of ship target from sea clutter, further reduce the feature dimensionality, and improve target recognition performance.展开更多
In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the ...In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the characteristics of strong coupling,nonlinearity and complex mechanism.To solve these problems,we put forward a multi-output Gaussian process regression(MGPR)model based on the combined kernel function for the polyester esterification process.Since the seasonal and trend decomposition using loess(STL)can extract the periodic and trend characteristics of time series,a combined kernel function based on the STL and the kernel function analysis is constructed for the MGPR.The effectiveness of the proposed model is verified by the actual polyester esterification process data collected from fiber production.展开更多
Silicone material extrusion(MEX)is widely used for processing liquids and pastes.Owing to the uneven linewidth and elastic extrusion deformation caused by material accumulation,products may exhibit geometric errors an...Silicone material extrusion(MEX)is widely used for processing liquids and pastes.Owing to the uneven linewidth and elastic extrusion deformation caused by material accumulation,products may exhibit geometric errors and performance defects,leading to a decline in product quality and affecting its service life.This study proposes a process parameter optimization method that considers the mechanical properties of printed specimens and production costs.To improve the quality of silicone printing samples and reduce production costs,three machine learning models,kernel extreme learning machine(KELM),support vector regression(SVR),and random forest(RF),were developed to predict these three factors.Training data were obtained through a complete factorial experiment.A new dataset is obtained using the Euclidean distance method,which assigns the elimination factor.It is trained with Bayesian optimization algorithms for parameter optimization,the new dataset is input into the improved double Gaussian extreme learning machine,and finally obtains the improved KELM model.The results showed improved prediction accuracy over SVR and RF.Furthermore,a multi-objective optimization framework was proposed by combining genetic algorithm technology with the improved KELM model.The effectiveness and reasonableness of the model algorithm were verified by comparing the optimized results with the experimental results.展开更多
Graph convolutional networks(GCNs)have become a dominant approach for skeleton-based action recognition tasks.Although GCNs have made significant progress in modeling skeletons as spatial-temporal graphs,they often re...Graph convolutional networks(GCNs)have become a dominant approach for skeleton-based action recognition tasks.Although GCNs have made significant progress in modeling skeletons as spatial-temporal graphs,they often require stacking multiple graph convolution layers to effectively capture long-distance relationships among nodes.This stacking not only increases computational burdens but also raises the risk of over-smoothing,which can lead to the neglect of crucial local action features.To address this issue,we propose a novel multi-scale adaptive large kernel graph convolutional network(MSLK-GCN)to effectively aggregate local and global spatio-temporal correlations while maintaining the computational efficiency.The core components of the network include two multi-scale large kernel graph convolution(LKGC)modules,a multi-channel adaptive graph convolution(MAGC)module,and a multi-scale temporal self-attention convolution(MSTC)module.The LKGC module adaptively focuses on active motion regions by utilizing a large convolution kernel and a gating mechanism,effectively capturing long-distance dependencies within the skeleton sequence.Meanwhile,the MAGC module dynamically learns relationships between different joints by adjusting connection weights between nodes.To further enhance the ability to capture temporal dynamics,the MSTC module effectively aggregates the temporal information by integrating Efficient Channel Attention(ECA)with multi-scale convolution.In addition,we use a multi-stream fusion strategy to make full use of different modal skeleton data,including bone,joint,joint motion,and bone motion.Exhaustive experiments on three scale-varying datasets,i.e.,NTU-60,NTU-120,and NW-UCLA,demonstrate that our MSLK-GCN can achieve state-of-the-art performance with fewer parameters.展开更多
文摘A novel model named Multi-scale Gaussian Processes (MGP) is proposed. Motivated by the ideas of multi-scale representations in the wavelet theory, in the new model, a Gaussian process is represented at a scale by a linear basis that is composed of a scale function and its different translations. Finally the distribution of the targets of the given samples can be obtained at different scales. Compared with the standard Gaussian Processes (GP) model, the MGP model can control its complexity conveniently just by adjusting the scale pa-rameter. So it can trade-off the generalization ability and the empirical risk rapidly. Experiments verify the fea-sibility of the MGP model, and exhibit that its performance is superior to the GP model if appropriate scales are chosen.
基金supported by Shanghai 2021“Science and Technology Innovation Action Plan”:Social Development Science and Technology Research Project(Grant No.21DZ1202703).
文摘The numerical simulation of the fluid flow and the flexible rod(s)interaction is more complicated and has lower efficiency due to the high computational cost.In this paper,a semi-resolved model coupling the computational fluid dynamics and the flexible rod dynamics is proposed using a two-way domain expansion method.The gov-erning equations of the flexible rod dynamics are discretized and solved by the finite element method,and the fluid flow is simulated by the finite volume method.The interaction between fluids and solid rods is modeled by introducing body force terms into the momentum equations.Referred to the traditional semi-resolved numerical model,an anisotropic Gaussian kernel function method is proposed to specify the interactive forces between flu-ids and solid bodies for non-circle rod cross-sections.A benchmark of the flow passing around a single flexible plate with a rectangular cross-section is used to validate the algorithm.Focused on the engineering applications,a test case of a finite patch of cylinders is implemented to validate the accuracy and efficiency of the coupled model.
基金The National Natural Science Foundation of China(No.51675098)
文摘Aiming at the difficulty of fault identification caused by manual extraction of fault features of rotating machinery,a one-dimensional multi-scale convolutional auto-encoder fault diagnosis model is proposed,based on the standard convolutional auto-encoder.In this model,the parallel convolutional and deconvolutional kernels of different scales are used to extract the features from the input signal and reconstruct the input signal;then the feature map extracted by multi-scale convolutional kernels is used as the input of the classifier;and finally the parameters of the whole model are fine-tuned using labeled data.Experiments on one set of simulation fault data and two sets of rolling bearing fault data are conducted to validate the proposed method.The results show that the model can achieve 99.75%,99.3%and 100%diagnostic accuracy,respectively.In addition,the diagnostic accuracy and reconstruction error of the one-dimensional multi-scale convolutional auto-encoder are compared with traditional machine learning,convolutional neural networks and a traditional convolutional auto-encoder.The final results show that the proposed model has a better recognition effect for rolling bearing fault data.
基金Rahul Radhakrishnan received the B.Tech.degree in Applied Electronics and Instrumentation from the Government Engineering College,Calicut,India,in 2010 and the M.Tech.degreein Control Systems from the Department of Electrical Engineering,National Institute of Technology Kurukshetra,India,in 2013.He received the Ph.D.degree from the Department of Electrical Engineering,Indian Institute of Technology Patna,India,in 2018.Currently,he is workingasan Assistant Professor in the Department of Electrical Engineering,Sardar Vallabhbhai National Institute of Technology,Surat,Gujarat,India.His main research interests include nonlinear filtering,aerospace,and underwater target tracking.
文摘This article addresses the nonlinear state estimation problem where the conventional Gaussian assumption is completely relaxed.Here,the uncertainties in process and measurements are assumed non-Gaussian,such that the maximum correntropy criterion(MCC)is chosen to replace the conventional minimum mean square error criterion.Furthermore,the MCC is realized using Gaussian as well as Cauchy kernels by defining an appropriate cost function.Simulation results demonstrate the superior estimation accuracy of the developed estimators for two nonlinear estimation problems.
基金supported by the National Natural Science Foundation of China(61001153,61271415,61401499,61531015)the Fundamental Research Funds for the Central Universities(3102014JCQ01010,3102014ZD0041)the Opening Research Foundation of State Key Laboratory of Underwater Information Processing and Control(9140C231002130C23085)
文摘With the vigorous expansion of nonlinear adaptive filtering with real-valued kernel functions,its counterpart complex kernel adaptive filtering algorithms were also sequentially proposed to solve the complex-valued nonlinear problems arising in almost all real-world applications.This paper firstly presents two schemes of the complex Gaussian kernel-based adaptive filtering algorithms to illustrate their respective characteristics.Then the theoretical convergence behavior of the complex Gaussian kernel least mean square(LMS)algorithm is studied by using the fixed dictionary strategy.The simulation results demonstrate that the theoretical curves predicted by the derived analytical models consistently coincide with the Monte Carlo simulation results in both transient and steady-state stages for two introduced complex Gaussian kernel LMS algonthms using non-circular complex data.The analytical models are able to be regard as a theoretical tool evaluating ability and allow to compare with mean square error(MSE)performance among of complex kernel LMS(KLMS)methods according to the specified kernel bandwidth and the length of dictionary.
文摘Panel data combine cross-section data and time series data. If the cross-section is locations, there is a need to check the correlation among locations. ρ and λ are parameters in generalized spatial model to cover effect of correlation between locations. Value of ρ or λ will influence the goodness of fit model, so it is important to make parameter estimation. The effect of another location is covered by making contiguity matrix until it gets spatial weighted matrix (W). There are some types of W—uniform W, binary W, kernel Gaussian W and some W from real case of economics condition or transportation condition from locations. This study is aimed to compare uniform W and kernel Gaussian W in spatial panel data model using RMSE value. The result of analysis showed that uniform weight had RMSE value less than kernel Gaussian model. Uniform W had stabil value for all the combinations.
文摘Predicting the power obtained at the output of the photovoltaic(PV)system is fundamental for the optimum use of the PV system.However,it varies at different times of the day depending on intermittent and nonlinear environmen-tal conditions including solar irradiation,temperature and the wind speed,Short-term power prediction is vital in PV systems to reconcile generation and demand in terms of the cost and capacity of the reserve.In this study,a Gaussian kernel based Support Vector Regression(SVR)prediction model using multiple input variables is proposed for estimating the maximum power obtained from using per-turb observation method in the different irradiation and the different temperatures for a short-term in the DC-DC boost converter at the PV system.The performance of the kernel-based prediction model depends on the availability of a suitable ker-nel function that matches the learning objective,since an unsuitable kernel func-tion or hyper parameter tuning results in significantly poor performance.In this study for thefirst time in the literature both maximum power is obtained at max-imum power point and short-term maximum power estimation is made.While evaluating the performance of the suggested model,the PV power data simulated at variable irradiations and variable temperatures for one day in the PV system simulated in MATLAB were used.The maximum power obtained from the simu-lated system at maximum irradiance was 852.6 W.The accuracy and the perfor-mance evaluation of suggested forecasting model were identified utilizing the computing error statistics such as root mean square error(RMSE)and mean square error(MSE)values.MSE and RMSE rates which obtained were 4.5566*10-04 and 0.0213 using ANN model.MSE and RMSE rates which obtained were 13.0000*10-04 and 0.0362 using SWD-FFNN model.Using SVR model,1.1548*10-05 MSE and 0.0034 RMSE rates were obtained.In the short-term maximum power prediction,SVR gave higher prediction performance according to ANN and SWD-FFNN.
基金supported by the National Natural Science Foundation of China (62271255,61871218)the Fundamental Research Funds for the Central University (3082019NC2019002)+1 种基金the Aeronautical Science Foundation (ASFC-201920007002)the Program of Remote Sensing Intelligent Monitoring and Emergency Services for Regional Security Elements。
文摘In order to extract the richer feature information of ship targets from sea clutter, and address the high dimensional data problem, a method termed as multi-scale fusion kernel sparse preserving projection(MSFKSPP) based on the maximum margin criterion(MMC) is proposed for recognizing the class of ship targets utilizing the high-resolution range profile(HRRP). Multi-scale fusion is introduced to capture the local and detailed information in small-scale features, and the global and contour information in large-scale features, offering help to extract the edge information from sea clutter and further improving the target recognition accuracy. The proposed method can maximally preserve the multi-scale fusion sparse of data and maximize the class separability in the reduced dimensionality by reproducing kernel Hilbert space. Experimental results on the measured radar data show that the proposed method can effectively extract the features of ship target from sea clutter, further reduce the feature dimensionality, and improve target recognition performance.
基金Natural Science Foundation of Shanghai,China(No.19ZR1402300)。
文摘In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the characteristics of strong coupling,nonlinearity and complex mechanism.To solve these problems,we put forward a multi-output Gaussian process regression(MGPR)model based on the combined kernel function for the polyester esterification process.Since the seasonal and trend decomposition using loess(STL)can extract the periodic and trend characteristics of time series,a combined kernel function based on the STL and the kernel function analysis is constructed for the MGPR.The effectiveness of the proposed model is verified by the actual polyester esterification process data collected from fiber production.
基金supported by the National Key R&D Program of China(No.2022YFA1005204l)。
文摘Silicone material extrusion(MEX)is widely used for processing liquids and pastes.Owing to the uneven linewidth and elastic extrusion deformation caused by material accumulation,products may exhibit geometric errors and performance defects,leading to a decline in product quality and affecting its service life.This study proposes a process parameter optimization method that considers the mechanical properties of printed specimens and production costs.To improve the quality of silicone printing samples and reduce production costs,three machine learning models,kernel extreme learning machine(KELM),support vector regression(SVR),and random forest(RF),were developed to predict these three factors.Training data were obtained through a complete factorial experiment.A new dataset is obtained using the Euclidean distance method,which assigns the elimination factor.It is trained with Bayesian optimization algorithms for parameter optimization,the new dataset is input into the improved double Gaussian extreme learning machine,and finally obtains the improved KELM model.The results showed improved prediction accuracy over SVR and RF.Furthermore,a multi-objective optimization framework was proposed by combining genetic algorithm technology with the improved KELM model.The effectiveness and reasonableness of the model algorithm were verified by comparing the optimized results with the experimental results.
基金supported in part by the National Natural Science Foundation of China under Grant No.61976127the Shandong Provincial Natural Science Foundation under Grant No.ZR2024MF030+1 种基金the Taishan Scholar Program of Shandong Province of China under Grant No.tsqn202306150the Key Research and Development Program of Shandong Province of China under Grant No.2025CXPT096.
文摘Graph convolutional networks(GCNs)have become a dominant approach for skeleton-based action recognition tasks.Although GCNs have made significant progress in modeling skeletons as spatial-temporal graphs,they often require stacking multiple graph convolution layers to effectively capture long-distance relationships among nodes.This stacking not only increases computational burdens but also raises the risk of over-smoothing,which can lead to the neglect of crucial local action features.To address this issue,we propose a novel multi-scale adaptive large kernel graph convolutional network(MSLK-GCN)to effectively aggregate local and global spatio-temporal correlations while maintaining the computational efficiency.The core components of the network include two multi-scale large kernel graph convolution(LKGC)modules,a multi-channel adaptive graph convolution(MAGC)module,and a multi-scale temporal self-attention convolution(MSTC)module.The LKGC module adaptively focuses on active motion regions by utilizing a large convolution kernel and a gating mechanism,effectively capturing long-distance dependencies within the skeleton sequence.Meanwhile,the MAGC module dynamically learns relationships between different joints by adjusting connection weights between nodes.To further enhance the ability to capture temporal dynamics,the MSTC module effectively aggregates the temporal information by integrating Efficient Channel Attention(ECA)with multi-scale convolution.In addition,we use a multi-stream fusion strategy to make full use of different modal skeleton data,including bone,joint,joint motion,and bone motion.Exhaustive experiments on three scale-varying datasets,i.e.,NTU-60,NTU-120,and NW-UCLA,demonstrate that our MSLK-GCN can achieve state-of-the-art performance with fewer parameters.
