This paper presents a two-level learning method for designing an optimal Radial Basis Function Network (RBFN) using Adaptive Velocity Update Relaxation Particle Swarm Optimization algorithm (AVURPSO) and Orthogonal Le...This paper presents a two-level learning method for designing an optimal Radial Basis Function Network (RBFN) using Adaptive Velocity Update Relaxation Particle Swarm Optimization algorithm (AVURPSO) and Orthogonal Least Squares algorithm (OLS) called as OLS-AVURPSO method. The novelty is to develop an AVURPSO algorithm to form the hybrid OLS-AVURPSO method for designing an optimal RBFN. The proposed method at the upper level finds the global optimum of the spread factor parameter using AVURPSO while at the lower level automatically constructs the RBFN using OLS algorithm. Simulation results confirm that the RBFN is superior to Multilayered Perceptron Network (MLPN) in terms of network size and computing time. To demonstrate the effectiveness of proposed OLS-AVURPSO in the design of RBFN, the Mackey-Glass Chaotic Time-Series as an example is modeled by both MLPN and RBFN.展开更多
Regional logistics demand forecast is the basis for government departments to make logistics planning and logistics related policies.It has the characteristics of a small amount of data and being nonlinear,so the trad...Regional logistics demand forecast is the basis for government departments to make logistics planning and logistics related policies.It has the characteristics of a small amount of data and being nonlinear,so the traditional prediction method can not guarantee the accuracy of prediction.Taking Xiamen City as an example,this paper selects the primary industry,the secondary industry,the tertiary industry,the total amount of investment in fixed assets,total import and export volume,per capita consumption expenditure,and the total retail sales of social consumer goods as the influencing factors,and uses a combining model least square and radial basis function(LS-RBF)neural network to analyze the related data from years 2000 to 2019,so as to predict the logistics demand from years 2020 to 2024.The model can well fit the training data,and the experimental results obtained from the comparison between the predicted value and the actual value in 2019 show that the error rate is very small.Therefore,the prediction results are reasonable and reliable.This method has high prediction accuracy,and it is suitable for irregular regional logistics demand forecast.展开更多
Partial least squares（PLS）,back-propagation neural network（BPNN）and radial basis function neural network（RBFNN）were respectively used for estalishing quantative analysis models with near infrared（NIR）diffuse r...Partial least squares（PLS）,back-propagation neural network（BPNN）and radial basis function neural network（RBFNN）were respectively used for estalishing quantative analysis models with near infrared（NIR）diffuse reflectance spectra for determining the contents of rifampincin（RMP）,isoniazid（INH）and pyrazinamide（PZA）in rifampicin isoniazid and pyrazinamide tablets.Savitzky-Golay smoothing,first derivative,second derivative,fast Fourier transform（FFT）and standard normal variate（SNV）transformation methods were applied to pretreating raw NIR diffuse reflectance spectra.The raw and pretreated spectra were divided into several regions,depending on the average spectrum and RSD spectrum.Principal component analysis（PCA）method was used for analyzing the raw and pretreated spectra in different regions in order to reduce the dimensions of input data.The optimum spectral regions and the models＇ parameters were chosen by comparing the root mean square error of cross-validation（RMSECV）values which were obtained by leave-one-out cross-validation method.The RMSECV values of the RBFNN models for determining the contents of RMP,INH and PZA were 0.00288,0.00226 and 0.00341,respectively.Using these models for predicting the contents of INH,RMP and PZA in prediction set,the RMSEP values were 0.00266,0.00227 and 0.00411,respectively.These results are better than those obtained from PLS models and BPNN models.With additional advantages of fast calculation speed and less dependence on the initial conditions,RBFNN is a suitable tool to model complex systems.展开更多
In this paper, adaptive identification and control of nonlinear dynamical systems are investigated using radial basis function networks (RBF). Firstly, a novel approach to train the RBF is introduced, which employs an...In this paper, adaptive identification and control of nonlinear dynamical systems are investigated using radial basis function networks (RBF). Firstly, a novel approach to train the RBF is introduced, which employs an adaptive fuzzy generalized learning vector quantization (AFGLVQ) technique and recursive least squares algorithm with variable forgetting factor (VRLS). The AFGLVQ adjusts the centers of the RBF while the VRLS updates the connection weights of the network. The identification algorithm has the properties of rapid convergence and persistent adaptability that make it suitable for real-time control. Secondly, on the basis of the one-step ahead RBF predictor, the control law is optimized iteratively through a numerical stable Davidon's least squares-based (SDLS) minimization approach. Four nonlinear examples are simulated to demonstrate the effectiveness of the identification and control algorithms.展开更多
This paper studies the problem applying Radial Basis Function Network(RBFN) which is trained by the Recursive Least Square Algorithm(RLSA) to the recognition of one dimensional images of radar targets. The equivalence...This paper studies the problem applying Radial Basis Function Network(RBFN) which is trained by the Recursive Least Square Algorithm(RLSA) to the recognition of one dimensional images of radar targets. The equivalence between the RBFN and the estimate of Parzen window probabilistic density is proved. It is pointed out that the I/O functions in RBFN hidden units can be generalized to general Parzen window probabilistic kernel function or potential function, too. This paper discusses the effects of the shape parameter a in the RBFN and the forgotten factor A in RLSA on the results of the recognition of three kinds of kernel function such as Gaussian, triangle, double-exponential, at the same time, also discusses the relationship between A and the training time in the RBFN.展开更多
Solving large radial basis function （RBF） interpolation problem with non-customized methods is computationally expensive and the matrices that occur are typically badly conditioned. In order to avoid these difficult...Solving large radial basis function （RBF） interpolation problem with non-customized methods is computationally expensive and the matrices that occur are typically badly conditioned. In order to avoid these difficulties, we present a fitting based on radial basis functions satisfying side conditions by least squares, although compared with interpolation the method loses some accuracy, it reduces the computational cost largely. Since the fitting accuracy and the non-singularity of coefficient matrix in normal equation are relevant to the uniformity of chosen centers of the fitted RBE we present a choice method of uniform centers. Numerical results confirm the fitting efficiency.展开更多
Accurately approximating higher order derivatives is an inherently difficult problem. It is shown that a random variable shape parameter strategy can improve the accuracy of approximating higher order derivatives with...Accurately approximating higher order derivatives is an inherently difficult problem. It is shown that a random variable shape parameter strategy can improve the accuracy of approximating higher order derivatives with Radial Basis Function methods. The method is used to solve fourth order boundary value problems. The use and location of ghost points are examined in order to enforce the extra boundary conditions that are necessary to make a fourth-order problem well posed. The use of ghost points versus solving an overdetermined linear system via least squares is studied. For a general fourth-order boundary value problem, the recommended approach is to either use one of two novel sets of ghost centers introduced here or else to use a least squares approach. When using either ghost centers or least squares, the random variable shape parameter strategy results in significantly better accuracy than when a constant shape parameter is used.展开更多
Least squares support vector machines (LS-SVMs), a nonlinear kemel based machine was introduced to investigate the prospects of application of this approach in modelling water vapor and carbon dioxide fluxes above a s...Least squares support vector machines (LS-SVMs), a nonlinear kemel based machine was introduced to investigate the prospects of application of this approach in modelling water vapor and carbon dioxide fluxes above a summer maize field using the dataset obtained in the North China Plain with eddy covariance technique. The performances of the LS-SVMs were compared to the corresponding models obtained with radial basis function (RBF) neural networks. The results indicated the trained LS-SVMs with a radial basis function kernel had satisfactory performance in modelling surface fluxes; its excellent approximation and generalization property shed new light on the study on complex processes in ecosystem.展开更多
In this paper, we propose a simple learning algorithm for non\|linear function approximation and system modeling using minimal radial basis function neural network with high generalization performance. A hybrid algori...In this paper, we propose a simple learning algorithm for non\|linear function approximation and system modeling using minimal radial basis function neural network with high generalization performance. A hybrid algorithm is constructed, which combines recursive n \|means clustering algorithm with a simple recursive regularized least squares algorithm (SRRLS). The n \|means clustering algorithm adjusts the centers of the network, while the SRRLS constructs a parsimonious network which makes the generalization performance of the network well. The SRRLS algorithm needs no matrix computing, so it has a lower computational cost and no ill\|conditional problem. Because of the recursive manner, this algorithm is suitable for on\|line applications. The effectiveness of this algorithm is demonstrated by two benchmark examples.展开更多
Purpose–The purpose of this paper is to consider the concept of Fuzzy Radial Basis Function Neural Networks with Information Granulation(IG-FRBFNN)and their optimization realized by means of the Multiobjective Partic...Purpose–The purpose of this paper is to consider the concept of Fuzzy Radial Basis Function Neural Networks with Information Granulation(IG-FRBFNN)and their optimization realized by means of the Multiobjective Particle Swarm Optimization(MOPSO).Design/methodology/approach–In fuzzy modeling,complexity,interpretability(or simplicity)as well as accuracy of the obtained model are essential design criteria.Since the performance of the IG-RBFNN model is directly affected by some parameters,such as the fuzzification coefficient used in the FCM,the number of rules and the orders of the polynomials in the consequent parts of the rules,the authors carry out both structural as well as parametric optimization of the network.A multi-objective Particle Swarm Optimization using Crowding Distance(MOPSO-CD)as well as O/WLS learning-based optimization are exploited to carry out the structural and parametric optimization of the model,respectively,while the optimization is of multiobjective character as it is aimed at the simultaneous minimization of complexity and maximization of accuracy.Findings–The performance of the proposed model is illustrated with the aid of three examples.The proposed optimization method leads to an accurate and highly interpretable fuzzy model.Originality/value–A MOPSO-CD as well as O/WLS learning-based optimization are exploited,respectively,to carry out the structural and parametric optimization of the model.As a result,the proposed methodology is interesting for designing an accurate and highly interpretable fuzzy model.展开更多
为提升chirplet变换(chirplet transform,CT)估算瞬时频率的精度,在CT基础上结合花斑翠鸟优化(pied kingfisher optimizer,PKO)和径向基移动最小二乘(radial basis function moving least squares,RBFMLS)算法提出了一种识别结构瞬时频...为提升chirplet变换(chirplet transform,CT)估算瞬时频率的精度,在CT基础上结合花斑翠鸟优化(pied kingfisher optimizer,PKO)和径向基移动最小二乘(radial basis function moving least squares,RBFMLS)算法提出了一种识别结构瞬时频率的新方法。该方法采用正定紧支径向基函数作为移动最小二乘近似的权函数,对CT的能量脊线进行估算,同时应用PKO对RBFMLS节点支撑半径和CT窗函数宽度进行优化。通过一组解析信号数值算例和一个时变拉索试验验证了所提方法的有效性。研究结果表明,该方法能有效改善信号分析的能量聚集性,提高瞬时频率的识别精度。展开更多
文摘This paper presents a two-level learning method for designing an optimal Radial Basis Function Network (RBFN) using Adaptive Velocity Update Relaxation Particle Swarm Optimization algorithm (AVURPSO) and Orthogonal Least Squares algorithm (OLS) called as OLS-AVURPSO method. The novelty is to develop an AVURPSO algorithm to form the hybrid OLS-AVURPSO method for designing an optimal RBFN. The proposed method at the upper level finds the global optimum of the spread factor parameter using AVURPSO while at the lower level automatically constructs the RBFN using OLS algorithm. Simulation results confirm that the RBFN is superior to Multilayered Perceptron Network (MLPN) in terms of network size and computing time. To demonstrate the effectiveness of proposed OLS-AVURPSO in the design of RBFN, the Mackey-Glass Chaotic Time-Series as an example is modeled by both MLPN and RBFN.
基金Social Science Research Project of Education Department of Fujian Province,China(No.JAS160571)Key Project of Education and Teaching Reform of Undergraduate Universities in Fujian Province,China(No.FBJG20190130)Educational Research Project of Social Science for Young and Middle Aged Teachers in Fujian Province,China(No.JAS19371)。
文摘Regional logistics demand forecast is the basis for government departments to make logistics planning and logistics related policies.It has the characteristics of a small amount of data and being nonlinear,so the traditional prediction method can not guarantee the accuracy of prediction.Taking Xiamen City as an example,this paper selects the primary industry,the secondary industry,the tertiary industry,the total amount of investment in fixed assets,total import and export volume,per capita consumption expenditure,and the total retail sales of social consumer goods as the influencing factors,and uses a combining model least square and radial basis function(LS-RBF)neural network to analyze the related data from years 2000 to 2019,so as to predict the logistics demand from years 2020 to 2024.The model can well fit the training data,and the experimental results obtained from the comparison between the predicted value and the actual value in 2019 show that the error rate is very small.Therefore,the prediction results are reasonable and reliable.This method has high prediction accuracy,and it is suitable for irregular regional logistics demand forecast.
基金Supported by the Science Technology Development Project of Jilin Province,China(No.20020503-2).
文摘Partial least squares（PLS）,back-propagation neural network（BPNN）and radial basis function neural network（RBFNN）were respectively used for estalishing quantative analysis models with near infrared（NIR）diffuse reflectance spectra for determining the contents of rifampincin（RMP）,isoniazid（INH）and pyrazinamide（PZA）in rifampicin isoniazid and pyrazinamide tablets.Savitzky-Golay smoothing,first derivative,second derivative,fast Fourier transform（FFT）and standard normal variate（SNV）transformation methods were applied to pretreating raw NIR diffuse reflectance spectra.The raw and pretreated spectra were divided into several regions,depending on the average spectrum and RSD spectrum.Principal component analysis（PCA）method was used for analyzing the raw and pretreated spectra in different regions in order to reduce the dimensions of input data.The optimum spectral regions and the models＇ parameters were chosen by comparing the root mean square error of cross-validation（RMSECV）values which were obtained by leave-one-out cross-validation method.The RMSECV values of the RBFNN models for determining the contents of RMP,INH and PZA were 0.00288,0.00226 and 0.00341,respectively.Using these models for predicting the contents of INH,RMP and PZA in prediction set,the RMSEP values were 0.00266,0.00227 and 0.00411,respectively.These results are better than those obtained from PLS models and BPNN models.With additional advantages of fast calculation speed and less dependence on the initial conditions,RBFNN is a suitable tool to model complex systems.
文摘In this paper, adaptive identification and control of nonlinear dynamical systems are investigated using radial basis function networks (RBF). Firstly, a novel approach to train the RBF is introduced, which employs an adaptive fuzzy generalized learning vector quantization (AFGLVQ) technique and recursive least squares algorithm with variable forgetting factor (VRLS). The AFGLVQ adjusts the centers of the RBF while the VRLS updates the connection weights of the network. The identification algorithm has the properties of rapid convergence and persistent adaptability that make it suitable for real-time control. Secondly, on the basis of the one-step ahead RBF predictor, the control law is optimized iteratively through a numerical stable Davidon's least squares-based (SDLS) minimization approach. Four nonlinear examples are simulated to demonstrate the effectiveness of the identification and control algorithms.
基金Supported by the National Natural Science Foundationthe Doctoral Foundation of the State Education Commission of China
文摘This paper studies the problem applying Radial Basis Function Network(RBFN) which is trained by the Recursive Least Square Algorithm(RLSA) to the recognition of one dimensional images of radar targets. The equivalence between the RBFN and the estimate of Parzen window probabilistic density is proved. It is pointed out that the I/O functions in RBFN hidden units can be generalized to general Parzen window probabilistic kernel function or potential function, too. This paper discusses the effects of the shape parameter a in the RBFN and the forgotten factor A in RLSA on the results of the recognition of three kinds of kernel function such as Gaussian, triangle, double-exponential, at the same time, also discusses the relationship between A and the training time in the RBFN.
基金Supported by National Natural Science Youth Foundation (10401021).
文摘Solving large radial basis function （RBF） interpolation problem with non-customized methods is computationally expensive and the matrices that occur are typically badly conditioned. In order to avoid these difficulties, we present a fitting based on radial basis functions satisfying side conditions by least squares, although compared with interpolation the method loses some accuracy, it reduces the computational cost largely. Since the fitting accuracy and the non-singularity of coefficient matrix in normal equation are relevant to the uniformity of chosen centers of the fitted RBE we present a choice method of uniform centers. Numerical results confirm the fitting efficiency.
文摘Accurately approximating higher order derivatives is an inherently difficult problem. It is shown that a random variable shape parameter strategy can improve the accuracy of approximating higher order derivatives with Radial Basis Function methods. The method is used to solve fourth order boundary value problems. The use and location of ghost points are examined in order to enforce the extra boundary conditions that are necessary to make a fourth-order problem well posed. The use of ghost points versus solving an overdetermined linear system via least squares is studied. For a general fourth-order boundary value problem, the recommended approach is to either use one of two novel sets of ghost centers introduced here or else to use a least squares approach. When using either ghost centers or least squares, the random variable shape parameter strategy results in significantly better accuracy than when a constant shape parameter is used.
基金Project supported by the National Science Fund for OutstandingYouth Overseas (No. 40328001) and the Key Research Plan of theKnowledge Innovation Project of the Institute of Geographic Sciencesand Natural Resources, Chinese Academy of Sciences (No.KZCXI-SW-01)
文摘Least squares support vector machines (LS-SVMs), a nonlinear kemel based machine was introduced to investigate the prospects of application of this approach in modelling water vapor and carbon dioxide fluxes above a summer maize field using the dataset obtained in the North China Plain with eddy covariance technique. The performances of the LS-SVMs were compared to the corresponding models obtained with radial basis function (RBF) neural networks. The results indicated the trained LS-SVMs with a radial basis function kernel had satisfactory performance in modelling surface fluxes; its excellent approximation and generalization property shed new light on the study on complex processes in ecosystem.
基金This work is supported by the International Pioneering Center of TEDATianjinP.R China
文摘In this paper, we propose a simple learning algorithm for non\|linear function approximation and system modeling using minimal radial basis function neural network with high generalization performance. A hybrid algorithm is constructed, which combines recursive n \|means clustering algorithm with a simple recursive regularized least squares algorithm (SRRLS). The n \|means clustering algorithm adjusts the centers of the network, while the SRRLS constructs a parsimonious network which makes the generalization performance of the network well. The SRRLS algorithm needs no matrix computing, so it has a lower computational cost and no ill\|conditional problem. Because of the recursive manner, this algorithm is suitable for on\|line applications. The effectiveness of this algorithm is demonstrated by two benchmark examples.
基金This work was supported by National Research Foundation of Korea Grant funded by the Korean Government(NRF-2010-D00065)the Grant of the Korean Ministry of Education,Science and Technology(The Regional Core Research Program/Center of Healthcare Technology Development)the GRRC program of Gyeonggi province[GRRC SUWON 2011-B2,Center for U-city Security&Surveillance Technology].
文摘Purpose–The purpose of this paper is to consider the concept of Fuzzy Radial Basis Function Neural Networks with Information Granulation(IG-FRBFNN)and their optimization realized by means of the Multiobjective Particle Swarm Optimization(MOPSO).Design/methodology/approach–In fuzzy modeling,complexity,interpretability(or simplicity)as well as accuracy of the obtained model are essential design criteria.Since the performance of the IG-RBFNN model is directly affected by some parameters,such as the fuzzification coefficient used in the FCM,the number of rules and the orders of the polynomials in the consequent parts of the rules,the authors carry out both structural as well as parametric optimization of the network.A multi-objective Particle Swarm Optimization using Crowding Distance(MOPSO-CD)as well as O/WLS learning-based optimization are exploited to carry out the structural and parametric optimization of the model,respectively,while the optimization is of multiobjective character as it is aimed at the simultaneous minimization of complexity and maximization of accuracy.Findings–The performance of the proposed model is illustrated with the aid of three examples.The proposed optimization method leads to an accurate and highly interpretable fuzzy model.Originality/value–A MOPSO-CD as well as O/WLS learning-based optimization are exploited,respectively,to carry out the structural and parametric optimization of the model.As a result,the proposed methodology is interesting for designing an accurate and highly interpretable fuzzy model.
文摘为提升chirplet变换(chirplet transform,CT)估算瞬时频率的精度,在CT基础上结合花斑翠鸟优化(pied kingfisher optimizer,PKO)和径向基移动最小二乘(radial basis function moving least squares,RBFMLS)算法提出了一种识别结构瞬时频率的新方法。该方法采用正定紧支径向基函数作为移动最小二乘近似的权函数,对CT的能量脊线进行估算,同时应用PKO对RBFMLS节点支撑半径和CT窗函数宽度进行优化。通过一组解析信号数值算例和一个时变拉索试验验证了所提方法的有效性。研究结果表明,该方法能有效改善信号分析的能量聚集性,提高瞬时频率的识别精度。
