Focused on various BP algorithms with variable learning rate based on network system error gradient, a modified learning strategy for training non-linear network models is developed with both the incremental and the d...Focused on various BP algorithms with variable learning rate based on network system error gradient, a modified learning strategy for training non-linear network models is developed with both the incremental and the decremental factors of network learning rate being adjusted adaptively and dynamically. The golden section law is put forward to build a relationship between the network training parameters, and a series of data from an existing model is used to train and test the network parameters. By means of the evaluation of network performance in respect to convergent speed and predicting precision, the effectiveness of the proposed learning strategy can be illustrated.展开更多
This paper presents an improved BP algorithm. The approach can reduce the amount of computation by using the logarithmic objective function. The learning rate μ(k) per iteration is determined by dynamic o...This paper presents an improved BP algorithm. The approach can reduce the amount of computation by using the logarithmic objective function. The learning rate μ(k) per iteration is determined by dynamic optimization method to accelerate the convergence rate. Since the determination of the learning rate in the proposed BP algorithm only uses the obtained first order derivatives in standard BP algorithm(SBP), the scale of computational and storage burden is like that of SBP algorithm,and the convergence rate is remarkably accelerated. Computer simulations demonstrate the effectiveness of the proposed algorithm展开更多
For accelerating the supervised learning by the SpikeProp algorithm with the temporal coding paradigm in spiking neural networks (SNNs), three learning rate adaptation methods (heuristic rule, delta-delta rule, and de...For accelerating the supervised learning by the SpikeProp algorithm with the temporal coding paradigm in spiking neural networks (SNNs), three learning rate adaptation methods (heuristic rule, delta-delta rule, and delta-bar-delta rule), which are used to speed up training in artificial neural networks, are used to develop the training algorithms for feedforward SNN. The performance of these algorithms is investigated by four experiments: classical XOR (exclusive or) problem, Iris dataset, fault diagnosis in the Tennessee Eastman process, and Poisson trains of discrete spikes. The results demonstrate that all the three learning rate adaptation methods are able to speed up convergence of SNN compared with the original SpikeProp algorithm. Furthermore, if the adaptive learning rate is used in combination with the momentum term, the two modifications will balance each other in a beneficial way to accomplish rapid and steady convergence. In the three learning rate adaptation methods, delta-bar-delta rule performs the best. The delta-bar-delta method with momentum has the fastest convergence rate, the greatest stability of training process, and the maximum accuracy of network learning. The proposed algorithms in this paper are simple and efficient, and consequently valuable for practical applications of SNN.展开更多
A multilayer perceptron neural network system is established to support the diagnosis for five most common heart diseases (coronary heart disease, rheumatic valvular heart disease, hypertension, chronic cor pulmonale ...A multilayer perceptron neural network system is established to support the diagnosis for five most common heart diseases (coronary heart disease, rheumatic valvular heart disease, hypertension, chronic cor pulmonale and congenital heart disease). Momentum term, adaptive learning rate, the forgetting mechanics, and conjugate gradients method are introduced to improve the basic BP algorithm aiming to speed up the convergence of the BP algorithm and enhance the accuracy for diagnosis. A heart disease database consisting of 352 samples is applied to the training and testing courses of the system. The performance of the system is assessed by cross-validation method. It is found that as the basic BP algorithm is improved step by step, the convergence speed and the classification accuracy of the network are enhanced, and the system has great application prospect in supporting heart diseases diagnosis.展开更多
Dear Editor,This letter is concerned with the problem of stable high-quality signal transmission of unmanned aerial vehicle(UAV)-assisted multiple-input multiple-output(MIMO)communication system.The particle swarm opt...Dear Editor,This letter is concerned with the problem of stable high-quality signal transmission of unmanned aerial vehicle(UAV)-assisted multiple-input multiple-output(MIMO)communication system.The particle swarm optimization(PSO)algorithm is used to achieve optimal beamforming and power allocation for this system.Additionally,sensitive particle(SP)and parameter adaptive adjustment are introduced into the traditional PSO algorithm,aiming to improve the performance of the PSO algorithm in dynamic environments with real-time changes in the UAV position.A reinforcement learning(RL)-based approach is proposed to obtain optimal UAV trajectory and adaptive adjustment strategy for PSO parameters,which combine with a specific obstacle avoidance scheme to achieve accurate UAV navigation while satisfying high-quality signal transmission.Simulation experiments show that our scheme provides higher and more stable spectral efficiency as well as more efficient UAV navigation than the currently commonly used scheme with a single RL approach.展开更多
针对捕鱼优化算法(catch fish optimization algorithm,CFOA)容易陷入局部最优、迭代后期种群多样性单一等问题,提出一种多策略融合改进的捕鱼优化算法。首先,通过反向学习策略进行种群初始化,以提高初始种群的质量;其次,引入组长趋同...针对捕鱼优化算法(catch fish optimization algorithm,CFOA)容易陷入局部最优、迭代后期种群多样性单一等问题,提出一种多策略融合改进的捕鱼优化算法。首先,通过反向学习策略进行种群初始化,以提高初始种群的质量;其次,引入组长趋同自适应组队策略,强化算法优势经验的学习;最后,通过引入Lévy飞行螺旋搜索策略,改善集体捕获阶段算法跳出局部最优值的能力;改进算法与灰狼优化(grey wolf optimization,GWO)算法、麻雀优化算法(sparrow search algorithm,SSA)、鲸鱼优化算法(whale optimization algorithm,WOA)、正弦余弦优化算法(sine cosine algorithm,SCA)等7种算法在15个基准测试函数上进行了仿真对比分析。试验结果表明,改进算法在求解精度和收敛速度等方面有较好提升。此外,3个工程设计优化问题的仿真试验进一步验证了改进算法在处理工程优化问题上的优越性。展开更多
文摘Focused on various BP algorithms with variable learning rate based on network system error gradient, a modified learning strategy for training non-linear network models is developed with both the incremental and the decremental factors of network learning rate being adjusted adaptively and dynamically. The golden section law is put forward to build a relationship between the network training parameters, and a series of data from an existing model is used to train and test the network parameters. By means of the evaluation of network performance in respect to convergent speed and predicting precision, the effectiveness of the proposed learning strategy can be illustrated.
文摘This paper presents an improved BP algorithm. The approach can reduce the amount of computation by using the logarithmic objective function. The learning rate μ(k) per iteration is determined by dynamic optimization method to accelerate the convergence rate. Since the determination of the learning rate in the proposed BP algorithm only uses the obtained first order derivatives in standard BP algorithm(SBP), the scale of computational and storage burden is like that of SBP algorithm,and the convergence rate is remarkably accelerated. Computer simulations demonstrate the effectiveness of the proposed algorithm
基金Supported by the National Natural Science Foundation of China (60904018, 61203040)the Natural Science Foundation of Fujian Province of China (2009J05147, 2011J01352)+1 种基金the Foundation for Distinguished Young Scholars of Higher Education of Fujian Province of China (JA10004)the Science Research Foundation of Huaqiao University (09BS617)
文摘For accelerating the supervised learning by the SpikeProp algorithm with the temporal coding paradigm in spiking neural networks (SNNs), three learning rate adaptation methods (heuristic rule, delta-delta rule, and delta-bar-delta rule), which are used to speed up training in artificial neural networks, are used to develop the training algorithms for feedforward SNN. The performance of these algorithms is investigated by four experiments: classical XOR (exclusive or) problem, Iris dataset, fault diagnosis in the Tennessee Eastman process, and Poisson trains of discrete spikes. The results demonstrate that all the three learning rate adaptation methods are able to speed up convergence of SNN compared with the original SpikeProp algorithm. Furthermore, if the adaptive learning rate is used in combination with the momentum term, the two modifications will balance each other in a beneficial way to accomplish rapid and steady convergence. In the three learning rate adaptation methods, delta-bar-delta rule performs the best. The delta-bar-delta method with momentum has the fastest convergence rate, the greatest stability of training process, and the maximum accuracy of network learning. The proposed algorithms in this paper are simple and efficient, and consequently valuable for practical applications of SNN.
基金the Natural Science Foundation of China (No. 30070211).
文摘A multilayer perceptron neural network system is established to support the diagnosis for five most common heart diseases (coronary heart disease, rheumatic valvular heart disease, hypertension, chronic cor pulmonale and congenital heart disease). Momentum term, adaptive learning rate, the forgetting mechanics, and conjugate gradients method are introduced to improve the basic BP algorithm aiming to speed up the convergence of the BP algorithm and enhance the accuracy for diagnosis. A heart disease database consisting of 352 samples is applied to the training and testing courses of the system. The performance of the system is assessed by cross-validation method. It is found that as the basic BP algorithm is improved step by step, the convergence speed and the classification accuracy of the network are enhanced, and the system has great application prospect in supporting heart diseases diagnosis.
基金supported by the National Natural Science Foundation of China(62173251,62203113the“Zhishan”Scholars Programs of Southeast University,and the Fundamental Research Funds for the Central Universities(2242023K30034).
文摘Dear Editor,This letter is concerned with the problem of stable high-quality signal transmission of unmanned aerial vehicle(UAV)-assisted multiple-input multiple-output(MIMO)communication system.The particle swarm optimization(PSO)algorithm is used to achieve optimal beamforming and power allocation for this system.Additionally,sensitive particle(SP)and parameter adaptive adjustment are introduced into the traditional PSO algorithm,aiming to improve the performance of the PSO algorithm in dynamic environments with real-time changes in the UAV position.A reinforcement learning(RL)-based approach is proposed to obtain optimal UAV trajectory and adaptive adjustment strategy for PSO parameters,which combine with a specific obstacle avoidance scheme to achieve accurate UAV navigation while satisfying high-quality signal transmission.Simulation experiments show that our scheme provides higher and more stable spectral efficiency as well as more efficient UAV navigation than the currently commonly used scheme with a single RL approach.
