Feedforward multi layer neural networks have very strong mapping capability that is based on the non linearity of the activation function, however, the non linearity of the activation function can cause the multiple ...Feedforward multi layer neural networks have very strong mapping capability that is based on the non linearity of the activation function, however, the non linearity of the activation function can cause the multiple local minima on the learning error surfaces, which affect the learning rate and solving optimal weights. This paper proposes a learning method linearizing non linearity of the activation function and discusses its merits and demerits theoretically.展开更多
The significant advantage of the complex resistivity method is to reflect the abnormal body through multi-parameters, but its inversion parameters are more than the resistivity tomography method. Therefore, how to eff...The significant advantage of the complex resistivity method is to reflect the abnormal body through multi-parameters, but its inversion parameters are more than the resistivity tomography method. Therefore, how to effectively invert these spectral parameters has become the focused area of the complex resistivity inversion. An optimized BP neural network (BPNN) approach based on Quantum Particle Swarm Optimization (QPSO) algorithm was presented, which was able to improve global search ability for complex resistivity multi-parameter nonlinear inversion. In the proposed method, the nonlinear weight adjustment strategy and mutation operator were used to enhance the optimization ability of QPSO algorithm. Implementation of proposed QPSO-BPNN was given, the network had 56 hidden neurons in two hidden layers (the first hidden layer has 46 neurons and the second hidden layer has 10 neurons) and it was trained on 48 datasets and tested on another 5 synthetic datasets. The training and test results show that BP neural network optimized by the QPSO algorithm performs better than the BP neural network without initial optimization on the inversion training and test models, and the mean square error distribution is better. At the same time, a double polarized anomalous bodies model was also used to verify the feasibility and effectiveness of the proposed method, the inversion results show that the QPSO-BP algorithm inversion clearly characterizes the anomalous boundaries and is closer to the values of the parameters.展开更多
文摘Feedforward multi layer neural networks have very strong mapping capability that is based on the non linearity of the activation function, however, the non linearity of the activation function can cause the multiple local minima on the learning error surfaces, which affect the learning rate and solving optimal weights. This paper proposes a learning method linearizing non linearity of the activation function and discusses its merits and demerits theoretically.
文摘The significant advantage of the complex resistivity method is to reflect the abnormal body through multi-parameters, but its inversion parameters are more than the resistivity tomography method. Therefore, how to effectively invert these spectral parameters has become the focused area of the complex resistivity inversion. An optimized BP neural network (BPNN) approach based on Quantum Particle Swarm Optimization (QPSO) algorithm was presented, which was able to improve global search ability for complex resistivity multi-parameter nonlinear inversion. In the proposed method, the nonlinear weight adjustment strategy and mutation operator were used to enhance the optimization ability of QPSO algorithm. Implementation of proposed QPSO-BPNN was given, the network had 56 hidden neurons in two hidden layers (the first hidden layer has 46 neurons and the second hidden layer has 10 neurons) and it was trained on 48 datasets and tested on another 5 synthetic datasets. The training and test results show that BP neural network optimized by the QPSO algorithm performs better than the BP neural network without initial optimization on the inversion training and test models, and the mean square error distribution is better. At the same time, a double polarized anomalous bodies model was also used to verify the feasibility and effectiveness of the proposed method, the inversion results show that the QPSO-BP algorithm inversion clearly characterizes the anomalous boundaries and is closer to the values of the parameters.
