Taking the practical reinforced engineering of a reinforced soil retaining wall as an example, which located in Shandong Province and set on 104 national highway, the stress spread behaviors of the anchor bars in the ...Taking the practical reinforced engineering of a reinforced soil retaining wall as an example, which located in Shandong Province and set on 104 national highway, the stress spread behaviors of the anchor bars in the preforced proceeding were tested. According to the test data, and by use of the update backpropagation (BP) algorithm neural network(NN), the test method and it’s mechanism were studied by the network, then the learning results show the mean square error(MSE) only at the 2 55% level, and the proof testing results show the MSE at 4 38% level (the main aim is to build a NN directly from the in situ test results (the learning phase)). Ipso facto, the learning and adjustment abilities of the NN permit us to develop the test data, subsequently, 36 test data were acquired from the NN. By use of the provide data, as well as the failure situation and carried loading capacity of the retaining wall, finally, the choice the reasonable range interval distance of prestress cement grouting anchor bars were carried out, and the result was 2 m×2 m.展开更多
A new type of recurrent neural network is discussed, which provides the potential for modelling unknown nonlinear systems. The proposed network is a generalization of the network described by Elman, which has three la...A new type of recurrent neural network is discussed, which provides the potential for modelling unknown nonlinear systems. The proposed network is a generalization of the network described by Elman, which has three layers including the input layer, the hidden layer and the output layer. The input layer is composed of two different groups of neurons, the group of external input neurons and the group of the internal context neurons. Since arbitrary connections can be allowed from the hidden layer to the context layer, the modified Elman network has more memory space to represent dynamic systems than the Elman network. In addition, it is proved that the proposed network with appropriate neurons in the context layer can approximate the trajectory of a given dynamical system for any fixed finite length of time. The dynamic backpropagation algorithm is used to estimate the weights of both the feedforward and feedback connections. The methods have been successfully applied to the modelling of nonlinear plants.展开更多
Complex-valued neural networks(CVNNs)have shown their excellent efficiency compared to their real counterparts in speech enhancement,image and signal processing.Researchers throughout the years have made many efforts ...Complex-valued neural networks(CVNNs)have shown their excellent efficiency compared to their real counterparts in speech enhancement,image and signal processing.Researchers throughout the years have made many efforts to improve the learning algorithms and activation functions of CVNNs.Since CVNNs have proven to have better performance in handling the naturally complex-valued data and signals,this area of study will grow and expect the arrival of some effective improvements in the future.Therefore,there exists an obvious reason to provide a comprehensive survey paper that systematically collects and categorizes the advancement of CVNNs.In this paper,we discuss and summarize the recent advances based on their learning algorithms,activation functions,which is the most challenging part of building a CVNN,and applications.Besides,we outline the structure and applications of complex-valued convolutional,residual and recurrent neural networks.Finally,we also present some challenges and future research directions to facilitate the exploration of the ability of CVNNs.展开更多
In recent years,neural networks have become an increasingly powerful tool in scientific computing.The universal approximation theorem asserts that a neural network may be constructed to approximate any given continuou...In recent years,neural networks have become an increasingly powerful tool in scientific computing.The universal approximation theorem asserts that a neural network may be constructed to approximate any given continuous function at desired accuracy.The backpropagation algorithm further allows efficient optimization of the parameters in training a neural network.Powered by GPU’s,effective computations for scientific and engineering problems are thereby enabled.In addition,we show that finite element shape functions may also be approximated by neural networks.展开更多
Traditional methods for judging the degree of insufficient fluid supply in oil wells have low efficiency and limited accuracy. To address this problem, a method for intelligently identifying the degree of insufficient...Traditional methods for judging the degree of insufficient fluid supply in oil wells have low efficiency and limited accuracy. To address this problem, a method for intelligently identifying the degree of insufficient fluid supply in oil wells based on convolutional neural networks is proposed in this paper. Firstly, 5000 indicator diagrams with insufficient liquid supply were collected from the oilfield site, and a sample set was established after preprocessing;then based on the AlexNet model, combined with the characteristics of the indicator diagram, a convolutional neural network model including 4 layers of convolutional layers, 3 layers of down-pooling layers and 2 layers of fully connected layers is established. The backpropagation, ReLu activation function and dropout regularization method are used to complete the training of the convolutional neural network;finally, the performance of the convolutional neural network under different iteration times and network structure is compared, and the super parameter optimization of the model is completed. It has laid a good foundation for realizing the self-adaptive and intelligent matching of oil well production parameters and formation fluid supply conditions. It has certain application prospects. The results show that the accuracy of training and verification of the method exceeds 98%, which can meet the actual application requirements on site.展开更多
This paper presents a multi-ANN approximation approach to approximate complex non-linear function. Comparing with single-ANN methods the proposed approach improves and increases the approximation and generalization ab...This paper presents a multi-ANN approximation approach to approximate complex non-linear function. Comparing with single-ANN methods the proposed approach improves and increases the approximation and generalization ability, and adaptability greatly in learning processes of networks. The simulation results have been shown that the method can be applied to the modeling and identification of complex dynamic control systems.展开更多
We introduce the fractional-order global optimal backpropagation machine,which is trained by an improved fractionalorder steepest descent method(FSDM).This is a fractional-order backpropagation neural network(FBPNN),a...We introduce the fractional-order global optimal backpropagation machine,which is trained by an improved fractionalorder steepest descent method(FSDM).This is a fractional-order backpropagation neural network(FBPNN),a state-of-the-art fractional-order branch of the family of backpropagation neural networks(BPNNs),different from the majority of the previous classic first-order BPNNs which are trained by the traditional first-order steepest descent method.The reverse incremental search of the proposed FBPNN is in the negative directions of the approximate fractional-order partial derivatives of the square error.First,the theoretical concept of an FBPNN trained by an improved FSDM is described mathematically.Then,the mathematical proof of fractional-order global optimal convergence,an assumption of the structure,and fractional-order multi-scale global optimization of the FBPNN are analyzed in detail.Finally,we perform three(types of)experiments to compare the performances of an FBPNN and a classic first-order BPNN,i.e.,example function approximation,fractional-order multi-scale global optimization,and comparison of global search and error fitting abilities with real data.The higher optimal search ability of an FBPNN to determine the global optimal solution is the major advantage that makes the FBPNN superior to a classic first-order BPNN.展开更多
Scanner color management is one of the key techniques for color reproduction in information optics. A new scanner color management model is presented based on analyzing rendering principle of scanning objects. In this...Scanner color management is one of the key techniques for color reproduction in information optics. A new scanner color management model is presented based on analyzing rendering principle of scanning objects. In this model, a standard color target is taken as experimental sample. Color blocks in color shade area are used to substitute complete color space to solve the difficulties in selecting experimental color blocks. Immune genetic algorithm is used to correct back-propagation neural network （BPNN） to speed up the convergence of the model. Experimental results show that the model can improve the accuracy of scanner color management.展开更多
In recent years,with the support of national policies,Cross Border E-Commerce(CBEC)has developed rapidly.This business model not only brings significant benefits to the national economy,but also has many unique challe...In recent years,with the support of national policies,Cross Border E-Commerce(CBEC)has developed rapidly.This business model not only brings significant benefits to the national economy,but also has many unique challenges,especially at the level of supply chain management.Therefore,to enable CBEC enterprises to develop sustainable supply chain,this study discusses the performance evaluation model of supply chain and proposes a CBEC Supply Chain Performance Evaluation Model(CBECSC-EM)based on the Levenberg–Marquardt Backpropagation(LMBP)algorithm.This experiment constructs performance evaluation indicators for the supply chain of CBEC enterprises.On this basis,the LMBP algorithm is introduced,and improved in the experiment to make the overall performance of the evaluation model more scientific and reasonable.In the verification set,the maximum F1 values of LMBP,DEA,SBM,and BP are 98.46%,93.78%,87.29%,and 78.95%,respectively.The MAPE value of LMBP model is 0.102%,which is lower than the other three methods(0.282%,0.343%,and 0.385%)selected in the experiment.The maximum standard deviation rates of importance and operability of the evaluation indexes are 0.1346 and 0.1405,respectively,and there is a significant consistency between the expert scores.Therefore,the LMBP algorithm has broad application prospects in supply chain performance evaluation of CBEC enterprises.展开更多
文摘Taking the practical reinforced engineering of a reinforced soil retaining wall as an example, which located in Shandong Province and set on 104 national highway, the stress spread behaviors of the anchor bars in the preforced proceeding were tested. According to the test data, and by use of the update backpropagation (BP) algorithm neural network(NN), the test method and it’s mechanism were studied by the network, then the learning results show the mean square error(MSE) only at the 2 55% level, and the proof testing results show the MSE at 4 38% level (the main aim is to build a NN directly from the in situ test results (the learning phase)). Ipso facto, the learning and adjustment abilities of the NN permit us to develop the test data, subsequently, 36 test data were acquired from the NN. By use of the provide data, as well as the failure situation and carried loading capacity of the retaining wall, finally, the choice the reasonable range interval distance of prestress cement grouting anchor bars were carried out, and the result was 2 m×2 m.
文摘A new type of recurrent neural network is discussed, which provides the potential for modelling unknown nonlinear systems. The proposed network is a generalization of the network described by Elman, which has three layers including the input layer, the hidden layer and the output layer. The input layer is composed of two different groups of neurons, the group of external input neurons and the group of the internal context neurons. Since arbitrary connections can be allowed from the hidden layer to the context layer, the modified Elman network has more memory space to represent dynamic systems than the Elman network. In addition, it is proved that the proposed network with appropriate neurons in the context layer can approximate the trajectory of a given dynamical system for any fixed finite length of time. The dynamic backpropagation algorithm is used to estimate the weights of both the feedforward and feedback connections. The methods have been successfully applied to the modelling of nonlinear plants.
基金partially supported by the JSPS KAKENHI(JP22H03643,JP19K22891)。
文摘Complex-valued neural networks(CVNNs)have shown their excellent efficiency compared to their real counterparts in speech enhancement,image and signal processing.Researchers throughout the years have made many efforts to improve the learning algorithms and activation functions of CVNNs.Since CVNNs have proven to have better performance in handling the naturally complex-valued data and signals,this area of study will grow and expect the arrival of some effective improvements in the future.Therefore,there exists an obvious reason to provide a comprehensive survey paper that systematically collects and categorizes the advancement of CVNNs.In this paper,we discuss and summarize the recent advances based on their learning algorithms,activation functions,which is the most challenging part of building a CVNN,and applications.Besides,we outline the structure and applications of complex-valued convolutional,residual and recurrent neural networks.Finally,we also present some challenges and future research directions to facilitate the exploration of the ability of CVNNs.
基金This work was supported in part by the National Natural Sci-ence Foundation of China(Grants 11521202,11832001,11890681 and 11988102).
文摘In recent years,neural networks have become an increasingly powerful tool in scientific computing.The universal approximation theorem asserts that a neural network may be constructed to approximate any given continuous function at desired accuracy.The backpropagation algorithm further allows efficient optimization of the parameters in training a neural network.Powered by GPU’s,effective computations for scientific and engineering problems are thereby enabled.In addition,we show that finite element shape functions may also be approximated by neural networks.
文摘Traditional methods for judging the degree of insufficient fluid supply in oil wells have low efficiency and limited accuracy. To address this problem, a method for intelligently identifying the degree of insufficient fluid supply in oil wells based on convolutional neural networks is proposed in this paper. Firstly, 5000 indicator diagrams with insufficient liquid supply were collected from the oilfield site, and a sample set was established after preprocessing;then based on the AlexNet model, combined with the characteristics of the indicator diagram, a convolutional neural network model including 4 layers of convolutional layers, 3 layers of down-pooling layers and 2 layers of fully connected layers is established. The backpropagation, ReLu activation function and dropout regularization method are used to complete the training of the convolutional neural network;finally, the performance of the convolutional neural network under different iteration times and network structure is compared, and the super parameter optimization of the model is completed. It has laid a good foundation for realizing the self-adaptive and intelligent matching of oil well production parameters and formation fluid supply conditions. It has certain application prospects. The results show that the accuracy of training and verification of the method exceeds 98%, which can meet the actual application requirements on site.
文摘This paper presents a multi-ANN approximation approach to approximate complex non-linear function. Comparing with single-ANN methods the proposed approach improves and increases the approximation and generalization ability, and adaptability greatly in learning processes of networks. The simulation results have been shown that the method can be applied to the modeling and identification of complex dynamic control systems.
基金Project supported by the National Key Research and Development Program of China(No.2018YFC0830300)the National Natural Science Foundation of China(No.61571312)。
文摘We introduce the fractional-order global optimal backpropagation machine,which is trained by an improved fractionalorder steepest descent method(FSDM).This is a fractional-order backpropagation neural network(FBPNN),a state-of-the-art fractional-order branch of the family of backpropagation neural networks(BPNNs),different from the majority of the previous classic first-order BPNNs which are trained by the traditional first-order steepest descent method.The reverse incremental search of the proposed FBPNN is in the negative directions of the approximate fractional-order partial derivatives of the square error.First,the theoretical concept of an FBPNN trained by an improved FSDM is described mathematically.Then,the mathematical proof of fractional-order global optimal convergence,an assumption of the structure,and fractional-order multi-scale global optimization of the FBPNN are analyzed in detail.Finally,we perform three(types of)experiments to compare the performances of an FBPNN and a classic first-order BPNN,i.e.,example function approximation,fractional-order multi-scale global optimization,and comparison of global search and error fitting abilities with real data.The higher optimal search ability of an FBPNN to determine the global optimal solution is the major advantage that makes the FBPNN superior to a classic first-order BPNN.
基金the China Aeronautical Science Foundation(No.02153071)the Key Research Project of Education Department of Jiangxi Province(No.2007259)
文摘Scanner color management is one of the key techniques for color reproduction in information optics. A new scanner color management model is presented based on analyzing rendering principle of scanning objects. In this model, a standard color target is taken as experimental sample. Color blocks in color shade area are used to substitute complete color space to solve the difficulties in selecting experimental color blocks. Immune genetic algorithm is used to correct back-propagation neural network （BPNN） to speed up the convergence of the model. Experimental results show that the model can improve the accuracy of scanner color management.
文摘In recent years,with the support of national policies,Cross Border E-Commerce(CBEC)has developed rapidly.This business model not only brings significant benefits to the national economy,but also has many unique challenges,especially at the level of supply chain management.Therefore,to enable CBEC enterprises to develop sustainable supply chain,this study discusses the performance evaluation model of supply chain and proposes a CBEC Supply Chain Performance Evaluation Model(CBECSC-EM)based on the Levenberg–Marquardt Backpropagation(LMBP)algorithm.This experiment constructs performance evaluation indicators for the supply chain of CBEC enterprises.On this basis,the LMBP algorithm is introduced,and improved in the experiment to make the overall performance of the evaluation model more scientific and reasonable.In the verification set,the maximum F1 values of LMBP,DEA,SBM,and BP are 98.46%,93.78%,87.29%,and 78.95%,respectively.The MAPE value of LMBP model is 0.102%,which is lower than the other three methods(0.282%,0.343%,and 0.385%)selected in the experiment.The maximum standard deviation rates of importance and operability of the evaluation indexes are 0.1346 and 0.1405,respectively,and there is a significant consistency between the expert scores.Therefore,the LMBP algorithm has broad application prospects in supply chain performance evaluation of CBEC enterprises.
