With the explosive growth of computational resources and data generation,deep machine learning has been successfully employed in various applications.One important and emerging scientific application of deep learning ...With the explosive growth of computational resources and data generation,deep machine learning has been successfully employed in various applications.One important and emerging scientific application of deep learning involves solving differential equations.Here,physics-informed neural networks(PINNs)are developed to solve the differential equations associated with a specific scientific problem.As such,algorithms for solving the differential equations by embedding their initial and boundary conditions in the cost function of the artificial neural networks using algorithmic differentiation must also be developed.In this study,various PINNs are adopted to estimate the stresses in the tablets and the interphase of a single lap joint.The proposed model is represented by two fourth-order non-homogeneous coupled partial differential equations,with the axial stresses in the upper and lower tablets adopted as the dependent variables.The axial stresses are a function of the tablet length,which presents the independent variable.Therefore,the axial stresses in the tablets are estimated by solving the coupled partial differential equations when subjected to the boundary conditions,whereas the remaining stress components are expressed in terms of axial stresses.The results obtained using the developed methodology are validated using the results obtained via MAPLE software.展开更多
A kind of second order algorithm--recursive approximate Newton algorithm was given by Karayiannis. The algorithm was simplified when it was formulated. Especially, the simplification to matrix Hessian was very reluct...A kind of second order algorithm--recursive approximate Newton algorithm was given by Karayiannis. The algorithm was simplified when it was formulated. Especially, the simplification to matrix Hessian was very reluctant, which led to the loss of valuable information and affected performance of the algorithm to certain extent. For multi layer feed forward neural networks, the second order back propagation recursive algorithm based generalized cost criteria was proposed. It is proved that it is equivalent to Newton recursive algorithm and has a second order convergent rate. The performance and application prospect are analyzed. Lots of simulation experiments indicate that the calculation of the new algorithm is almost equivalent to the recursive least square multiple algorithm. The algorithm and selection of networks parameters are significant and the performance is more excellent than BP algorithm and the second order learning algorithm that was given by Karayiannis.展开更多
There is instability in the distributed energy storage cloud group end region on the power grid side.In order to avoid large-scale fluctuating charging and discharging in the power grid environment and make the capaci...There is instability in the distributed energy storage cloud group end region on the power grid side.In order to avoid large-scale fluctuating charging and discharging in the power grid environment and make the capacitor components showa continuous and stable charging and discharging state,a hierarchical time-sharing configuration algorithm of distributed energy storage cloud group end region on the power grid side based on multi-scale and multi feature convolution neural network is proposed.Firstly,a voltage stability analysis model based onmulti-scale and multi feature convolution neural network is constructed,and the multi-scale and multi feature convolution neural network is optimized based on Self-OrganizingMaps(SOM)algorithm to analyze the voltage stability of the cloud group end region of distributed energy storage on the grid side under the framework of credibility.According to the optimal scheduling objectives and network size,the distributed robust optimal configuration control model is solved under the framework of coordinated optimal scheduling at multiple time scales;Finally,the time series characteristics of regional power grid load and distributed generation are analyzed.According to the regional hierarchical time-sharing configuration model of“cloud”,“group”and“end”layer,the grid side distributed energy storage cloud group end regional hierarchical time-sharing configuration algorithm is realized.The experimental results show that after applying this algorithm,the best grid side distributed energy storage configuration scheme can be determined,and the stability of grid side distributed energy storage cloud group end region layered timesharing configuration can be improved.展开更多
A brain-computer interface(BCI)system is one of the most effective ways that translates brain signals into output commands.Different imagery activities can be classified based on the changes inμandβrhythms and their...A brain-computer interface(BCI)system is one of the most effective ways that translates brain signals into output commands.Different imagery activities can be classified based on the changes inμandβrhythms and their spatial distributions.Multi-layer perceptron neural networks(MLP-NNs)are commonly used for classification.Training such MLP-NNs has great importance in a way that has attracted many researchers to this field recently.Conventional methods for training NNs,such as gradient descent and recursive methods,have some disadvantages including low accuracy,slow convergence speed and trapping in local minimums.In this paper,in order to overcome these issues,the MLP-NN trained by a hybrid population-physics-based algorithm,the combination of particle swarm optimization and gravitational search algorithm(PSOGSA),is proposed for our classification problem.To show the advantages of using PSOGSA that trains NNs,this algorithm is compared with other meta-heuristic algorithms such as particle swarm optimization(PSO),gravitational search algorithm(GSA)and new versions of PSO.The metrics that are discussed in this paper are the speed of convergence and classification accuracy metrics.The results show that the proposed algorithm in most subjects of encephalography(EEG)dataset has very better or acceptable performance compared to others.展开更多
This paper presents the development of an artificial neural network (ANN) model based on the multi-layer perceptron (MLP) for analyzing internet traffic data over IP networks. We applied the ANN to analyze a time seri...This paper presents the development of an artificial neural network (ANN) model based on the multi-layer perceptron (MLP) for analyzing internet traffic data over IP networks. We applied the ANN to analyze a time series of measured data for network response evaluation. For this reason, we used the input and output data of an internet traffic over IP networks to identify the ANN model, and we studied the performance of some training algorithms used to estimate the weights of the neuron. The comparison between some training algorithms demonstrates the efficiency and the accu-racy of the Levenberg-Marquardt (LM) and the Resilient back propagation (Rp) algorithms in term of statistical crite-ria. Consequently, the obtained results show that the developed models, using the LM and the Rp algorithms, can successfully be used for analyzing internet traffic over IP networks, and can be applied as an excellent and fundamental tool for the management of the internet traffic at different times.展开更多
In this paper,a fast neural network model for the forecasting of effective points by DEA model is proposed,which is based on the SPDS training algorithm.The SPDS training algorithm overcomes the drawbacks of slow conv...In this paper,a fast neural network model for the forecasting of effective points by DEA model is proposed,which is based on the SPDS training algorithm.The SPDS training algorithm overcomes the drawbacks of slow convergent speed and partially minimum result for BP algorithm.Its training speed is much faster and its forecasting precision is much better than those of BP algorithm.By numeric examples,it is showed that adopting the neural network model in the forecasting of effective points by DEA model is valid.展开更多
A one-dimensional BOD-DO coupling model for water quality simulation is presented, which adopts Streeter-Phelps equations and the theory of back-propagation artificial neural network. The water quality data of Yangtze...A one-dimensional BOD-DO coupling model for water quality simulation is presented, which adopts Streeter-Phelps equations and the theory of back-propagation artificial neural network. The water quality data of Yangtze River in the Chongqing region in the year of 1989 are divided into 5 groups and used in the learning and testing courses of this model. The result shows that such model is feasible for water quality simulation and is more accurate than traditional models.展开更多
This paper aims to propose a framework for manifold regularization(MR) based distributed semi-supervised learning(DSSL) using single layer feed-forward neural network(SLFNN). The proposed framework, denoted as DSSL-SL...This paper aims to propose a framework for manifold regularization(MR) based distributed semi-supervised learning(DSSL) using single layer feed-forward neural network(SLFNN). The proposed framework, denoted as DSSL-SLFNN is based on the SLFNN, MR framework, and distributed optimization strategy. Then, a series of algorithms are derived to solve DSSL problems. In DSSL problems, data consisting of labeled and unlabeled samples are distributed over a communication network, where each node has only access to its own data and can only communicate with its neighbors. In some scenarios, DSSL problems cannot be solved by centralized algorithms. According to the DSSL-SLFNN framework, each node over the communication network exchanges the initial parameters of the SLFNN with the same basis functions for semi-supervised learning(SSL). All nodes calculate the global optimal coefficients of the SLFNN by using distributed datasets and local updates. During the learning process, each node only exchanges local coefficients with its neighbors rather than raw data. It means that DSSL-SLFNN based algorithms work in a fully distributed fashion and are privacy preserving methods. Finally, several simulations are presented to show the efficiency of the proposed framework and the derived algorithms.展开更多
Now a days,Remote Sensing(RS)techniques are used for earth observation and for detection of soil types with high accuracy and better reliability.This technique provides perspective view of spatial resolution and aids ...Now a days,Remote Sensing(RS)techniques are used for earth observation and for detection of soil types with high accuracy and better reliability.This technique provides perspective view of spatial resolution and aids in instantaneous measurement of soil’s minerals and its characteristics.There are a few challenges that is present in soil classification using image enhancement such as,locating and plotting soil boundaries,slopes,hazardous areas,drainage condition,land use,vegetation etc.There are some traditional approaches which involves few drawbacks such as,manual involvement which results in inaccuracy due to human interference,time consuming,inconsistent prediction etc.To overcome these draw backs and to improve the predictive analysis of soil characteristics,we propose a Hybrid Deep Learning improved BAT optimization algorithm(HDIB)for soil classification using remote sensing hyperspectral features.In HDIB,we propose a spontaneous BAT optimization algorithm for feature extraction of both spectral-spatial features by choosing pure pixels from the Hyper Spectral(HS)image.Spectral-spatial vector as training illustrations is attained by merging spatial and spectral vector by means of priority stacking methodology.Then,a recurring Deep Learning(DL)Neural Network(NN)is used for classifying the HS images,considering the datasets of Pavia University,Salinas and Tamil Nadu Hill Scene,which in turn improves the reliability of classification.Finally,the performance of the proposed HDIB based soil classifier is compared and analyzed with existing methodologies like Single Layer Perceptron(SLP),Convolutional Neural Networks(CNN)and Deep Metric Learning(DML)and it shows an improved classification accuracy of 99.87%,98.34%and 99.9%for Tamil Nadu Hills dataset,Pavia University and Salinas scene datasets respectively.展开更多
【目的】针对现有桥梁施工线形预测方法的不足,提出一种基于自适应矩估计(adaptive moment estimation,Adam)优化反向传播(back propagation,BP)神经网络的连续刚构桥线形预测方法。【方法】以小乌江大桥为研究对象,通过正交试验确定了...【目的】针对现有桥梁施工线形预测方法的不足,提出一种基于自适应矩估计(adaptive moment estimation,Adam)优化反向传播(back propagation,BP)神经网络的连续刚构桥线形预测方法。【方法】以小乌江大桥为研究对象,通过正交试验确定了桥梁施工线形的敏感参数为混凝土容重、混凝土弹性模量、张拉控制应力和温度。以均方根误差、平均绝对误差、决定系数和运算耗时为评价指标,在初始学习率相同的条件下,对梯度下降、梯度下降最小化、均方根传播和Adam四种优化算法的性能进行对比。【结果】基于Adam优化算法的BP神经网络收敛时的运算耗时为0.518 s,相较于其他三种优化算法,Adam优化算法下BP神经网络具有更快的收敛速度和更高的拟合精度。【结论】所提方法可较准确地预测连续刚构桥施工过程的线形。展开更多
基金Project supported by the Science and Engineering Research Board(SERB),Department of Science and Technology(DST),India(No.SRG/2019/001581)。
文摘With the explosive growth of computational resources and data generation,deep machine learning has been successfully employed in various applications.One important and emerging scientific application of deep learning involves solving differential equations.Here,physics-informed neural networks(PINNs)are developed to solve the differential equations associated with a specific scientific problem.As such,algorithms for solving the differential equations by embedding their initial and boundary conditions in the cost function of the artificial neural networks using algorithmic differentiation must also be developed.In this study,various PINNs are adopted to estimate the stresses in the tablets and the interphase of a single lap joint.The proposed model is represented by two fourth-order non-homogeneous coupled partial differential equations,with the axial stresses in the upper and lower tablets adopted as the dependent variables.The axial stresses are a function of the tablet length,which presents the independent variable.Therefore,the axial stresses in the tablets are estimated by solving the coupled partial differential equations when subjected to the boundary conditions,whereas the remaining stress components are expressed in terms of axial stresses.The results obtained using the developed methodology are validated using the results obtained via MAPLE software.
文摘A kind of second order algorithm--recursive approximate Newton algorithm was given by Karayiannis. The algorithm was simplified when it was formulated. Especially, the simplification to matrix Hessian was very reluctant, which led to the loss of valuable information and affected performance of the algorithm to certain extent. For multi layer feed forward neural networks, the second order back propagation recursive algorithm based generalized cost criteria was proposed. It is proved that it is equivalent to Newton recursive algorithm and has a second order convergent rate. The performance and application prospect are analyzed. Lots of simulation experiments indicate that the calculation of the new algorithm is almost equivalent to the recursive least square multiple algorithm. The algorithm and selection of networks parameters are significant and the performance is more excellent than BP algorithm and the second order learning algorithm that was given by Karayiannis.
基金supported by State Grid Corporation Limited Science and Technology Project Funding(Contract No.SGCQSQ00YJJS2200380).
文摘There is instability in the distributed energy storage cloud group end region on the power grid side.In order to avoid large-scale fluctuating charging and discharging in the power grid environment and make the capacitor components showa continuous and stable charging and discharging state,a hierarchical time-sharing configuration algorithm of distributed energy storage cloud group end region on the power grid side based on multi-scale and multi feature convolution neural network is proposed.Firstly,a voltage stability analysis model based onmulti-scale and multi feature convolution neural network is constructed,and the multi-scale and multi feature convolution neural network is optimized based on Self-OrganizingMaps(SOM)algorithm to analyze the voltage stability of the cloud group end region of distributed energy storage on the grid side under the framework of credibility.According to the optimal scheduling objectives and network size,the distributed robust optimal configuration control model is solved under the framework of coordinated optimal scheduling at multiple time scales;Finally,the time series characteristics of regional power grid load and distributed generation are analyzed.According to the regional hierarchical time-sharing configuration model of“cloud”,“group”and“end”layer,the grid side distributed energy storage cloud group end regional hierarchical time-sharing configuration algorithm is realized.The experimental results show that after applying this algorithm,the best grid side distributed energy storage configuration scheme can be determined,and the stability of grid side distributed energy storage cloud group end region layered timesharing configuration can be improved.
文摘A brain-computer interface(BCI)system is one of the most effective ways that translates brain signals into output commands.Different imagery activities can be classified based on the changes inμandβrhythms and their spatial distributions.Multi-layer perceptron neural networks(MLP-NNs)are commonly used for classification.Training such MLP-NNs has great importance in a way that has attracted many researchers to this field recently.Conventional methods for training NNs,such as gradient descent and recursive methods,have some disadvantages including low accuracy,slow convergence speed and trapping in local minimums.In this paper,in order to overcome these issues,the MLP-NN trained by a hybrid population-physics-based algorithm,the combination of particle swarm optimization and gravitational search algorithm(PSOGSA),is proposed for our classification problem.To show the advantages of using PSOGSA that trains NNs,this algorithm is compared with other meta-heuristic algorithms such as particle swarm optimization(PSO),gravitational search algorithm(GSA)and new versions of PSO.The metrics that are discussed in this paper are the speed of convergence and classification accuracy metrics.The results show that the proposed algorithm in most subjects of encephalography(EEG)dataset has very better or acceptable performance compared to others.
文摘This paper presents the development of an artificial neural network (ANN) model based on the multi-layer perceptron (MLP) for analyzing internet traffic data over IP networks. We applied the ANN to analyze a time series of measured data for network response evaluation. For this reason, we used the input and output data of an internet traffic over IP networks to identify the ANN model, and we studied the performance of some training algorithms used to estimate the weights of the neuron. The comparison between some training algorithms demonstrates the efficiency and the accu-racy of the Levenberg-Marquardt (LM) and the Resilient back propagation (Rp) algorithms in term of statistical crite-ria. Consequently, the obtained results show that the developed models, using the LM and the Rp algorithms, can successfully be used for analyzing internet traffic over IP networks, and can be applied as an excellent and fundamental tool for the management of the internet traffic at different times.
基金Sponsored by the Natural Scientific Research Foundation of Heilongjiang Province(Grant No.40000045-6-07259)the Natural Scientific Research Inno-vation Foundation of Harbin Institute of Technology(Grant No.HIT.NSRIF.2008.59)+1 种基金the Scientific and Technology Critical Project of Harbin,Hei-longjiang Province(2004)the National Soft Science Key Foundation(Grant No.2008GXS5D113)
文摘In this paper,a fast neural network model for the forecasting of effective points by DEA model is proposed,which is based on the SPDS training algorithm.The SPDS training algorithm overcomes the drawbacks of slow convergent speed and partially minimum result for BP algorithm.Its training speed is much faster and its forecasting precision is much better than those of BP algorithm.By numeric examples,it is showed that adopting the neural network model in the forecasting of effective points by DEA model is valid.
基金Funded by the National Natural Science Foundation of China (No.59838300 No.59778021)
文摘A one-dimensional BOD-DO coupling model for water quality simulation is presented, which adopts Streeter-Phelps equations and the theory of back-propagation artificial neural network. The water quality data of Yangtze River in the Chongqing region in the year of 1989 are divided into 5 groups and used in the learning and testing courses of this model. The result shows that such model is feasible for water quality simulation and is more accurate than traditional models.
基金supported by National Natural Science Foundation of China (Nos. 61877047, 61877046, 62106186 and 62063031)the Fundamental Research Funds for the Central Universities (Nos. JB210701 and JB210718)。
文摘This paper aims to propose a framework for manifold regularization(MR) based distributed semi-supervised learning(DSSL) using single layer feed-forward neural network(SLFNN). The proposed framework, denoted as DSSL-SLFNN is based on the SLFNN, MR framework, and distributed optimization strategy. Then, a series of algorithms are derived to solve DSSL problems. In DSSL problems, data consisting of labeled and unlabeled samples are distributed over a communication network, where each node has only access to its own data and can only communicate with its neighbors. In some scenarios, DSSL problems cannot be solved by centralized algorithms. According to the DSSL-SLFNN framework, each node over the communication network exchanges the initial parameters of the SLFNN with the same basis functions for semi-supervised learning(SSL). All nodes calculate the global optimal coefficients of the SLFNN by using distributed datasets and local updates. During the learning process, each node only exchanges local coefficients with its neighbors rather than raw data. It means that DSSL-SLFNN based algorithms work in a fully distributed fashion and are privacy preserving methods. Finally, several simulations are presented to show the efficiency of the proposed framework and the derived algorithms.
文摘Now a days,Remote Sensing(RS)techniques are used for earth observation and for detection of soil types with high accuracy and better reliability.This technique provides perspective view of spatial resolution and aids in instantaneous measurement of soil’s minerals and its characteristics.There are a few challenges that is present in soil classification using image enhancement such as,locating and plotting soil boundaries,slopes,hazardous areas,drainage condition,land use,vegetation etc.There are some traditional approaches which involves few drawbacks such as,manual involvement which results in inaccuracy due to human interference,time consuming,inconsistent prediction etc.To overcome these draw backs and to improve the predictive analysis of soil characteristics,we propose a Hybrid Deep Learning improved BAT optimization algorithm(HDIB)for soil classification using remote sensing hyperspectral features.In HDIB,we propose a spontaneous BAT optimization algorithm for feature extraction of both spectral-spatial features by choosing pure pixels from the Hyper Spectral(HS)image.Spectral-spatial vector as training illustrations is attained by merging spatial and spectral vector by means of priority stacking methodology.Then,a recurring Deep Learning(DL)Neural Network(NN)is used for classifying the HS images,considering the datasets of Pavia University,Salinas and Tamil Nadu Hill Scene,which in turn improves the reliability of classification.Finally,the performance of the proposed HDIB based soil classifier is compared and analyzed with existing methodologies like Single Layer Perceptron(SLP),Convolutional Neural Networks(CNN)and Deep Metric Learning(DML)and it shows an improved classification accuracy of 99.87%,98.34%and 99.9%for Tamil Nadu Hills dataset,Pavia University and Salinas scene datasets respectively.
文摘【目的】针对现有桥梁施工线形预测方法的不足,提出一种基于自适应矩估计(adaptive moment estimation,Adam)优化反向传播(back propagation,BP)神经网络的连续刚构桥线形预测方法。【方法】以小乌江大桥为研究对象,通过正交试验确定了桥梁施工线形的敏感参数为混凝土容重、混凝土弹性模量、张拉控制应力和温度。以均方根误差、平均绝对误差、决定系数和运算耗时为评价指标,在初始学习率相同的条件下,对梯度下降、梯度下降最小化、均方根传播和Adam四种优化算法的性能进行对比。【结果】基于Adam优化算法的BP神经网络收敛时的运算耗时为0.518 s,相较于其他三种优化算法,Adam优化算法下BP神经网络具有更快的收敛速度和更高的拟合精度。【结论】所提方法可较准确地预测连续刚构桥施工过程的线形。
