Deep neural networks(DNNs)are effective in solving both forward and inverse problems for nonlinear partial differential equations(PDEs).However,conventional DNNs are not effective in handling problems such as delay di...Deep neural networks(DNNs)are effective in solving both forward and inverse problems for nonlinear partial differential equations(PDEs).However,conventional DNNs are not effective in handling problems such as delay differential equations(DDEs)and delay integrodifferential equations(DIDEs)with constant delays,primarily due to their low regularity at delayinduced breaking points.In this paper,a DNN method that combines multi-task learning(MTL)which is proposed to solve both the forward and inverse problems of DIDEs.The core idea of this approach is to divide the original equation into multiple tasks based on the delay,using auxiliary outputs to represent the integral terms,followed by the use of MTL to seamlessly incorporate the properties at the breaking points into the loss function.Furthermore,given the increased training dificulty associated with multiple tasks and outputs,we employ a sequential training scheme to reduce training complexity and provide reference solutions for subsequent tasks.This approach significantly enhances the approximation accuracy of solving DIDEs with DNNs,as demonstrated by comparisons with traditional DNN methods.We validate the effectiveness of this method through several numerical experiments,test various parameter sharing structures in MTL and compare the testing results of these structures.Finally,this method is implemented to solve the inverse problem of nonlinear DIDE and the results show that the unknown parameters of DIDE can be discovered with sparse or noisy data.展开更多
In this paper,we propose a symmetric difference data enhancement physics-informed neural network(SDE-PINN)to study soliton solutions for discrete nonlinear lattice equations(NLEs).By considering known and unknown symm...In this paper,we propose a symmetric difference data enhancement physics-informed neural network(SDE-PINN)to study soliton solutions for discrete nonlinear lattice equations(NLEs).By considering known and unknown symmetric points,numerical simulations are conducted to one-soliton and two-soliton solutions of a discrete KdV equation,as well as a one-soliton solution of a discrete Toda lattice equation.Compared with the existing discrete deep learning approach,the numerical results reveal that within the specified spatiotemporal domain,the prediction accuracy by SDE-PINN is excellent regardless of the interior or extrapolation prediction,with a significant reduction in training time.The proposed data enhancement technique and symmetric structure development provides a new perspective for the deep learning approach to solve discrete NLEs.The newly proposed SDE-PINN can also be applied to solve continuous nonlinear equations and other discrete NLEs numerically.展开更多
A neural network(NN) is a powerful tool for approximating bounded continuous functions in machine learning. The NN provides a framework for numerically solving ordinary differential equations(ODEs) and partial differe...A neural network(NN) is a powerful tool for approximating bounded continuous functions in machine learning. The NN provides a framework for numerically solving ordinary differential equations(ODEs) and partial differential equations(PDEs)combined with the automatic differentiation(AD) technique. In this work, we explore the use of NN for the function approximation and propose a universal solver for ODEs and PDEs. The solver is tested for initial value problems and boundary value problems of ODEs, and the results exhibit high accuracy for not only the unknown functions but also their derivatives. The same strategy can be used to construct a PDE solver based on collocation points instead of a mesh, which is tested with the Burgers equation and the heat equation(i.e., the Laplace equation).展开更多
We consider solving the forward and inverse partial differential equations(PDEs)which have sharp solutions with physics-informed neural networks(PINNs)in this work.In particular,to better capture the sharpness of the ...We consider solving the forward and inverse partial differential equations(PDEs)which have sharp solutions with physics-informed neural networks(PINNs)in this work.In particular,to better capture the sharpness of the solution,we propose the adaptive sampling methods(ASMs)based on the residual and the gradient of the solution.We first present a residual only-based ASM denoted by ASMⅠ.In this approach,we first train the neural network using a small number of residual points and divide the computational domain into a certain number of sub-domains,then we add new residual points in the sub-domain which has the largest mean absolute value of the residual,and those points which have the largest absolute values of the residual in this sub-domain as new residual points.We further develop a second type of ASM(denoted by ASMⅡ)based on both the residual and the gradient of the solution due to the fact that only the residual may not be able to efficiently capture the sharpness of the solution.The procedure of ASMⅡis almost the same as that of ASMⅠ,and we add new residual points which have not only large residuals but also large gradients.To demonstrate the effectiveness of the present methods,we use both ASMⅠand ASMⅡto solve a number of PDEs,including the Burger equation,the compressible Euler equation,the Poisson equation over an Lshape domain as well as the high-dimensional Poisson equation.It has been shown from the numerical results that the sharp solutions can be well approximated by using either ASMⅠor ASMⅡ,and both methods deliver much more accurate solutions than the original PINNs with the same number of residual points.Moreover,the ASMⅡalgorithm has better performance in terms of accuracy,efficiency,and stability compared with the ASMⅠalgorithm.This means that the gradient of the solution improves the stability and efficiency of the adaptive sampling procedure as well as the accuracy of the solution.Furthermore,we also employ the similar adaptive sampling technique for the data points of boundary conditions(BCs)if the sharpness of the solution is near the boundary.The result of the L-shape Poisson problem indicates that the present method can significantly improve the efficiency,stability,and accuracy.展开更多
From the analytical dynamics point of view, this paper develops an optimal control framework to synchronize networked multibody systems using the fundamental equation of mechanics. A novel robust control law derived f...From the analytical dynamics point of view, this paper develops an optimal control framework to synchronize networked multibody systems using the fundamental equation of mechanics. A novel robust control law derived from the framework is then used to achieve complete synchronization of networked identical or non-identical multibody systems formulated with Lagrangian dynamics. A distinctive feature of the developed control strategy is the introduction of network structures into the control requirement. The control law consists of two components, the first describing the architecture of the network and the second denoting an active feedback control strategy. A corresponding stability analysis is performed by the algebraic graph theory. A representative network composed of ten identical or non-identical gyroscopes is used as an illustrative example. Numerical simulation of the systems with three kinds of network structures, including global coupling, nearest-neighbour, and small-world networks, is given to demonstrate effectiveness of the proposed control methodology.展开更多
Despite some empirical successes for solving nonlinear evolution equations using deep learning,there are several unresolved issues.First,it could not uncover the dynamical behaviors of some equations where highly nonl...Despite some empirical successes for solving nonlinear evolution equations using deep learning,there are several unresolved issues.First,it could not uncover the dynamical behaviors of some equations where highly nonlinear source terms are included very well.Second,the gradient exploding and vanishing problems often occur for the traditional feedforward neural networks.In this paper,we propose a new architecture that combines the deep residual neural network with some underlying physical laws.Using the sine-Gordon equation as an example,we show that the numerical result is in good agreement with the exact soliton solution.In addition,a lot of numerical experiments show that the model is robust under small perturbations to a certain extent.展开更多
In this paper, we give a smoothing neural network algorithm for absolute value equations (AVE). By using smoothing function, we reformulate the AVE as a differentiable unconstrained optimization and we establish a ste...In this paper, we give a smoothing neural network algorithm for absolute value equations (AVE). By using smoothing function, we reformulate the AVE as a differentiable unconstrained optimization and we establish a steep descent method to solve it. We prove the stability and the equilibrium state of the neural network to be a solution of the AVE. The numerical tests show the efficient of the proposed algorithm.展开更多
Novel distributed parameter neural networks are proposed for solving partial differential equations, and their dynamic performances are studied in Hilbert space. The locally connected neural networks are obtained by s...Novel distributed parameter neural networks are proposed for solving partial differential equations, and their dynamic performances are studied in Hilbert space. The locally connected neural networks are obtained by separating distributed parameter neural networks. Two simulations are also given. Both theoretical and computed results illustrate that the distributed parameter neural networks are effective and efficient for solving partial differential equation problems.展开更多
This research work investigates the use of Artificial Neural Network (ANN) based on models for solving first and second order linear constant coefficient ordinary differential equations with initial conditions. In par...This research work investigates the use of Artificial Neural Network (ANN) based on models for solving first and second order linear constant coefficient ordinary differential equations with initial conditions. In particular, we employ a feed-forward Multilayer Perceptron Neural Network (MLPNN), but bypass the standard back-propagation algorithm for updating the intrinsic weights. A trial solution of the differential equation is written as a sum of two parts. The first part satisfies the initial or boundary conditions and contains no adjustable parameters. The second part involves a feed-forward neural network to be trained to satisfy the differential equation. Numerous works have appeared in recent times regarding the solution of differential equations using ANN, however majority of these employed a single hidden layer perceptron model, incorporating a back-propagation algorithm for weight updation. For the homogeneous case, we assume a solution in exponential form and compute a polynomial approximation using statistical regression. From here we pick the unknown coefficients as the weights from input layer to hidden layer of the associated neural network trial solution. To get the weights from hidden layer to the output layer, we form algebraic equations incorporating the default sign of the differential equations. We then apply the Gaussian Radial Basis function (GRBF) approximation model to achieve our objective. The weights obtained in this manner need not be adjusted. We proceed to develop a Neural Network algorithm using MathCAD software, which enables us to slightly adjust the intrinsic biases. We compare the convergence and the accuracy of our results with analytic solutions, as well as well-known numerical methods and obtain satisfactory results for our example ODE problems.展开更多
The closed form of solutions of Kac-van Moerbeke lattice and self-dual network equations are considered by proposing transformations based on Riccati equation, using symbolic computation. In contrast to the numerical ...The closed form of solutions of Kac-van Moerbeke lattice and self-dual network equations are considered by proposing transformations based on Riccati equation, using symbolic computation. In contrast to the numerical computation of travelling wave solutions for differential difference equations, our method obtains exact solutions which have physical relevance.展开更多
The N-fold Darboux transformation(DT) T_n^([N]) of the nonlinear self-dual network equation is given in terms of the determinant representation. The elements in determinants are composed of the eigenvalues λ_j(j = 1,...The N-fold Darboux transformation(DT) T_n^([N]) of the nonlinear self-dual network equation is given in terms of the determinant representation. The elements in determinants are composed of the eigenvalues λ_j(j = 1, 2..., N)and the corresponding eigenfunctions of the associated Lax equation. Using this representation, the N-soliton solutions of the nonlinear self-dual network equation are given from the zero "seed" solution by the N-fold DT. A general form of the N-degenerate soliton is constructed from the determinants of N-soliton by a special limit λ_j →λ_1 and by using the higher-order Taylor expansion. For 2-degenerate and 3-degenerate solitons, approximate orbits are given analytically,which provide excellent fit of exact trajectories. These orbits have a time-dependent "phase shift", namely ln(t^2).展开更多
Bayesian networks （BN） have many advantages over other methods in ecological modeling, and have become an increasingly popular modeling tool. However, BN are flawed in regard to building models based on inadequate e...Bayesian networks （BN） have many advantages over other methods in ecological modeling, and have become an increasingly popular modeling tool. However, BN are flawed in regard to building models based on inadequate existing knowledge. To overcome this limitation, we propose a new method that links BN with structural equation modeling （SEM）. In this method, SEM is used to improve the model structure for BN. This method was used to simulate coastal phytoplankton dynamics in the Bohai Bay. We demonstrate that this hybrid approach minimizes the need for expert elicitation, generates more reasonable structures for BN models, and increases the BN model＇s accuracy and reliability. These results suggest that the inclusion of SEM for testing and verifying the theoretical structure during the initial construction stage improves the effectiveness of BN models, especially for complex eco-environment systems. The results also demonstrate that in the Bohai Bay, while phytoplankton biomass has the greatest influence on phytoplankton dynamics, the impact of nutrients on phytoplankton dynamics is larger than the influence of the physical environment in summer. Furthermore, although the Redfield ratio indicates that phosphorus should be the primary nutrient limiting factor, our results show that silicate plays the most important role in regulating phytoplankton dynamics in the Bohai Bay.展开更多
Growth rate of Yarrowia lipolytica NCIM 3589 was observed in a fermentation medium consisting of peptone, yeast extract, sodium chloride. Logistic equation was fitted to the growth data (time vs. biomass concentration...Growth rate of Yarrowia lipolytica NCIM 3589 was observed in a fermentation medium consisting of peptone, yeast extract, sodium chloride. Logistic equation was fitted to the growth data (time vs. biomass concentration) and compared with the prediction given by Artificial Neural Networks (ANN). ANN was found to be superior in describing growth characteristics. A single MATLAB programme is developed to fit the growth data by logistic equation and ANN.展开更多
We consider optimal control problems for the flow of gas in a pipe network. The equations of motions are taken to be represented by a semi-linear model derived from the fully nonlinear isothermal Euler gas equations. ...We consider optimal control problems for the flow of gas in a pipe network. The equations of motions are taken to be represented by a semi-linear model derived from the fully nonlinear isothermal Euler gas equations. We formulate an optimal control problem on a given network and introduce a time discretization thereof. We then study the well-posedness of the corresponding time-discrete optimal control problem. In order to further reduce the complexity, we consider an instantaneous control strategy. The main part of the paper is concerned with a non-overlapping domain decomposition of the semi-linear elliptic optimal control problem on the graph into local problems on a small part of the network, ultimately on a single edge.展开更多
This paper focuses on a very important point which consists in evaluating experimental data prior to their use for chemical process designs. Hexafluoropropylene P, ρ, T data measured at 11 temperatures from 263 to 36...This paper focuses on a very important point which consists in evaluating experimental data prior to their use for chemical process designs. Hexafluoropropylene P, ρ, T data measured at 11 temperatures from 263 to 362 K and at pressures up to 10 MPa have been examined through a consistency test presented herein and based on the use of a methodology implying both neural networks and Virial equation. Such a methodology appears as very powerful to identify erroneous data and could be conveniently handled for quick checks of databases previously to modeling through classical thermodynamic models and equations of state. As an application to liquid and vapor phase densities of hexafluoropropylene, a more reliable database is provided after removing out layer data.展开更多
Under different conditions,gene regulatory networks(GRNs)of the same gene set could be similar but different.The differential analysis of GRNs under different conditions is important for understanding condition-specif...Under different conditions,gene regulatory networks(GRNs)of the same gene set could be similar but different.The differential analysis of GRNs under different conditions is important for understanding condition-specific gene regulatory relationships.In a naive approach,existing GRN inference algorithms can be used to separately estimate two GRNs under different conditions and identify the differences between them.However,in this way,the similarities between the pairwise GRNs are not taken into account.Several joint differential analysis algorithms have been proposed recently,which were proved to outperform the naive approach apparently.In this paper,we model the GRNs under different conditions with structural equation models(SEMs)to integrate gene expression data and genetic perturbations,and re-parameterize the pairwise SEMs to form an integrated model that incorporates the differential structure.Then,a Bayesian inference method is used to make joint differential analysis by solving the integrated model.We evaluated the performance of the proposed re-parametrization-based Bayesian differential analysis(ReBDA)algorithm by running simulations on synthetic data with different settings.The performance of the ReBDA algorithm was demonstrated better than another state-of-the-art joint differential analysis algorithm for SEMs ReDNet obviously.In the end,the ReBDA algorithm was applied to make differential analysis on a real human lung gene data set to illustrate its applicability and practicability.展开更多
Partial differential equations(PDEs)are important tools for scientific research and are widely used in various fields.However,it is usually very difficult to obtain accurate analytical solutions of PDEs,and numerical ...Partial differential equations(PDEs)are important tools for scientific research and are widely used in various fields.However,it is usually very difficult to obtain accurate analytical solutions of PDEs,and numerical methods to solve PDEs are often computationally intensive and very time-consuming.In recent years,Physics Informed Neural Networks(PINNs)have been successfully applied to find numerical solutions of PDEs and have shown great potential.All the while,solitary waves have been of great interest to researchers in the field of nonlinear science.In this paper,we perform numerical simulations of solitary wave solutions of several PDEs using improved PINNs.The improved PINNs not only incorporate constraints on the control equations to ensure the interpretability of the prediction results,which is important for physical field simulations,in addition,an adaptive activation function is introduced.By introducing hyperparameters in the activation function to change the slope of the activation function to avoid the disappearance of the gradient,computing time is saved thereby speeding up training.In this paper,the m Kd V equation,the improved Boussinesq equation,the Caudrey–Dodd–Gibbon–Sawada–Kotera equation and the p-g BKP equation are selected for study,and the errors of the simulation results are analyzed to assess the accuracy of the predicted solitary wave solution.The experimental results show that the improved PINNs are significantly better than the traditional PINNs with shorter training time but more accurate prediction results.The improved PINNs improve the training speed by more than 1.5 times compared with the traditional PINNs,while maintaining the prediction error less than 10~(-2)in this order of magnitude.展开更多
We propose the meshfree-based physics-informed neural networks for solving the unsteady Oseen equations.Firstly,based on the ideas of meshfree and small sample learning,we only randomly select a small number of spatio...We propose the meshfree-based physics-informed neural networks for solving the unsteady Oseen equations.Firstly,based on the ideas of meshfree and small sample learning,we only randomly select a small number of spatiotemporal points to train the neural network instead of forming a mesh.Specifically,we optimize the neural network by minimizing the loss function to satisfy the differential operators,initial condition and boundary condition.Then,we prove the convergence of the loss function and the convergence of the neural network.In addition,the feasibility and effectiveness of the method are verified by the results of numerical experiments,and the theoretical derivation is verified by the relative error between the neural network solution and the analytical solution.展开更多
Intelligent Adaptive Control(AC) has remarkable advantages in the control system design of aero-engine which has strong nonlinearity and uncertainty. Inspired by the Nonlinear Autoregressive Moving Average(NARMA)-L2 a...Intelligent Adaptive Control(AC) has remarkable advantages in the control system design of aero-engine which has strong nonlinearity and uncertainty. Inspired by the Nonlinear Autoregressive Moving Average(NARMA)-L2 adaptive control, a novel Nonlinear State Space Equation(NSSE) based Adaptive neural network Control(NSSE-AC) method is proposed for the turbo-shaft engine control system design. The proposed NSSE model is derived from a special neural network with an extra layer, and the rotor speed of the gas turbine is taken as the main state variable which makes the NSSE model be able to capture the system dynamic better than the NARMA-L2 model. A hybrid Recursive Least-Square and Levenberg-Marquardt(RLS-LM) algorithm is advanced to perform the online learning of the neural network, which further enhances both the accuracy of the NSSE model and the performance of the adaptive controller. The feedback correction is also utilized in the NSSE-AC system to eliminate the steady-state tracking error. Simulation results show that, compared with the NARMA-L2 model, the NSSE model of the turboshaft engine is more accurate. The maximum modeling error is decreased from 5.92% to 0.97%when the LM algorithm is introduced to optimize the neural network parameters. The NSSE-AC method can not only achieve a better main control loop performance than the traditional controller but also limit all the constraint parameters efficiently with quick and accurate switching responses even if component degradation exists. Thus, the effectiveness of the NSSE-AC method is validated.展开更多
Fusion and fission are two important phenomena that have been experimentally observed in many real physical models.In this paper,we investigate the two phenomena in the(2+1)-dimensional Hirota-Satsuma-Ito equation via...Fusion and fission are two important phenomena that have been experimentally observed in many real physical models.In this paper,we investigate the two phenomena in the(2+1)-dimensional Hirota-Satsuma-Ito equation via the physics-informed neural networks(PINN)method.By choosing suitable physically constrained initial boundary conditions,the data-driven fusion and fission solutions are obtained for the first time.Dynamical behaviors and error analysis of these solutions are investigated via illustratively numerical figures,which show that good results are achieved.It is pointed out that the PINN method adopted here can be effectively used to construct the data-driven fusion and fission solutions for other nonlinear integrable equations.Based on the powerful predictive capability of the PINN method and wide applications of fusion and fission in many physical areas,it is hoped that the data-driven solutions obtained here will be helpful for experts to predict or explain related physical phenomena.展开更多
文摘Deep neural networks(DNNs)are effective in solving both forward and inverse problems for nonlinear partial differential equations(PDEs).However,conventional DNNs are not effective in handling problems such as delay differential equations(DDEs)and delay integrodifferential equations(DIDEs)with constant delays,primarily due to their low regularity at delayinduced breaking points.In this paper,a DNN method that combines multi-task learning(MTL)which is proposed to solve both the forward and inverse problems of DIDEs.The core idea of this approach is to divide the original equation into multiple tasks based on the delay,using auxiliary outputs to represent the integral terms,followed by the use of MTL to seamlessly incorporate the properties at the breaking points into the loss function.Furthermore,given the increased training dificulty associated with multiple tasks and outputs,we employ a sequential training scheme to reduce training complexity and provide reference solutions for subsequent tasks.This approach significantly enhances the approximation accuracy of solving DIDEs with DNNs,as demonstrated by comparisons with traditional DNN methods.We validate the effectiveness of this method through several numerical experiments,test various parameter sharing structures in MTL and compare the testing results of these structures.Finally,this method is implemented to solve the inverse problem of nonlinear DIDE and the results show that the unknown parameters of DIDE can be discovered with sparse or noisy data.
基金supported by the National Natural Science Foundation of China(Grant No.12071042)the Beijing Natural Science Foundation(Grant No.1202004)Promoting the Development of University Classification-Student Innovation and Entrepreneurship Training Programme(Grant No.5112410857)。
文摘In this paper,we propose a symmetric difference data enhancement physics-informed neural network(SDE-PINN)to study soliton solutions for discrete nonlinear lattice equations(NLEs).By considering known and unknown symmetric points,numerical simulations are conducted to one-soliton and two-soliton solutions of a discrete KdV equation,as well as a one-soliton solution of a discrete Toda lattice equation.Compared with the existing discrete deep learning approach,the numerical results reveal that within the specified spatiotemporal domain,the prediction accuracy by SDE-PINN is excellent regardless of the interior or extrapolation prediction,with a significant reduction in training time.The proposed data enhancement technique and symmetric structure development provides a new perspective for the deep learning approach to solve discrete NLEs.The newly proposed SDE-PINN can also be applied to solve continuous nonlinear equations and other discrete NLEs numerically.
基金Project supported by the National Natural Science Foundation of China(No.11521091)
文摘A neural network(NN) is a powerful tool for approximating bounded continuous functions in machine learning. The NN provides a framework for numerically solving ordinary differential equations(ODEs) and partial differential equations(PDEs)combined with the automatic differentiation(AD) technique. In this work, we explore the use of NN for the function approximation and propose a universal solver for ODEs and PDEs. The solver is tested for initial value problems and boundary value problems of ODEs, and the results exhibit high accuracy for not only the unknown functions but also their derivatives. The same strategy can be used to construct a PDE solver based on collocation points instead of a mesh, which is tested with the Burgers equation and the heat equation(i.e., the Laplace equation).
基金Project supported by the National Key R&D Program of China(No.2022YFA1004504)the National Natural Science Foundation of China(Nos.12171404 and 12201229)the Fundamental Research Funds for Central Universities of China(No.20720210037)。
文摘We consider solving the forward and inverse partial differential equations(PDEs)which have sharp solutions with physics-informed neural networks(PINNs)in this work.In particular,to better capture the sharpness of the solution,we propose the adaptive sampling methods(ASMs)based on the residual and the gradient of the solution.We first present a residual only-based ASM denoted by ASMⅠ.In this approach,we first train the neural network using a small number of residual points and divide the computational domain into a certain number of sub-domains,then we add new residual points in the sub-domain which has the largest mean absolute value of the residual,and those points which have the largest absolute values of the residual in this sub-domain as new residual points.We further develop a second type of ASM(denoted by ASMⅡ)based on both the residual and the gradient of the solution due to the fact that only the residual may not be able to efficiently capture the sharpness of the solution.The procedure of ASMⅡis almost the same as that of ASMⅠ,and we add new residual points which have not only large residuals but also large gradients.To demonstrate the effectiveness of the present methods,we use both ASMⅠand ASMⅡto solve a number of PDEs,including the Burger equation,the compressible Euler equation,the Poisson equation over an Lshape domain as well as the high-dimensional Poisson equation.It has been shown from the numerical results that the sharp solutions can be well approximated by using either ASMⅠor ASMⅡ,and both methods deliver much more accurate solutions than the original PINNs with the same number of residual points.Moreover,the ASMⅡalgorithm has better performance in terms of accuracy,efficiency,and stability compared with the ASMⅠalgorithm.This means that the gradient of the solution improves the stability and efficiency of the adaptive sampling procedure as well as the accuracy of the solution.Furthermore,we also employ the similar adaptive sampling technique for the data points of boundary conditions(BCs)if the sharpness of the solution is near the boundary.The result of the L-shape Poisson problem indicates that the present method can significantly improve the efficiency,stability,and accuracy.
基金Project supported by the National Natural Science Foundation of China(Nos.10972129 and 11272191)the Specialized Research Foundation for the Doctoral Program of Higher Education(No.200802800015)+1 种基金the Science and Technology Project of High Schools of Shandong Province(No.J15LJ07)the Shandong Provincial Natural Science Foundation(No.ZR2015FL026)
文摘From the analytical dynamics point of view, this paper develops an optimal control framework to synchronize networked multibody systems using the fundamental equation of mechanics. A novel robust control law derived from the framework is then used to achieve complete synchronization of networked identical or non-identical multibody systems formulated with Lagrangian dynamics. A distinctive feature of the developed control strategy is the introduction of network structures into the control requirement. The control law consists of two components, the first describing the architecture of the network and the second denoting an active feedback control strategy. A corresponding stability analysis is performed by the algebraic graph theory. A representative network composed of ten identical or non-identical gyroscopes is used as an illustrative example. Numerical simulation of the systems with three kinds of network structures, including global coupling, nearest-neighbour, and small-world networks, is given to demonstrate effectiveness of the proposed control methodology.
基金The authors gratefully acknowledge the support of the National Natural Science Foundation of China(Grant No.11675054)Shanghai Collaborative Innovation Center of Trustworthy Software for Internet of Things(Grant No.ZF1213)Science and Technology Commission of Shanghai Municipality(Grant No.18dz2271000).
文摘Despite some empirical successes for solving nonlinear evolution equations using deep learning,there are several unresolved issues.First,it could not uncover the dynamical behaviors of some equations where highly nonlinear source terms are included very well.Second,the gradient exploding and vanishing problems often occur for the traditional feedforward neural networks.In this paper,we propose a new architecture that combines the deep residual neural network with some underlying physical laws.Using the sine-Gordon equation as an example,we show that the numerical result is in good agreement with the exact soliton solution.In addition,a lot of numerical experiments show that the model is robust under small perturbations to a certain extent.
文摘In this paper, we give a smoothing neural network algorithm for absolute value equations (AVE). By using smoothing function, we reformulate the AVE as a differentiable unconstrained optimization and we establish a steep descent method to solve it. We prove the stability and the equilibrium state of the neural network to be a solution of the AVE. The numerical tests show the efficient of the proposed algorithm.
文摘Novel distributed parameter neural networks are proposed for solving partial differential equations, and their dynamic performances are studied in Hilbert space. The locally connected neural networks are obtained by separating distributed parameter neural networks. Two simulations are also given. Both theoretical and computed results illustrate that the distributed parameter neural networks are effective and efficient for solving partial differential equation problems.
文摘This research work investigates the use of Artificial Neural Network (ANN) based on models for solving first and second order linear constant coefficient ordinary differential equations with initial conditions. In particular, we employ a feed-forward Multilayer Perceptron Neural Network (MLPNN), but bypass the standard back-propagation algorithm for updating the intrinsic weights. A trial solution of the differential equation is written as a sum of two parts. The first part satisfies the initial or boundary conditions and contains no adjustable parameters. The second part involves a feed-forward neural network to be trained to satisfy the differential equation. Numerous works have appeared in recent times regarding the solution of differential equations using ANN, however majority of these employed a single hidden layer perceptron model, incorporating a back-propagation algorithm for weight updation. For the homogeneous case, we assume a solution in exponential form and compute a polynomial approximation using statistical regression. From here we pick the unknown coefficients as the weights from input layer to hidden layer of the associated neural network trial solution. To get the weights from hidden layer to the output layer, we form algebraic equations incorporating the default sign of the differential equations. We then apply the Gaussian Radial Basis function (GRBF) approximation model to achieve our objective. The weights obtained in this manner need not be adjusted. We proceed to develop a Neural Network algorithm using MathCAD software, which enables us to slightly adjust the intrinsic biases. We compare the convergence and the accuracy of our results with analytic solutions, as well as well-known numerical methods and obtain satisfactory results for our example ODE problems.
基金The project supported by ＂973＂ Project under Grant No.2004CB318000, the Doctor Start-up Foundation of Liaoning Province of China under Grant No. 20041066, and the Science Research Plan of Liaoning Education Bureau under Grant No. 2004F099
文摘The closed form of solutions of Kac-van Moerbeke lattice and self-dual network equations are considered by proposing transformations based on Riccati equation, using symbolic computation. In contrast to the numerical computation of travelling wave solutions for differential difference equations, our method obtains exact solutions which have physical relevance.
基金Supported by the Natural Science Foundation of Zhejiang Province under Grant No.LY15A010005the Natural Science Foundation of Ningbo under Grant No.2018A610197+1 种基金the NSF of China under Grant No.11671219K.C.Wong Magna Fund in Ningbo University
文摘The N-fold Darboux transformation(DT) T_n^([N]) of the nonlinear self-dual network equation is given in terms of the determinant representation. The elements in determinants are composed of the eigenvalues λ_j(j = 1, 2..., N)and the corresponding eigenfunctions of the associated Lax equation. Using this representation, the N-soliton solutions of the nonlinear self-dual network equation are given from the zero "seed" solution by the N-fold DT. A general form of the N-degenerate soliton is constructed from the determinants of N-soliton by a special limit λ_j →λ_1 and by using the higher-order Taylor expansion. For 2-degenerate and 3-degenerate solitons, approximate orbits are given analytically,which provide excellent fit of exact trajectories. These orbits have a time-dependent "phase shift", namely ln(t^2).
基金supported by the Natural Science Foundation of Tianjin(Grant No.16JCYBJC23000)the Open Foundation of the Key Laboratory for Ecological Environment in Coastal Areas of the State Oceanic Administration(Grant No.201604)Science and Technology Foundation for Young Scholars from Tianjin Fisheries Bureau(Grant No.J2014-05)
文摘Bayesian networks （BN） have many advantages over other methods in ecological modeling, and have become an increasingly popular modeling tool. However, BN are flawed in regard to building models based on inadequate existing knowledge. To overcome this limitation, we propose a new method that links BN with structural equation modeling （SEM）. In this method, SEM is used to improve the model structure for BN. This method was used to simulate coastal phytoplankton dynamics in the Bohai Bay. We demonstrate that this hybrid approach minimizes the need for expert elicitation, generates more reasonable structures for BN models, and increases the BN model＇s accuracy and reliability. These results suggest that the inclusion of SEM for testing and verifying the theoretical structure during the initial construction stage improves the effectiveness of BN models, especially for complex eco-environment systems. The results also demonstrate that in the Bohai Bay, while phytoplankton biomass has the greatest influence on phytoplankton dynamics, the impact of nutrients on phytoplankton dynamics is larger than the influence of the physical environment in summer. Furthermore, although the Redfield ratio indicates that phosphorus should be the primary nutrient limiting factor, our results show that silicate plays the most important role in regulating phytoplankton dynamics in the Bohai Bay.
文摘Growth rate of Yarrowia lipolytica NCIM 3589 was observed in a fermentation medium consisting of peptone, yeast extract, sodium chloride. Logistic equation was fitted to the growth data (time vs. biomass concentration) and compared with the prediction given by Artificial Neural Networks (ANN). ANN was found to be superior in describing growth characteristics. A single MATLAB programme is developed to fit the growth data by logistic equation and ANN.
文摘We consider optimal control problems for the flow of gas in a pipe network. The equations of motions are taken to be represented by a semi-linear model derived from the fully nonlinear isothermal Euler gas equations. We formulate an optimal control problem on a given network and introduce a time discretization thereof. We then study the well-posedness of the corresponding time-discrete optimal control problem. In order to further reduce the complexity, we consider an instantaneous control strategy. The main part of the paper is concerned with a non-overlapping domain decomposition of the semi-linear elliptic optimal control problem on the graph into local problems on a small part of the network, ultimately on a single edge.
文摘This paper focuses on a very important point which consists in evaluating experimental data prior to their use for chemical process designs. Hexafluoropropylene P, ρ, T data measured at 11 temperatures from 263 to 362 K and at pressures up to 10 MPa have been examined through a consistency test presented herein and based on the use of a methodology implying both neural networks and Virial equation. Such a methodology appears as very powerful to identify erroneous data and could be conveniently handled for quick checks of databases previously to modeling through classical thermodynamic models and equations of state. As an application to liquid and vapor phase densities of hexafluoropropylene, a more reliable database is provided after removing out layer data.
基金supported by grants from National Natural Science Foundation of China(Nos.61502198,61572226,61472161,61876069)。
文摘Under different conditions,gene regulatory networks(GRNs)of the same gene set could be similar but different.The differential analysis of GRNs under different conditions is important for understanding condition-specific gene regulatory relationships.In a naive approach,existing GRN inference algorithms can be used to separately estimate two GRNs under different conditions and identify the differences between them.However,in this way,the similarities between the pairwise GRNs are not taken into account.Several joint differential analysis algorithms have been proposed recently,which were proved to outperform the naive approach apparently.In this paper,we model the GRNs under different conditions with structural equation models(SEMs)to integrate gene expression data and genetic perturbations,and re-parameterize the pairwise SEMs to form an integrated model that incorporates the differential structure.Then,a Bayesian inference method is used to make joint differential analysis by solving the integrated model.We evaluated the performance of the proposed re-parametrization-based Bayesian differential analysis(ReBDA)algorithm by running simulations on synthetic data with different settings.The performance of the ReBDA algorithm was demonstrated better than another state-of-the-art joint differential analysis algorithm for SEMs ReDNet obviously.In the end,the ReBDA algorithm was applied to make differential analysis on a real human lung gene data set to illustrate its applicability and practicability.
文摘Partial differential equations(PDEs)are important tools for scientific research and are widely used in various fields.However,it is usually very difficult to obtain accurate analytical solutions of PDEs,and numerical methods to solve PDEs are often computationally intensive and very time-consuming.In recent years,Physics Informed Neural Networks(PINNs)have been successfully applied to find numerical solutions of PDEs and have shown great potential.All the while,solitary waves have been of great interest to researchers in the field of nonlinear science.In this paper,we perform numerical simulations of solitary wave solutions of several PDEs using improved PINNs.The improved PINNs not only incorporate constraints on the control equations to ensure the interpretability of the prediction results,which is important for physical field simulations,in addition,an adaptive activation function is introduced.By introducing hyperparameters in the activation function to change the slope of the activation function to avoid the disappearance of the gradient,computing time is saved thereby speeding up training.In this paper,the m Kd V equation,the improved Boussinesq equation,the Caudrey–Dodd–Gibbon–Sawada–Kotera equation and the p-g BKP equation are selected for study,and the errors of the simulation results are analyzed to assess the accuracy of the predicted solitary wave solution.The experimental results show that the improved PINNs are significantly better than the traditional PINNs with shorter training time but more accurate prediction results.The improved PINNs improve the training speed by more than 1.5 times compared with the traditional PINNs,while maintaining the prediction error less than 10~(-2)in this order of magnitude.
基金Project supported in part by the National Natural Science Foundation of China(Grant No.11771259)Shaanxi Provincial Joint Laboratory of Artificial Intelligence(GrantNo.2022JCSYS05)+1 种基金Innovative Team Project of Shaanxi Provincial Department of Education(Grant No.21JP013)Shaanxi Provincial Social Science Fund Annual Project(Grant No.2022D332)。
文摘We propose the meshfree-based physics-informed neural networks for solving the unsteady Oseen equations.Firstly,based on the ideas of meshfree and small sample learning,we only randomly select a small number of spatiotemporal points to train the neural network instead of forming a mesh.Specifically,we optimize the neural network by minimizing the loss function to satisfy the differential operators,initial condition and boundary condition.Then,we prove the convergence of the loss function and the convergence of the neural network.In addition,the feasibility and effectiveness of the method are verified by the results of numerical experiments,and the theoretical derivation is verified by the relative error between the neural network solution and the analytical solution.
基金co-supported by the National Science and Technology Major Project, China (No. J2019-Ⅰ-0010-0010)the Project funded by China Postdoctoral Science Foundation (No. 2021M701692)+3 种基金the Fundamental Research Funds for the Central Universities, China (No. NS2022029)the Postgraduate Research & Practice Innovation Program of NUAA, China (No. xcxjh20220206)the National Natural Science Foundation of China (No. 51976089)Jiangsu Funding Program for Excellent Postdoctoral Talent, China (No. 2022ZB202)。
文摘Intelligent Adaptive Control(AC) has remarkable advantages in the control system design of aero-engine which has strong nonlinearity and uncertainty. Inspired by the Nonlinear Autoregressive Moving Average(NARMA)-L2 adaptive control, a novel Nonlinear State Space Equation(NSSE) based Adaptive neural network Control(NSSE-AC) method is proposed for the turbo-shaft engine control system design. The proposed NSSE model is derived from a special neural network with an extra layer, and the rotor speed of the gas turbine is taken as the main state variable which makes the NSSE model be able to capture the system dynamic better than the NARMA-L2 model. A hybrid Recursive Least-Square and Levenberg-Marquardt(RLS-LM) algorithm is advanced to perform the online learning of the neural network, which further enhances both the accuracy of the NSSE model and the performance of the adaptive controller. The feedback correction is also utilized in the NSSE-AC system to eliminate the steady-state tracking error. Simulation results show that, compared with the NARMA-L2 model, the NSSE model of the turboshaft engine is more accurate. The maximum modeling error is decreased from 5.92% to 0.97%when the LM algorithm is introduced to optimize the neural network parameters. The NSSE-AC method can not only achieve a better main control loop performance than the traditional controller but also limit all the constraint parameters efficiently with quick and accurate switching responses even if component degradation exists. Thus, the effectiveness of the NSSE-AC method is validated.
基金supported by the National Natural Science Foundation of China under grant Nos.12371250 and 12205154Jiangsu Provincial Natural Science Foundation under grant Nos.BK20221508 and BK20210380Jiangsu Qinglan High-level Talent Project and High-level Personnel Project under grant No.JSSCBS20210277.
文摘Fusion and fission are two important phenomena that have been experimentally observed in many real physical models.In this paper,we investigate the two phenomena in the(2+1)-dimensional Hirota-Satsuma-Ito equation via the physics-informed neural networks(PINN)method.By choosing suitable physically constrained initial boundary conditions,the data-driven fusion and fission solutions are obtained for the first time.Dynamical behaviors and error analysis of these solutions are investigated via illustratively numerical figures,which show that good results are achieved.It is pointed out that the PINN method adopted here can be effectively used to construct the data-driven fusion and fission solutions for other nonlinear integrable equations.Based on the powerful predictive capability of the PINN method and wide applications of fusion and fission in many physical areas,it is hoped that the data-driven solutions obtained here will be helpful for experts to predict or explain related physical phenomena.
