The bistratified lobula giant type 1(BLG1) neuron is an identified looming-sensitive neuron in crab's visual brain that demonstrates special sensitivity to diving targets, or descending approaching motions. In thi...The bistratified lobula giant type 1(BLG1) neuron is an identified looming-sensitive neuron in crab's visual brain that demonstrates special sensitivity to diving targets, or descending approaching motions. In this paper, a novel neural model is proposed to shape such unique selectivity through incorporating a bio-plausible feedforward contrast inhibition synapse and a radially extending spatial enhancement distribution. Herein the synaptic connections and neuronal functions of this model are placed within a framework for matching and describing underlying biological findings. The systematic and comparative experiments have validated the proposed computational model that reconciles with the characteristics of BLG1 neurons in crab.展开更多
This paper illustrates the benefits of a self-tuning PID strategy applied to a proton exchange membrane fuel cell system. Controller parameters are updated on-line, at each sampling time, based on an instantaneous lin...This paper illustrates the benefits of a self-tuning PID strategy applied to a proton exchange membrane fuel cell system. Controller parameters are updated on-line, at each sampling time, based on an instantaneous linearization of an artificial neural network model of the process and a General Minimum Variance control law. The self-tuning PID scheme allows managing nonlinear behaviors of the system while avoiding heavy computations. The applicability, efficiency and robustness of the proposed control strategy are experimentally confirmed using varying control scenarios. In this aim, the original built-in controller is overridden and the self-tuning PID controller is implemented externally and executed on-line. Experimental results show good performance in setpoint tracking accuracy and robustness against plant/model mismatch. The proposed strategy appears to be a promising alternative to heavy computation nonlinear control strategies and not optimal linear control strategies.展开更多
An adaptive control scheme is presented for systems with unknown hysteresis. In order to handle the case where the hysteresis output is unmeasurale, a novel model is firstly developed to describe the characteristic of...An adaptive control scheme is presented for systems with unknown hysteresis. In order to handle the case where the hysteresis output is unmeasurale, a novel model is firstly developed to describe the characteristic of hysteresis. This model is motivated by Preisach model but implemented by using neural networks ( NN) . The main advantage is that it is easily used for controller design. Then, the adaptive controller based on the proposed model is presented for a class of SISO nonlinear systems preceded by unknown hysteresis, which is estimated by the proposed model. The laws for model updating and the control laws for the neural adaptive controller are derived from Lyapunov stability theorem, therefore the semiglobal stability of the closed-loop system is guaranteed. At last, the simulation results are illustrated.展开更多
The objective of this paper is to develop a variable learning rate for neural modeling of multivariable nonlinear stochastic system. The corresponding parameter is obtained by gradient descent method optimization. The...The objective of this paper is to develop a variable learning rate for neural modeling of multivariable nonlinear stochastic system. The corresponding parameter is obtained by gradient descent method optimization. The effectiveness of the suggested algorithm applied to the identification of behavior of two nonlinear stochastic systems is demonstrated by simulation experiments.展开更多
Dear Editor,Aiming at the consensus tracking problem of a class of unknown heterogeneous nonlinear multiagent systems(MASs)with input constraints,a novel data-driven iterative learning consensus control(ILCC)protocol ...Dear Editor,Aiming at the consensus tracking problem of a class of unknown heterogeneous nonlinear multiagent systems(MASs)with input constraints,a novel data-driven iterative learning consensus control(ILCC)protocol based on zeroing neural networks(ZNNs)is proposed.First,a dynamic linearization data model(DLDM)is acquired via dynamic linearization technology(DLT).展开更多
In recent years,discrete neuron and discrete neural network models have played an important role in the development of neural dynamics.This paper reviews the theoretical advantages of well-known discrete neuron models...In recent years,discrete neuron and discrete neural network models have played an important role in the development of neural dynamics.This paper reviews the theoretical advantages of well-known discrete neuron models,some existing discretized continuous neuron models,and discrete neural networks in simulating complex neural dynamics.It places particular emphasis on the importance of memristors in the composition of neural networks,especially their unique memory and nonlinear characteristics.The integration of memristors into discrete neural networks,including Hopfield networks and their fractional-order variants,cellular neural networks and discrete neuron models has enabled the study and construction of various neural models with memory.These models exhibit complex dynamic behaviors,including superchaotic attractors,hidden attractors,multistability,and synchronization transitions.Furthermore,the present paper undertakes an analysis of more complex dynamical properties,including synchronization,speckle patterns,and chimera states in discrete coupled neural networks.This research provides new theoretical foundations and potential applications in the fields of brain-inspired computing,artificial intelligence,image encryption,and biological modeling.展开更多
Time series analysis plays an important role in hydrologic forecasting,while the key to this analysis is to establish a proper model.This paper presents a time series neural network model with back propagation proced...Time series analysis plays an important role in hydrologic forecasting,while the key to this analysis is to establish a proper model.This paper presents a time series neural network model with back propagation procedure for hydrologic forecasting.Free from the disadvantages of previous models,the model can be parallel to operate information flexibly and rapidly.It excels in the ability of nonlinear mapping and can learn and adjust by itself,which gives the model a possibility to describe the complex nonlinear hydrologic process.By using directly a training process based on a set of previous data, the model can forecast the time series of stream flow.Moreover,two practical examples were used to test the performance of the time series neural network model.Results confirm that the model is efficient and feasible.展开更多
The data-driven machine learning paradigm typically requires high-quality,large-scale datasets for training neural networks,which are often unavailable in many scientific and engineering applications.Integrating physi...The data-driven machine learning paradigm typically requires high-quality,large-scale datasets for training neural networks,which are often unavailable in many scientific and engineering applications.Integrating physics equations into machine learning models,either fully or partially,can mitigate these data requirements and improve generalizability;however,such approaches frequently rely on differentiable programming frameworks.This ability poses significant challenges when legacy or commercial numerical solvers,which are often nondifferentiable and difficult to modify without introducing code changes,are integrated.This work addresses these challenges by leveraging the mini-batching iterative ensemble Kalman inversion(EKI)algorithm as a gradientfree training framework for hybrid neural models.The use of stochastic mini-batching significantly enhances the computational efficiency and convergence of EKI,making it well-suited for high-dimensional learning problems.The proposed method is demonstrated for modeling a fiber-reinforced composite plate,where heterogeneous local constitutive laws are parameterized by a trainable neural network embedded within the FEniCS finite element solver.Using the displacement field as indirect data,the hybrid neural FEM solver successfully predicts deformations by learning the local constitutive laws,even for unseen fiber volume fraction distributions and varying test loading conditions.These results demonstrate the effectiveness of iterative EKI in training hybrid neural models with non-differentiable components,paving the way for broader adoption of hybrid neural models in scientific and engineering applications.展开更多
The Heihe River drainage basin is one of the endangered ecological regions of China. The shortage of water resources is the bottleneck, which constrains the sustainable development of the region. Many scholars in Chin...The Heihe River drainage basin is one of the endangered ecological regions of China. The shortage of water resources is the bottleneck, which constrains the sustainable development of the region. Many scholars in China have done researches concerning this problem. Based on previous researches, this paper analyzed characteristics, tendencies, and causes of annual runoff variations in the Yingluo Gorge (1944-2005) and the Zhengyi Gorge (1954-2005), which are the boundaries of the upper reaches, the middle reaches, and the lower reaches of the Heihe River drainage basin, by wavelet analysis, wavelet neural network model, and GIS spatial analysis. The results show that: (1) annual runoff variations of the Yingluo Gorge have principal periods of 7 years and 25 years, and its increasing rate is 1.04 m^3/s.10y; (2) annual runoff variations of the Zhengyi Gorge have principal periods of 6 years and 27 years, and its decreasing rate is 2.25 m^3/s.10y; (3) prediction results show that: during 2006-2015, annual runoff variations of the Yingluo and Zhengyi gorges have ascending tendencies, and the increasing rates are respectively 2.04 m^3/s.10y and 1.61 m^3/s.10y; (4) the increase of annual runoff in the Yingluo Gorge has causal relationship with increased temperature and precipitation in the upper reaches, and the decrease of annual runoff in the Zhengyi Gorge in the past decades was mainly caused by the increased human consumption of water resources in the middle researches. The study results will provide scientific basis for making rational use and allocation schemes of water resources in the Heihe River drainage basin.展开更多
Bayesian regularized BP neural network(BRBPNN) technique was applied in the chlorophyll-α prediction of Nanzui water area in Dongting Lake. Through BP network interpolation method, the input and output samples of t...Bayesian regularized BP neural network(BRBPNN) technique was applied in the chlorophyll-α prediction of Nanzui water area in Dongting Lake. Through BP network interpolation method, the input and output samples of the network were obtained. After the selection of input variables using stepwise/multiple linear regression method in SPSS i1.0 software, the BRBPNN model was established between chlorophyll-α and environmental parameters, biological parameters. The achieved optimal network structure was 3-11-1 with the correlation coefficients and the mean square errors for the training set and the test set as 0.999 and 0.000?8426, 0.981 and 0.0216 respectively. The sum of square weights between each input neuron and the hidden layer of optimal BRBPNN models of different structures indicated that the effect of individual input parameter on chlorophyll- α declined in the order of alga amount 〉 secchi disc depth(SD) 〉 electrical conductivity (EC). Additionally, it also demonstrated that the contributions of these three factors were the maximal for the change of chlorophyll-α concentration, total phosphorus(TP) and total nitrogen(TN) were the minimal. All the results showed that BRBPNN model was capable of automated regularization parameter selection and thus it may ensure the excellent generation ability and robustness. Thus, this study laid the foundation for the application of BRBPNN model in the analysis of aquatic ecological data(chlorophyll-α prediction) and the explanation about the effective eutrophication treatment measures for Nanzui water area in Dongting Lake.展开更多
Epilepsy is believed to be caused by a lack of balance between excitation and inhibitation in the brain. A promising strategy for the control of the disease is closed-loop brain stimulation. How to determine the stimu...Epilepsy is believed to be caused by a lack of balance between excitation and inhibitation in the brain. A promising strategy for the control of the disease is closed-loop brain stimulation. How to determine the stimulation control parameters for effective and safe treatment protocols remains, however, an unsolved question. To constrain the complex dynamics of the biological brain, we use a neural population model(NPM). We propose that a proportional-derivative(PD) type closed-loop control can successfully suppress epileptiform activities. First, we determine the stability of root loci, which reveals that the dynamical mechanism underlying epilepsy in the NPM is the loss of homeostatic control caused by the lack of balance between excitation and inhibition. Then, we design a PD type closed-loop controller to stabilize the unstable NPM such that the homeostatic equilibriums are maintained; we show that epileptiform activities are successfully suppressed. A graphical approach is employed to determine the stabilizing region of the PD controller in the parameter space, providing a theoretical guideline for the selection of the PD control parameters. Furthermore, we establish the relationship between the control parameters and the model parameters in the form of stabilizing regions to help understand the mechanism of suppressing epileptiform activities in the NPM. Simulations show that the PD-type closed-loop control strategy can effectively suppress epileptiform activities in the NPM.展开更多
Background: Leaf Area Index(LAI) is an important parameter used in monitoring and modeling of forest ecosystems. The aim of this study was to evaluate performance of the artificial neural network(ANN) models to predic...Background: Leaf Area Index(LAI) is an important parameter used in monitoring and modeling of forest ecosystems. The aim of this study was to evaluate performance of the artificial neural network(ANN) models to predict the LAI by comparing the regression analysis models as the classical method in these pure and even-aged Crimean pine forest stands.Methods: One hundred eight temporary sample plots were collected from Crimean pine forest stands to estimate stand parameters. Each sample plot was imaged with hemispherical photographs to detect the LAI. The partial correlation analysis was used to assess the relationships between the stand LAI values and stand parameters, and the multivariate linear regression analysis was used to predict the LAI from stand parameters. Different artificial neural network models comprising different number of neuron and transfer functions were trained and used to predict the LAI of forest stands.Results: The correlation coefficients between LAI and stand parameters(stand number of trees, basal area, the quadratic mean diameter, stand density and stand age) were significant at the level of 0.01. The stand age, number of trees, site index, and basal area were independent parameters in the most successful regression model predicted LAI values using stand parameters(R_(adj)~2=0.5431). As corresponding method to predict the interactions between the stand LAI values and stand parameters, the neural network architecture based on the RBF 4-19-1 with Gaussian activation function in hidden layer and the identity activation function in output layer performed better in predicting LAI(SSE(12.1040), MSE(0.1223), RMSE(0.3497), AIC(0.1040), BIC(-77.7310) and R^2(0.6392)) compared to the other studied techniques.Conclusion: The ANN outperformed the multivariate regression techniques in predicting LAI from stand parameters. The ANN models, developed in this study, may aid in making forest management planning in study forest stands.展开更多
In this research, a method called ANNMG is presented to integrate Artificial Neural Networks and Geostatistics for optimum mineral reserve evaluation. The word ANNMG simply means Artificial Neural Network Model integr...In this research, a method called ANNMG is presented to integrate Artificial Neural Networks and Geostatistics for optimum mineral reserve evaluation. The word ANNMG simply means Artificial Neural Network Model integrated with Geostatiscs, In this procedure, the Artificial Neural Network was trained, tested and validated using assay values obtained from exploratory drillholes. Next, the validated model was used to generalize mineral grades at known and unknown sampled locations inside the drilling region respectively. Finally, the reproduced and generalized assay values were combined and fed to geostatistics in order to develop a geological 3D block model. The regression analysis revealed that the predicted sample grades were in close proximity to the actual sample grades, The generalized grades from the ANNMG show that this process could be used to complement exploration activities thereby reducing drilling requirement. It could also be an effective mineral reserve evaluation method that could oroduce optimum block model for mine design.展开更多
Warm rotary draw bending provides a feasible method to form the large-diameter thin-walled(LDTW)TC4 bent tubes, which are widely used in the pneumatic system of aircrafts. An accurate prediction of flow behavior of ...Warm rotary draw bending provides a feasible method to form the large-diameter thin-walled(LDTW)TC4 bent tubes, which are widely used in the pneumatic system of aircrafts. An accurate prediction of flow behavior of TC4 tubes considering the couple effects of temperature,strain rate and strain is critical for understanding the deformation behavior of metals and optimizing the processing parameters in warm rotary draw bending of TC4 tubes. In this study, isothermal compression tests of TC4 tube alloy were performed from 573 to 873 K with an interval of 100 K and strain rates of 0.001, 0.010 and0.100 s^(-1). The prediction of flow behavior was done using two constitutive models, namely modified Arrhenius model and artificial neural network(ANN) model. The predictions of these constitutive models were compared using statistical measures like correlation coefficient(R), average absolute relative error(AARE) and its variation with the deformation parameters(temperature, strain rate and strain). Analysis of statistical measures reveals that the two models show high predicted accuracy in terms of R and AARE. Comparatively speaking, the ANN model presents higher predicted accuracy than the modified Arrhenius model. In addition, the predicted accuracy of ANN model presents high stability at the whole deformation parameter ranges, whereas the predictability of the modified Arrhenius model has some fluctuation at different deformation conditions. It presents higher predicted accuracy at temperatures of 573-773 K, strain rates of 0.010-0.100 s^(-1)and strain of 0.04-0.32, while low accuracy at temperature of 873 K, strain rates of 0.001 s^(-1)and strain of 0.36-0.48.Thus, the application of modified Arrhenius model is limited by its relatively low predicted accuracy at some deformation conditions, while the ANN model presents very high predicted accuracy at all deformation conditions,which can be used to study the compression behavior of TC4 tube at the temperature range of 573-873 K and the strain rate of 0.001-0.100 s^(-1). It can provide guideline for the design of processing parameters in warm rotary draw bending of LDTW TC4 tubes.展开更多
Titanium dioxide (TiO2) nanoparticles were prepared by sol gel route. The preparation parameters were optimized in the removal of 4-nitropbenol (4-NP). All catalysts were analyzed by X-ray diffraction (XRD) and ...Titanium dioxide (TiO2) nanoparticles were prepared by sol gel route. The preparation parameters were optimized in the removal of 4-nitropbenol (4-NP). All catalysts were analyzed by X-ray diffraction (XRD) and scanning electron microscopy (SEM). An artificial neural network model (ANN) was developed to predict the photocatalytic removal of 4-NP in the presence of TiOz nanoparticles prepared under desired conditions. The comparison between the predicted results by designed ANN model and the experimental data proved that modeling of the removal process of 4-NP using artificial neural network was a precise method to predict the extent of 4-NP removal under different conditions.展开更多
The aim of the research was to create a prediction model for winter rapeseed yield.The constructed model enabled to perform simulation on 30 June,in the current year,immediately before harvesting.An artificial neural ...The aim of the research was to create a prediction model for winter rapeseed yield.The constructed model enabled to perform simulation on 30 June,in the current year,immediately before harvesting.An artificial neural network with multilayer perceptron(MLP) topology was used to build the predictive model.The model was created on the basis of meteorological data(air temperature and atmospheric precipitation) and mineral fertilization data.The data were collected in the period 2008–2017 from 291 productive fields located in Poland,in the southern part of the Opole region.The assessment of the forecast quality created on the basis of the neural model has been verified by defining forecast errors using relative approximation error(RAE),root mean square error(RMS),mean absolute error(MAE),and mean absolute percentage error(MAPE) metrics.An important feature of the created predictive model is the ability to forecast the current agrotechnical year based on current weather and fertilizing data.The lowest value of the MAPE error was obtained for a neural network model based on the MLP network of 21:21-13-6-1:1 structure,which was 9.43%.The performed sensitivity analysis of the network examined the factors that have the greatest impact on the yield of winter rape.The highest rank 1 was obtained by an independent variable with the average air temperature from 1 January to 15 April of 2017(designation by the T1-4_CY model).展开更多
In order to improve the accuracy of model for terminative temperature in steelmaking, it is necessary to predict and control before decarburization. Thus, an optimization neural network model of terminative temperatur...In order to improve the accuracy of model for terminative temperature in steelmaking, it is necessary to predict and control before decarburization. Thus, an optimization neural network model of terminative temperature in the process of dephosphorization by laying correlative degree weights to all input factors related was used. Then sim- ulation experiment of model newly established is conducted utilizing 210 data from a domestic steel plant. The results show that hit rate arrives at 56.45~~ when error is within plus or minus 5%, and the value is 100% when within ~10%. Comparing to the traditional neural network prediction model, the accuracy almost increases by 6. 839o//oo. Thus, the simulation prediction fits the real perfectly, which accounts for that neural network model for terminative tempera- ture based on grey theory can reflect accurately the practice in dephosphorization. Naturally, this method is effective and nraeticahle.展开更多
Spontaneous alpha oscillations are a ubiquitous phenomenon in the brain and play a key role in neural information processing and various cognitive functions.Jansen's neural mass model(NMM) was initially proposed to...Spontaneous alpha oscillations are a ubiquitous phenomenon in the brain and play a key role in neural information processing and various cognitive functions.Jansen's neural mass model(NMM) was initially proposed to study the origin of alpha oscillations.Most of previous studies of the spontaneous alpha oscillations in the NMM were conducted using numerical methods.In this study,we aim to propose an analytical approach using the describing function method to elucidate the spontaneous alpha oscillation mechanism in the NMM.First,the sigmoid nonlinear function in the NMM is approximated by its describing function,allowing us to reformulate the NMM and derive its standard form composed of one nonlinear part and one linear part.Second,by conducting a theoretical analysis,we can assess whether or not the spontaneous alpha oscillation would occur in the NMM and,furthermore,accurately determine its amplitude and frequency.The results reveal analytically that the interaction between linearity and nonlinearity of the NMM plays a key role in generating the spontaneous alpha oscillations.Furthermore,strong nonlinearity and large linear strength are required to generate the spontaneous alpha oscillations.展开更多
The developments of modern mathematics and computer science make artificial neural networks become most useful tools in wide range of fields. Modeling methods of artificial neural networks are described in this paper...The developments of modern mathematics and computer science make artificial neural networks become most useful tools in wide range of fields. Modeling methods of artificial neural networks are described in this paper. The programming technique by using Matlab neural networks toolbox is discussed. The application in Material Hot Working of neural networks is also introduced.展开更多
In the context of global warming,precipitation forms are likely to transform from snowfall to rainfall with a more pronounced trend.The change in precipitation forms will inevitably affect the processes of regional ru...In the context of global warming,precipitation forms are likely to transform from snowfall to rainfall with a more pronounced trend.The change in precipitation forms will inevitably affect the processes of regional runoff generation and confluence as well as the annual distribution of runoff.Most researchers used precipitation data from the CMIP5 model directly to study future precipitation trends without distinguishing between snowfall and rainfall.CMIP5 models have been proven to have better performance in simulating temperature but poorer performance in simulating precipitation.To overcome the above limitations,this paper used a Back Propagation Neural Network(BNN)to predict the rainfall-to-precipitation ratio(RPR)in months experiencing freezing-thawing transitions(FTTs).We utilized the meteorological(air pressure,air temperature,evaporation,relative humidity,wind speed,sunshine hours,surface temperature),topographic(altitude,slope,aspect)and geographic(longitude,latitude)data from 28 meteorological stations in the Chinese Tianshan Mountains region(CTMR)from 1961 to 2018 to calculate the RPR and constructed an index system of impact factors.Based on the BNN,decision-making trial and evaluation laboratory method(BP-DEMATEL),the key factors driving the transformation of the RPR in the CTMR were identified.We found that temperature was the only key factor affecting the transformation of the RPR in the BP-DEMATEL model.Considering the relationship between temperature and the RPR,the future temperature under different representative concentration pathways(RCPs)(RCP2.6/RCP4.5/RCP8.5)provided by 21 CMIP5 models and the meteorological factors from meteorological stations were input into the BNN model to acquire the future RPR from 2011 to 2100.The results showed that under the three scenarios,the RPR in the number of months experiencing FTTs during 2011-2100 will be higher than that in the historical period(1981-2010)in the CTMR.Furthermore,in terms of spatial variation,the RPR values on the south slope will be larger than those on the north slope under the three emission scenarios.Moreover,the RPR values exhibited different variation characteristics under different emission scenarios.Under the low-emission scenario(RCP2.6),as time passed,the RPR values changed slightly at more stations.Under the mediumemission scenario(RCP4.5),the RPR increased in the whole CTMR and stabilized on the north slope by the end of this century.Under the high-emission scenario(RCP8.5),the RPR values increased significantly through the 21 st century in the whole CTMR.This study may help to provide a scientific management basis for agricultural production and hydrology.展开更多
基金supported by the National Natural Science Foundation of China (No.12031003)the European Union's Horizon 2020 Research and Innovation Programme under the Marie Sklodowska-Curie Grant Agreement (No.778062 ULTRACEPT)。
文摘The bistratified lobula giant type 1(BLG1) neuron is an identified looming-sensitive neuron in crab's visual brain that demonstrates special sensitivity to diving targets, or descending approaching motions. In this paper, a novel neural model is proposed to shape such unique selectivity through incorporating a bio-plausible feedforward contrast inhibition synapse and a radially extending spatial enhancement distribution. Herein the synaptic connections and neuronal functions of this model are placed within a framework for matching and describing underlying biological findings. The systematic and comparative experiments have validated the proposed computational model that reconciles with the characteristics of BLG1 neurons in crab.
文摘This paper illustrates the benefits of a self-tuning PID strategy applied to a proton exchange membrane fuel cell system. Controller parameters are updated on-line, at each sampling time, based on an instantaneous linearization of an artificial neural network model of the process and a General Minimum Variance control law. The self-tuning PID scheme allows managing nonlinear behaviors of the system while avoiding heavy computations. The applicability, efficiency and robustness of the proposed control strategy are experimentally confirmed using varying control scenarios. In this aim, the original built-in controller is overridden and the self-tuning PID controller is implemented externally and executed on-line. Experimental results show good performance in setpoint tracking accuracy and robustness against plant/model mismatch. The proposed strategy appears to be a promising alternative to heavy computation nonlinear control strategies and not optimal linear control strategies.
基金This work was partially supported by National Science Foundation of China(No.50265001)Guangxi Science Foundation(No.0339068).
文摘An adaptive control scheme is presented for systems with unknown hysteresis. In order to handle the case where the hysteresis output is unmeasurale, a novel model is firstly developed to describe the characteristic of hysteresis. This model is motivated by Preisach model but implemented by using neural networks ( NN) . The main advantage is that it is easily used for controller design. Then, the adaptive controller based on the proposed model is presented for a class of SISO nonlinear systems preceded by unknown hysteresis, which is estimated by the proposed model. The laws for model updating and the control laws for the neural adaptive controller are derived from Lyapunov stability theorem, therefore the semiglobal stability of the closed-loop system is guaranteed. At last, the simulation results are illustrated.
文摘The objective of this paper is to develop a variable learning rate for neural modeling of multivariable nonlinear stochastic system. The corresponding parameter is obtained by gradient descent method optimization. The effectiveness of the suggested algorithm applied to the identification of behavior of two nonlinear stochastic systems is demonstrated by simulation experiments.
基金supported by the National Nature Science Foundation of China(U21A20166)the Science and Technology Development Foundation of Jilin Province(20230508095RC)+2 种基金the Major Science and Technology Projects of Jilin Province and Changchun City(20220301033GX)the Development and Reform Commission Foundation of Jilin Province(2023C034-3)the Interdisciplinary Integration and Innovation Project of JLU(JLUXKJC2020202).
文摘Dear Editor,Aiming at the consensus tracking problem of a class of unknown heterogeneous nonlinear multiagent systems(MASs)with input constraints,a novel data-driven iterative learning consensus control(ILCC)protocol based on zeroing neural networks(ZNNs)is proposed.First,a dynamic linearization data model(DLDM)is acquired via dynamic linearization technology(DLT).
基金supported by the Natural Science Foundation of Hunan Province(Grant No.2025JJ50368)the Scientific Research Fund of Hunan Provincial Education Department(Grant No.24A0248)the Guiding Science and Technology Plan Project of Changsha City(Grant No.kzd2501129)。
文摘In recent years,discrete neuron and discrete neural network models have played an important role in the development of neural dynamics.This paper reviews the theoretical advantages of well-known discrete neuron models,some existing discretized continuous neuron models,and discrete neural networks in simulating complex neural dynamics.It places particular emphasis on the importance of memristors in the composition of neural networks,especially their unique memory and nonlinear characteristics.The integration of memristors into discrete neural networks,including Hopfield networks and their fractional-order variants,cellular neural networks and discrete neuron models has enabled the study and construction of various neural models with memory.These models exhibit complex dynamic behaviors,including superchaotic attractors,hidden attractors,multistability,and synchronization transitions.Furthermore,the present paper undertakes an analysis of more complex dynamical properties,including synchronization,speckle patterns,and chimera states in discrete coupled neural networks.This research provides new theoretical foundations and potential applications in the fields of brain-inspired computing,artificial intelligence,image encryption,and biological modeling.
文摘Time series analysis plays an important role in hydrologic forecasting,while the key to this analysis is to establish a proper model.This paper presents a time series neural network model with back propagation procedure for hydrologic forecasting.Free from the disadvantages of previous models,the model can be parallel to operate information flexibly and rapidly.It excels in the ability of nonlinear mapping and can learn and adjust by itself,which gives the model a possibility to describe the complex nonlinear hydrologic process.By using directly a training process based on a set of previous data, the model can forecast the time series of stream flow.Moreover,two practical examples were used to test the performance of the time series neural network model.Results confirm that the model is efficient and feasible.
基金supported by the Air Force Office of Scientific Research(AFOSR),United States of America(Grant No.FA9550-22-1-0065).
文摘The data-driven machine learning paradigm typically requires high-quality,large-scale datasets for training neural networks,which are often unavailable in many scientific and engineering applications.Integrating physics equations into machine learning models,either fully or partially,can mitigate these data requirements and improve generalizability;however,such approaches frequently rely on differentiable programming frameworks.This ability poses significant challenges when legacy or commercial numerical solvers,which are often nondifferentiable and difficult to modify without introducing code changes,are integrated.This work addresses these challenges by leveraging the mini-batching iterative ensemble Kalman inversion(EKI)algorithm as a gradientfree training framework for hybrid neural models.The use of stochastic mini-batching significantly enhances the computational efficiency and convergence of EKI,making it well-suited for high-dimensional learning problems.The proposed method is demonstrated for modeling a fiber-reinforced composite plate,where heterogeneous local constitutive laws are parameterized by a trainable neural network embedded within the FEniCS finite element solver.Using the displacement field as indirect data,the hybrid neural FEM solver successfully predicts deformations by learning the local constitutive laws,even for unseen fiber volume fraction distributions and varying test loading conditions.These results demonstrate the effectiveness of iterative EKI in training hybrid neural models with non-differentiable components,paving the way for broader adoption of hybrid neural models in scientific and engineering applications.
基金National Natural Science Foundation of China, No.40335046
文摘The Heihe River drainage basin is one of the endangered ecological regions of China. The shortage of water resources is the bottleneck, which constrains the sustainable development of the region. Many scholars in China have done researches concerning this problem. Based on previous researches, this paper analyzed characteristics, tendencies, and causes of annual runoff variations in the Yingluo Gorge (1944-2005) and the Zhengyi Gorge (1954-2005), which are the boundaries of the upper reaches, the middle reaches, and the lower reaches of the Heihe River drainage basin, by wavelet analysis, wavelet neural network model, and GIS spatial analysis. The results show that: (1) annual runoff variations of the Yingluo Gorge have principal periods of 7 years and 25 years, and its increasing rate is 1.04 m^3/s.10y; (2) annual runoff variations of the Zhengyi Gorge have principal periods of 6 years and 27 years, and its decreasing rate is 2.25 m^3/s.10y; (3) prediction results show that: during 2006-2015, annual runoff variations of the Yingluo and Zhengyi gorges have ascending tendencies, and the increasing rates are respectively 2.04 m^3/s.10y and 1.61 m^3/s.10y; (4) the increase of annual runoff in the Yingluo Gorge has causal relationship with increased temperature and precipitation in the upper reaches, and the decrease of annual runoff in the Zhengyi Gorge in the past decades was mainly caused by the increased human consumption of water resources in the middle researches. The study results will provide scientific basis for making rational use and allocation schemes of water resources in the Heihe River drainage basin.
文摘Bayesian regularized BP neural network(BRBPNN) technique was applied in the chlorophyll-α prediction of Nanzui water area in Dongting Lake. Through BP network interpolation method, the input and output samples of the network were obtained. After the selection of input variables using stepwise/multiple linear regression method in SPSS i1.0 software, the BRBPNN model was established between chlorophyll-α and environmental parameters, biological parameters. The achieved optimal network structure was 3-11-1 with the correlation coefficients and the mean square errors for the training set and the test set as 0.999 and 0.000?8426, 0.981 and 0.0216 respectively. The sum of square weights between each input neuron and the hidden layer of optimal BRBPNN models of different structures indicated that the effect of individual input parameter on chlorophyll- α declined in the order of alga amount 〉 secchi disc depth(SD) 〉 electrical conductivity (EC). Additionally, it also demonstrated that the contributions of these three factors were the maximal for the change of chlorophyll-α concentration, total phosphorus(TP) and total nitrogen(TN) were the minimal. All the results showed that BRBPNN model was capable of automated regularization parameter selection and thus it may ensure the excellent generation ability and robustness. Thus, this study laid the foundation for the application of BRBPNN model in the analysis of aquatic ecological data(chlorophyll-α prediction) and the explanation about the effective eutrophication treatment measures for Nanzui water area in Dongting Lake.
基金supported by the National Natural Science Foundation of China(Grant Nos.61473208,61025019,and 91132722)ONR MURI N000141010278NIH grant R01EY016281
文摘Epilepsy is believed to be caused by a lack of balance between excitation and inhibitation in the brain. A promising strategy for the control of the disease is closed-loop brain stimulation. How to determine the stimulation control parameters for effective and safe treatment protocols remains, however, an unsolved question. To constrain the complex dynamics of the biological brain, we use a neural population model(NPM). We propose that a proportional-derivative(PD) type closed-loop control can successfully suppress epileptiform activities. First, we determine the stability of root loci, which reveals that the dynamical mechanism underlying epilepsy in the NPM is the loss of homeostatic control caused by the lack of balance between excitation and inhibition. Then, we design a PD type closed-loop controller to stabilize the unstable NPM such that the homeostatic equilibriums are maintained; we show that epileptiform activities are successfully suppressed. A graphical approach is employed to determine the stabilizing region of the PD controller in the parameter space, providing a theoretical guideline for the selection of the PD control parameters. Furthermore, we establish the relationship between the control parameters and the model parameters in the form of stabilizing regions to help understand the mechanism of suppressing epileptiform activities in the NPM. Simulations show that the PD-type closed-loop control strategy can effectively suppress epileptiform activities in the NPM.
基金Funding from The Scientific and Technological Research Council of Turkey(Project No:2130026)is gratefully acknowledged
文摘Background: Leaf Area Index(LAI) is an important parameter used in monitoring and modeling of forest ecosystems. The aim of this study was to evaluate performance of the artificial neural network(ANN) models to predict the LAI by comparing the regression analysis models as the classical method in these pure and even-aged Crimean pine forest stands.Methods: One hundred eight temporary sample plots were collected from Crimean pine forest stands to estimate stand parameters. Each sample plot was imaged with hemispherical photographs to detect the LAI. The partial correlation analysis was used to assess the relationships between the stand LAI values and stand parameters, and the multivariate linear regression analysis was used to predict the LAI from stand parameters. Different artificial neural network models comprising different number of neuron and transfer functions were trained and used to predict the LAI of forest stands.Results: The correlation coefficients between LAI and stand parameters(stand number of trees, basal area, the quadratic mean diameter, stand density and stand age) were significant at the level of 0.01. The stand age, number of trees, site index, and basal area were independent parameters in the most successful regression model predicted LAI values using stand parameters(R_(adj)~2=0.5431). As corresponding method to predict the interactions between the stand LAI values and stand parameters, the neural network architecture based on the RBF 4-19-1 with Gaussian activation function in hidden layer and the identity activation function in output layer performed better in predicting LAI(SSE(12.1040), MSE(0.1223), RMSE(0.3497), AIC(0.1040), BIC(-77.7310) and R^2(0.6392)) compared to the other studied techniques.Conclusion: The ANN outperformed the multivariate regression techniques in predicting LAI from stand parameters. The ANN models, developed in this study, may aid in making forest management planning in study forest stands.
基金the management of Sierra Rutile Company for providing the drillhole dataset used in this studythe Japanese Ministry of Education Science and Technology (MEXT) Scholarship for academic funding
文摘In this research, a method called ANNMG is presented to integrate Artificial Neural Networks and Geostatistics for optimum mineral reserve evaluation. The word ANNMG simply means Artificial Neural Network Model integrated with Geostatiscs, In this procedure, the Artificial Neural Network was trained, tested and validated using assay values obtained from exploratory drillholes. Next, the validated model was used to generalize mineral grades at known and unknown sampled locations inside the drilling region respectively. Finally, the reproduced and generalized assay values were combined and fed to geostatistics in order to develop a geological 3D block model. The regression analysis revealed that the predicted sample grades were in close proximity to the actual sample grades, The generalized grades from the ANNMG show that this process could be used to complement exploration activities thereby reducing drilling requirement. It could also be an effective mineral reserve evaluation method that could oroduce optimum block model for mine design.
基金financially supported by the National Natural Science Foundation of China(Nos.51275415 and50905144)the Natural Science Basic Research Plan in Shanxi Province(No.2011JQ6004)the Program of the Ministry of Education of China for Introducing Talents of Discipline to Universities(No.B08040)
文摘Warm rotary draw bending provides a feasible method to form the large-diameter thin-walled(LDTW)TC4 bent tubes, which are widely used in the pneumatic system of aircrafts. An accurate prediction of flow behavior of TC4 tubes considering the couple effects of temperature,strain rate and strain is critical for understanding the deformation behavior of metals and optimizing the processing parameters in warm rotary draw bending of TC4 tubes. In this study, isothermal compression tests of TC4 tube alloy were performed from 573 to 873 K with an interval of 100 K and strain rates of 0.001, 0.010 and0.100 s^(-1). The prediction of flow behavior was done using two constitutive models, namely modified Arrhenius model and artificial neural network(ANN) model. The predictions of these constitutive models were compared using statistical measures like correlation coefficient(R), average absolute relative error(AARE) and its variation with the deformation parameters(temperature, strain rate and strain). Analysis of statistical measures reveals that the two models show high predicted accuracy in terms of R and AARE. Comparatively speaking, the ANN model presents higher predicted accuracy than the modified Arrhenius model. In addition, the predicted accuracy of ANN model presents high stability at the whole deformation parameter ranges, whereas the predictability of the modified Arrhenius model has some fluctuation at different deformation conditions. It presents higher predicted accuracy at temperatures of 573-773 K, strain rates of 0.010-0.100 s^(-1)and strain of 0.04-0.32, while low accuracy at temperature of 873 K, strain rates of 0.001 s^(-1)and strain of 0.36-0.48.Thus, the application of modified Arrhenius model is limited by its relatively low predicted accuracy at some deformation conditions, while the ANN model presents very high predicted accuracy at all deformation conditions,which can be used to study the compression behavior of TC4 tube at the temperature range of 573-873 K and the strain rate of 0.001-0.100 s^(-1). It can provide guideline for the design of processing parameters in warm rotary draw bending of LDTW TC4 tubes.
文摘Titanium dioxide (TiO2) nanoparticles were prepared by sol gel route. The preparation parameters were optimized in the removal of 4-nitropbenol (4-NP). All catalysts were analyzed by X-ray diffraction (XRD) and scanning electron microscopy (SEM). An artificial neural network model (ANN) was developed to predict the photocatalytic removal of 4-NP in the presence of TiOz nanoparticles prepared under desired conditions. The comparison between the predicted results by designed ANN model and the experimental data proved that modeling of the removal process of 4-NP using artificial neural network was a precise method to predict the extent of 4-NP removal under different conditions.
文摘The aim of the research was to create a prediction model for winter rapeseed yield.The constructed model enabled to perform simulation on 30 June,in the current year,immediately before harvesting.An artificial neural network with multilayer perceptron(MLP) topology was used to build the predictive model.The model was created on the basis of meteorological data(air temperature and atmospheric precipitation) and mineral fertilization data.The data were collected in the period 2008–2017 from 291 productive fields located in Poland,in the southern part of the Opole region.The assessment of the forecast quality created on the basis of the neural model has been verified by defining forecast errors using relative approximation error(RAE),root mean square error(RMS),mean absolute error(MAE),and mean absolute percentage error(MAPE) metrics.An important feature of the created predictive model is the ability to forecast the current agrotechnical year based on current weather and fertilizing data.The lowest value of the MAPE error was obtained for a neural network model based on the MLP network of 21:21-13-6-1:1 structure,which was 9.43%.The performed sensitivity analysis of the network examined the factors that have the greatest impact on the yield of winter rape.The highest rank 1 was obtained by an independent variable with the average air temperature from 1 January to 15 April of 2017(designation by the T1-4_CY model).
基金Sponsored by National Key Technology Research and Development Program in 11th Five-Year Plan of China (2006BAE03A07)
文摘In order to improve the accuracy of model for terminative temperature in steelmaking, it is necessary to predict and control before decarburization. Thus, an optimization neural network model of terminative temperature in the process of dephosphorization by laying correlative degree weights to all input factors related was used. Then sim- ulation experiment of model newly established is conducted utilizing 210 data from a domestic steel plant. The results show that hit rate arrives at 56.45~~ when error is within plus or minus 5%, and the value is 100% when within ~10%. Comparing to the traditional neural network prediction model, the accuracy almost increases by 6. 839o//oo. Thus, the simulation prediction fits the real perfectly, which accounts for that neural network model for terminative tempera- ture based on grey theory can reflect accurately the practice in dephosphorization. Naturally, this method is effective and nraeticahle.
基金Project supported by the National Natural Science Foundation of China(Grant No.61473208)the Tianjin Research Program of Application Foundation and Advanced Technology,China(Grant No.15JCYBJC47700)+1 种基金the National Institutes of Health,USA(Grant Nos.R01DA040990 and R01EY027544)the Project of Humanities and Social Sciences from the Ministry of Education,China(Grant No.17YJAZH092)
文摘Spontaneous alpha oscillations are a ubiquitous phenomenon in the brain and play a key role in neural information processing and various cognitive functions.Jansen's neural mass model(NMM) was initially proposed to study the origin of alpha oscillations.Most of previous studies of the spontaneous alpha oscillations in the NMM were conducted using numerical methods.In this study,we aim to propose an analytical approach using the describing function method to elucidate the spontaneous alpha oscillation mechanism in the NMM.First,the sigmoid nonlinear function in the NMM is approximated by its describing function,allowing us to reformulate the NMM and derive its standard form composed of one nonlinear part and one linear part.Second,by conducting a theoretical analysis,we can assess whether or not the spontaneous alpha oscillation would occur in the NMM and,furthermore,accurately determine its amplitude and frequency.The results reveal analytically that the interaction between linearity and nonlinearity of the NMM plays a key role in generating the spontaneous alpha oscillations.Furthermore,strong nonlinearity and large linear strength are required to generate the spontaneous alpha oscillations.
文摘The developments of modern mathematics and computer science make artificial neural networks become most useful tools in wide range of fields. Modeling methods of artificial neural networks are described in this paper. The programming technique by using Matlab neural networks toolbox is discussed. The application in Material Hot Working of neural networks is also introduced.
基金financially supported by the National Natural Science Foundation of China(41761014,42161025,42101096)the Strategic Priority Research Program of Chinese Academy of Sciences(Grant No.XDA20020201)the Foundation of A Hundred Youth Talents Training Program of Lanzhou Jiaotong University,and the Excellent Platform of Lanzhou Jiaotong University。
文摘In the context of global warming,precipitation forms are likely to transform from snowfall to rainfall with a more pronounced trend.The change in precipitation forms will inevitably affect the processes of regional runoff generation and confluence as well as the annual distribution of runoff.Most researchers used precipitation data from the CMIP5 model directly to study future precipitation trends without distinguishing between snowfall and rainfall.CMIP5 models have been proven to have better performance in simulating temperature but poorer performance in simulating precipitation.To overcome the above limitations,this paper used a Back Propagation Neural Network(BNN)to predict the rainfall-to-precipitation ratio(RPR)in months experiencing freezing-thawing transitions(FTTs).We utilized the meteorological(air pressure,air temperature,evaporation,relative humidity,wind speed,sunshine hours,surface temperature),topographic(altitude,slope,aspect)and geographic(longitude,latitude)data from 28 meteorological stations in the Chinese Tianshan Mountains region(CTMR)from 1961 to 2018 to calculate the RPR and constructed an index system of impact factors.Based on the BNN,decision-making trial and evaluation laboratory method(BP-DEMATEL),the key factors driving the transformation of the RPR in the CTMR were identified.We found that temperature was the only key factor affecting the transformation of the RPR in the BP-DEMATEL model.Considering the relationship between temperature and the RPR,the future temperature under different representative concentration pathways(RCPs)(RCP2.6/RCP4.5/RCP8.5)provided by 21 CMIP5 models and the meteorological factors from meteorological stations were input into the BNN model to acquire the future RPR from 2011 to 2100.The results showed that under the three scenarios,the RPR in the number of months experiencing FTTs during 2011-2100 will be higher than that in the historical period(1981-2010)in the CTMR.Furthermore,in terms of spatial variation,the RPR values on the south slope will be larger than those on the north slope under the three emission scenarios.Moreover,the RPR values exhibited different variation characteristics under different emission scenarios.Under the low-emission scenario(RCP2.6),as time passed,the RPR values changed slightly at more stations.Under the mediumemission scenario(RCP4.5),the RPR increased in the whole CTMR and stabilized on the north slope by the end of this century.Under the high-emission scenario(RCP8.5),the RPR values increased significantly through the 21 st century in the whole CTMR.This study may help to provide a scientific management basis for agricultural production and hydrology.