To improve the performance of multilayer perceptron(MLP)neural networks activated by conventional activation functions,this paper presents a new MLP activated by univariate Gaussian radial basis functions(RBFs)with ad...To improve the performance of multilayer perceptron(MLP)neural networks activated by conventional activation functions,this paper presents a new MLP activated by univariate Gaussian radial basis functions(RBFs)with adaptive centers and widths,which is composed of more than one hidden layer.In the hidden layer of the RBF-activated MLP network(MLPRBF),the outputs of the preceding layer are first linearly transformed and then fed into the univariate Gaussian RBF,which exploits the highly nonlinear property of RBF.Adaptive RBFs might address the issues of saturated outputs,low sensitivity,and vanishing gradients in MLPs activated by other prevailing nonlinear functions.Finally,we apply four MLP networks with the rectified linear unit(ReLU),sigmoid function(sigmoid),hyperbolic tangent function(tanh),and Gaussian RBF as the activation functions to approximate the one-dimensional(1D)sinusoidal function,the analytical solution of viscous Burgers’equation,and the two-dimensional(2D)steady lid-driven cavity flows.Using the same network structure,MLP-RBF generally predicts more accurately and converges faster than the other threeMLPs.MLP-RBF using less hidden layers and/or neurons per layer can yield comparable or even higher approximation accuracy than other MLPs equipped with more layers or neurons.展开更多
Totally three articles focusing on functional magnetic resonance imaging features of brain function in the activated brain regions of stroke patients undergoing acupuncture on the healthy limbs and healthy controls un...Totally three articles focusing on functional magnetic resonance imaging features of brain function in the activated brain regions of stroke patients undergoing acupuncture on the healthy limbs and healthy controls undergoing acupuncture on the lower extremities are published in three issues. We hope that our readers find these papers useful to their research.展开更多
Background and objective:Activated carbon is commonly used as an immobilisation matrix due to its large surface area,making it a highly desirable matrix for use in immobilising enzymes as preparation for use on the in...Background and objective:Activated carbon is commonly used as an immobilisation matrix due to its large surface area,making it a highly desirable matrix for use in immobilising enzymes as preparation for use on the industrial scale.The objective of this research is to determine the effectiveness of different acids for functionalisation on immobilisation capacity and also to characterize the functionalized activated carbon for the functional groups present.Materials and methods:Activated carbon was functionalised with three acids(hydrochloric acid,nitric acid and sulphuric acid)along with a control sample washed with distilled water.Immobilisation capacity was calculated with hydrochloric acid functionalized activated carbon(HCl-FAC)giving the highest immobilization capacity(6.022 U/g).Characterisation of the functionalised activated carbon was conducted using FT-IR(Fourier Transform Infra-Red)spectroscopy analysis of the samples with the aim of analyzing the various functional groups present to determine the sample with distinct characteristics thus telling the degree of adsorption of lipase onto the activated carbon powder.Results:HNO3-FAC(functionalized activated carbon)showed a very distinct pattern as a larger number of surface functional groups emerged.The immobilisation on a matrix ensures thermal stability and increased reusability of the enzyme.Therefore,in this research,lipase sourced from Candida antarctica was immobilised on acid functionalised activated carbon.The best acid for functionalisation was found to be hydrochloric acid.Conclusion:Due to the very distinct patterns shown by the FT-IR spectrum of the HNO3-FAC after a fair comparison with others,it allows for a larger number of surface functional groups which will definitely enhance the stability of the enzyme lipase.展开更多
Deep learning(DL),derived from the domain of Artificial Neural Networks(ANN),forms one of the most essential components of modern deep learning algorithms.DL segmentation models rely on layer-by-layer convolution-base...Deep learning(DL),derived from the domain of Artificial Neural Networks(ANN),forms one of the most essential components of modern deep learning algorithms.DL segmentation models rely on layer-by-layer convolution-based feature representation,guided by forward and backward propagation.Acritical aspect of this process is the selection of an appropriate activation function(AF)to ensure robustmodel learning.However,existing activation functions often fail to effectively address the vanishing gradient problem or are complicated by the need for manual parameter tuning.Most current research on activation function design focuses on classification tasks using natural image datasets such asMNIST,CIFAR-10,and CIFAR-100.To address this gap,this study proposesMed-ReLU,a novel activation function specifically designed for medical image segmentation.Med-ReLU prevents deep learning models fromsuffering dead neurons or vanishing gradient issues.It is a hybrid activation function that combines the properties of ReLU and Softsign.For positive inputs,Med-ReLU adopts the linear behavior of ReLU to avoid vanishing gradients,while for negative inputs,it exhibits the Softsign’s polynomial convergence,ensuring robust training and avoiding inactive neurons across the training set.The training performance and segmentation accuracy ofMed-ReLU have been thoroughly evaluated,demonstrating stable learning behavior and resistance to overfitting.It consistently outperforms state-of-the-art activation functions inmedical image segmentation tasks.Designed as a parameter-free function,Med-ReLU is simple to implement in complex deep learning architectures,and its effectiveness spans various neural network models and anomaly detection scenarios.展开更多
Activated carbon（AC） is very effective for multi-pollutant removal; however, the complicated components in flue gas can influence each other＇s adsorption. A series of adsorption experiments for multicomponents, inc...Activated carbon（AC） is very effective for multi-pollutant removal; however, the complicated components in flue gas can influence each other＇s adsorption. A series of adsorption experiments for multicomponents, including SO_2, NO, chlorobenzene and H2 O,on AC were performed in a fixed-bed reactor. For single-component adsorption, the adsorption amount for chlorobenzene was larger than for SO_2 and NO on the AC. In the multi-component atmosphere, the adsorption amount decreased by 27.6% for chlorobenzene and decreased by 95.6% for NO, whereas it increased by a factor of two for SO_2,demonstrating that a complex atmosphere is unfavorable for chlorobenzene adsorption and inhibits NO adsorption. In contrast, it is very beneficial for SO_2 adsorption. The temperature-programmed desorption（TPD） results indicated that the binding strength between the gas adsorbates and the AC follows the order of SO_2〉 chlorobenzene 〉 NO. The adsorption amount is independent of the binding strength. The presence of H2 O enhanced the component effects, while it weakened the binding force between the gas adsorbates and the AC. AC oxygen functional groups were analyzed using TPD and X-ray photoelectron spectroscopy（XPS） measurements. The results reveal the reason why the chlorobenzene adsorption is less affected by the presence of other components. Lactone groups partly transform into carbonyl and quinone groups after chlorobenzene desorption. The chlorobenzene adsorption increases the number of C = O groups, which explains the positive effect of chlorobenzene on SO_2 adsorption and the strong NO adsorption.展开更多
AIM： To evaluate the differences in the functional connectivity（FC） of the primary visual cortex（V1） between the youth comitant exotropia（CE） patients and health subjects using resting functional magnetic reson...AIM： To evaluate the differences in the functional connectivity（FC） of the primary visual cortex（V1） between the youth comitant exotropia（CE） patients and health subjects using resting functional magnetic resonance imaging（f MRI） data.METHODS： Totally, 32 CEs（25 males and 7 females） and 32 healthy control subjects（HCs）（25 males and 7 females） were enrolled in the study and underwent the MRI scanning. Two-sample t-test was used to examine differences in FC maps between the CE patients and HCs. RESULTS： The CE patients showed significantly less FC between the left brodmann area（BA17） and left lingual gyrus/cerebellum posterior lobe, right middle occipital gyrus, left precentral gyrus/postcentral gyrus and right inferior parietal lobule/postcentral gyrus. Meanwhile, CE patients showed significantly less FC between right BA17 and right middle occipital gyrus（BA19, 37）.CONCLUSION： Our findings show that CE involves abnormal FC in primary visual cortex in many regions, which may underlie the pathologic mechanism of impaired fusion and stereoscopic vision in CEs.展开更多
Exploration of soil environmental characteristics governing soil microbial community structure and activity may improve our understanding of biogeochemical processes and soil quality. The impact of soil environmental ...Exploration of soil environmental characteristics governing soil microbial community structure and activity may improve our understanding of biogeochemical processes and soil quality. The impact of soil environmental characteristics especially organic carbon availability after 15-yr different organic and inorganic fertilizer inputs on soil bacterial community structure and functional metabolic diversity of soil microbial communities were evaluated in a 15-yr fertilizer experiment in Changping County, Beijing, China. The experiment was a wheat-maize rotation system which was established in 1991 including four different fertilizer treatments. These treatments included： a non-amended control（CK）, a commonly used application rate of inorganic fertilizer treatment（NPK）; a commonly used application rate of inorganic fertilizer with swine manure incorporated treatment（NPKM）, and a commonly used application rate of inorganic fertilizer with maize straw incorporated treatment（NPKS）. Denaturing gradient gel electrophoresis（DGGE） of the 16 S r RNA gene was used to determine the bacterial community structure and single carbon source utilization profiles were determined to characterize the microbial community functional metabolic diversity of different fertilizer treatments using Biolog Eco plates. The results indicated that long-term fertilized treatments significantly increased soil bacterial community structure compared to CK. The use of inorganic fertilizer with organic amendments incorporated for long term（NPKM, NPKS） significantly promoted soil bacterial structure than the application of inorganic fertilizer only（NPK）, and NPKM treatment was the most important driver for increases in the soil microbial community richness（S） and structural diversity（H）. Overall utilization of carbon sources by soil microbial communities（average well color development, AWCD） and microbial substrate utilization diversity and evenness indices（H＇ and E） indicated that long-term inorganic fertilizer with organic amendments incorporated（NPKM, NPKS） could significantly stimulate soil microbial metabolic activity and functional diversity relative to CK, while no differences of them were found between NPKS and NPK treatments. Principal component analysis（PCA） based on carbon source utilization profiles also showed significant separation of soil microbial community under long-term fertilization regimes and NPKM treatment was significantly separated from the other three treatments primarily according to the higher microbial utilization of carbohydrates, carboxylic acids, polymers, phenolic compounds, and amino acid, while higher utilization of amines/amides differed soil microbial community in NPKS treatment from those in the other three treatments. Redundancy analysis（RDA） indicated that soil organic carbon（SOC） availability, especially soil microbial biomass carbon（Cmic） and Cmic/SOC ratio are the key factors of soil environmental characteristics contributing to the increase of both soil microbial community structure and functional metabolic diversity in the long-term fertilization trial. Our results showed that long-term inorganic fertilizer and swine manure application could significantly improve soil bacterial community structure and soil microbial metabolic activity through the increases in SOC availability, which could provide insights into the sustainable management of China＇s soil resource.展开更多
Recently,deep learning has achieved remarkable results in fields that require human cognitive ability,learning ability,and reasoning ability.Activation functions are very important because they provide the ability of ...Recently,deep learning has achieved remarkable results in fields that require human cognitive ability,learning ability,and reasoning ability.Activation functions are very important because they provide the ability of artificial neural networks to learn complex patterns through nonlinearity.Various activation functions are being studied to solve problems such as vanishing gradients and dying nodes that may occur in the deep learning process.However,it takes a lot of time and effort for researchers to use the existing activation function in their research.Therefore,in this paper,we propose a universal activation function(UA)so that researchers can easily create and apply various activation functions and improve the performance of neural networks.UA can generate new types of activation functions as well as functions like traditional activation functions by properly adjusting three hyperparameters.The famous Convolutional Neural Network(CNN)and benchmark datasetwere used to evaluate the experimental performance of the UA proposed in this study.We compared the performance of the artificial neural network to which the traditional activation function is applied and the artificial neural network to which theUA is applied.In addition,we evaluated the performance of the new activation function generated by adjusting the hyperparameters of theUA.The experimental performance evaluation results showed that the classification performance of CNNs improved by up to 5%through the UA,although most of them showed similar performance to the traditional activation function.展开更多
In this paper, the multistability issue is discussed for delayed complex-valued recurrent neural networks with discontinuous real-imaginary-type activation functions. Based on a fixed theorem and stability definition,...In this paper, the multistability issue is discussed for delayed complex-valued recurrent neural networks with discontinuous real-imaginary-type activation functions. Based on a fixed theorem and stability definition, sufficient criteria are established for the existence and stability of multiple equilibria of complex-valued recurrent neural networks. The number of stable equilibria is larger than that of real-valued recurrent neural networks, which can be used to achieve high-capacity associative memories. One numerical example is provided to show the effectiveness and superiority of the presented results.展开更多
The stability of a periodic oscillation and the global exponential class of recurrent neural networks with non-monotone activation functions and time-varying delays are analyzed. For two sets of activation functions, ...The stability of a periodic oscillation and the global exponential class of recurrent neural networks with non-monotone activation functions and time-varying delays are analyzed. For two sets of activation functions, some algebraic criteria for ascertaining global exponential periodicity and global exponential stability of the class of recurrent neural networks are derived by using the comparison principle and the theory of monotone operator. These conditions are easy to check in terms of system parameters. In addition, we provide a new and efficacious method for the qualitative analysis of various neural networks.展开更多
Silver coatings on the exterior surface of monolithic activated carbon（MAC） with different morphology were prepared by directly immersing MAC into [Ag（NH3）2]NO3 solution. Acid and base treatments were employed to ...Silver coatings on the exterior surface of monolithic activated carbon（MAC） with different morphology were prepared by directly immersing MAC into [Ag（NH3）2]NO3 solution. Acid and base treatments were employed to modify the surface oxygenic groups of MAC, respectively. The MACs＇ Brunauer-EmmettTeller（BET） surface area, surface groups, and silver coating morphology were characterized by N2 adsorption, elemental analysis（EA）, X-ray photoelectron spectroscopy（XPS）, and scanning electron microscopy（SEM）, respectively. The coating morphology was found to be closely related to the surface area and surface functional groups of MAC. For a raw MAC which contained a variety of oxygenic groups, HNO3 treatment enhanced the relative amount of highly oxidized groups such as carboxyl and carbonates, which disfavored the deposition of silver particles. By contrast, Na OH treatment significantly improved the amount of carbonyl groups, which in turn improved the deposition amount of silver. Importantly, lamella silver was produced on raw MAC while Na OH treatment resulted in granular particles because of the capping effect of carbonyl groups. At appropriate [Ag（NH3）2]NO3 concentrations, silver nanoparticles smaller than 100 nm were homogeneously dispersed on Na OH-treated MAC. The successful tuning of the size and morphology of silver coatings on MAC is promising for novel applications in air purification and for antibacterial or aesthetic purposes.展开更多
This paper describes our implementation of several neural networks built on a field programmable gate array (FPGA) and used to recognize a handwritten digit dataset—the Modified National Institute of Standards and Te...This paper describes our implementation of several neural networks built on a field programmable gate array (FPGA) and used to recognize a handwritten digit dataset—the Modified National Institute of Standards and Technology (MNIST) database. We also propose a novel hardware-friendly activation function called the dynamic Rectifid Linear Unit (ReLU)—D-ReLU function that achieves higher performance than traditional activation functions at no cost to accuracy. We built a 2-layer online training multilayer perceptron (MLP) neural network on an FPGA with varying data width. Reducing the data width from 8 to 4 bits only reduces prediction accuracy by 11%, but the FPGA area decreases by 41%. Compared to networks that use the sigmoid functions, our proposed D-ReLU function uses 24% - 41% less area with no loss to prediction accuracy. Further reducing the data width of the 3-layer networks from 8 to 4 bits, the prediction accuracies only decrease by 3% - 5%, with area being reduced by 9% - 28%. Moreover, FPGA solutions have 29 times faster execution time, even despite running at a 60× lower clock rate. Thus, FPGA implementations of neural networks offer a high-performance, low power alternative to traditional software methods, and our novel D-ReLU activation function offers additional improvements to performance and power saving.展开更多
Activation functions play an essential role in converting the output of the artificial neural network into nonlinear results,since without this nonlinearity,the results of the network will be less accurate.Nonlinearity...Activation functions play an essential role in converting the output of the artificial neural network into nonlinear results,since without this nonlinearity,the results of the network will be less accurate.Nonlinearity is the mission of all nonlinear functions,except for polynomials.The activation function must be dif-ferentiable for backpropagation learning.This study’s objective is to determine the best activation functions for the approximation of each fractal image.Different results have been attained using Matlab and Visual Basic programs,which indi-cate that the bounded function is more helpful than other functions.The non-lin-earity of the activation function is important when using neural networks for coding fractal images because the coefficients of the Iterated Function System are different according to the different types of fractals.The most commonly cho-sen activation function is the sigmoidal function,which produces a positive value.Other functions,such as tansh or arctan,whose values can be positive or negative depending on the network input,tend to train neural networks faster.The coding speed of the fractal image is different depending on the appropriate activation function chosen for each fractal shape.In this paper,we have provided the appro-priate activation functions for each type of system of iterated functions that help the network to identify the transactions of the system.展开更多
Recently we have studied the rare earth ion-selective electrodes with active materials of the func-tional polymers and found that the process chosen for the functional polymers had an effect on the propertiesof gadoli...Recently we have studied the rare earth ion-selective electrodes with active materials of the func-tional polymers and found that the process chosen for the functional polymers had an effect on the propertiesof gadolinium ion selective electrode besides the effects of their structures.1.Effect of preparation process of the grafted polymers on the properties ofgadolinium ion selective electrodesThe electrode membranes which consist of functional polymers as active materials were prepared by re-action of gadolinium chloride with the radiation grafted clmer of acrlic acid and polystyrene of which展开更多
Aphasia is an acquired language disorder that is a common consequence of stroke.The pathogenesis of the disease is not fully understood,and as a result,current treatment options are not satisfactory.Here,we used blood...Aphasia is an acquired language disorder that is a common consequence of stroke.The pathogenesis of the disease is not fully understood,and as a result,current treatment options are not satisfactory.Here,we used blood oxygenation level-dependent functional magnetic resonance imaging to evaluate the activation of bilateral cortices in patients with Broca＇s aphasia 1 to 3 months after stroke.Our results showed that language expression was associated with multiple brain regions in which the right hemisphere participated in the generation of language.The activation areas in the left hemisphere of aphasia patients were significantly smaller compared with those in healthy adults.The activation frequency,volumes,and intensity in the regions related to language,such as the left inferior frontal gyrus（Broca＇s area）,the left superior temporal gyrus,and the right inferior frontal gyrus（the mirror region of Broca＇s area）,were lower in patients compared with healthy adults.In contrast,activation in the right superior temporal gyrus,the bilateral superior parietal lobule,and the left inferior temporal gyrus was stronger in patients compared with healthy controls.These results suggest that the right inferior frontal gyrus plays a role in the recovery of language function in the subacute stage of stroke-related aphasia by increasing the engagement of related brain areas.展开更多
Background:Excessive heat exposure can lead to hyperthermia in humans,which impairs physical performance and disrupts cognitive function.While heat is a known physiological stressor,it is unclear how severe heat stres...Background:Excessive heat exposure can lead to hyperthermia in humans,which impairs physical performance and disrupts cognitive function.While heat is a known physiological stressor,it is unclear how severe heat stress affects brain physiology and function.Methods:Eleven healthy participants were subjected to heat stress from prolonged exercise or warm water immersion until their rectal temperatures(T_(re))attained 39.5℃,inducing exertional or passive hyperthermia,respectively.In a separate trial,blended ice was ingested before and during exercise as a cooling strategy.Data were compared to a control condition with seated rest(normothermic).Brain temperature(T_(br)),cerebral perfusion,and task-based brain activity were assessed using magnetic resonance imaging techniques.Results:T_(br)in motor cortex was found to be tightly regulated at rest(37.3℃±0.4℃(mean±SD))despite fluctuations in T_(re).With the development of hyperthermia,T_(br)increases and dovetails with the rising T_(re).Bilateral motor cortical activity was suppressed during high-intensity plantarflexion tasks,implying a reduced central motor drive in hyperthermic participants(T_(re)=38.5℃±0.1℃).Global gray matter perfusion and regional perfusion in sensorimotor cortex were reduced with passive hyperthermia.Executive function was poorer under a passive hyperthermic state,and this could relate to compromised visual processing as indicated by the reduced activation of left lateral-occipital cortex.Conversely,ingestion of blended ice before and during exercise alleviated the rise in both T_(re)and T_(bc)and mitigated heat-related neural perturbations.Conclusion:Severe heat exposure elevates T_(br),disrupts motor cortical activity and executive function,and this can lead to impairment of physical and cognitive performance.展开更多
A vehicle engine cooling system is of utmost importance to ensure that the engine operates in a safe temperature range.In most radiators that are used to cool an engine,water serves as a cooling fluid.The performance ...A vehicle engine cooling system is of utmost importance to ensure that the engine operates in a safe temperature range.In most radiators that are used to cool an engine,water serves as a cooling fluid.The performance of a radiator in terms of heat transmission is significantly influenced by the incorporation of nanoparticles into the cooling water.Concentration and uniformity of nanoparticle distribution are the two major factors for the practical use of nanofluids.The shape and size of nanoparticles also have a great impact on the performance of heat transfer.Many researchers are investigating the impact of nanoparticles on heat transfer.This study aims to develop an artificial neural network(ANN)model for predicting the thermal conductivity of an ethylene glycol(EG)/waterbased crystalline nanocellulose(CNC)nanofluid for cooling internal combustion engine.The implementation of an artificial neural network considering different activation functions in the hidden layer is made to find the bestmodel for the cooling of an engine using the nanofluid.Accuracies of the model with different activation functions in artificial neural networks are analyzed for different nanofluid concentrations and temperatures.In artificial neural networks,Levenberg–Marquardt is an optimization approach used with activation functions,including Tansig and Logsig functions in the training phase.The findings of each training,testing,and validation phase are presented to demonstrate the network that provides the highest level of accuracy.The best result was obtained with Tansig,which has a correlation of 0.99903 and an error of 3.7959×10^(–8).It has also been noticed that the Logsig function can also be a good model due to its correlation of 0.99890 and an error of 4.9218×10^(–8).Thus ourANNwith Tansig and Logsig functions demonstrates a high correlation between the actual output and the predicted output.展开更多
In this paper,the functional polymeric active materials were prepared by the grafting copolymerization and their structure and properties were studied.The results show that the structure and properties of these ac- ti...In this paper,the functional polymeric active materials were prepared by the grafting copolymerization and their structure and properties were studied.The results show that the structure and properties of these ac- tive materials have the relative large effects on the properties of gadolinium ion selective electrodes.展开更多
The purpose of this study was to address the challenges in predicting and classifying accuracy in modeling Container Dwell Time (CDT) using Artificial Neural Networks (ANN). This objective was driven by the suboptimal...The purpose of this study was to address the challenges in predicting and classifying accuracy in modeling Container Dwell Time (CDT) using Artificial Neural Networks (ANN). This objective was driven by the suboptimal outcomes reported in previous studies and sought to apply an innovative approach to improve these results. To achieve this, the study applied the Fusion of Activation Functions (FAFs) to a substantial dataset. This dataset included 307,594 container records from the Port of Tema from 2014 to 2022, encompassing both import and transit containers. The RandomizedSearchCV algorithm from Python’s Scikit-learn library was utilized in the methodological approach to yield the optimal activation function for prediction accuracy. The results indicated that “ajaLT”, a fusion of the Logistic and Hyperbolic Tangent Activation Functions, provided the best prediction accuracy, reaching a high of 82%. Despite these encouraging findings, it’s crucial to recognize the study’s limitations. While Fusion of Activation Functions is a promising method, further evaluation is necessary across different container types and port operations to ascertain the broader applicability and generalizability of these findings. The original value of this study lies in its innovative application of FAFs to CDT. Unlike previous studies, this research evaluates the method based on prediction accuracy rather than training time. It opens new avenues for machine learning engineers and researchers in applying FAFs to enhance prediction accuracy in CDT modeling, contributing to a previously underexplored area.展开更多
Objective: to investigate the effect of rehabilitation nursing on activity function in knee meniscus injury. Methods: 60 patients with knee meniscus injury from 12-2020-December 2021. The control group was given routi...Objective: to investigate the effect of rehabilitation nursing on activity function in knee meniscus injury. Methods: 60 patients with knee meniscus injury from 12-2020-December 2021. The control group was given routine care, and the rehabilitation nursing group implements routine nursing combined rehabilitation nursing. The pain level, depression, anxiety, activity function, and satisfaction degree were compared between the two groups. Results: pain level, depression, activity function and satisfaction were lower than the control group, P <0.05. Conclusion: in case of knee meniscus injury, it can relieve depression and anxiety, improve activity function and reduce pain and improve satisfaction.展开更多
基金This work was partially supported by the research grant of the National University of Singapore(NUS),Ministry of Education(MOE Tier 1).
文摘To improve the performance of multilayer perceptron(MLP)neural networks activated by conventional activation functions,this paper presents a new MLP activated by univariate Gaussian radial basis functions(RBFs)with adaptive centers and widths,which is composed of more than one hidden layer.In the hidden layer of the RBF-activated MLP network(MLPRBF),the outputs of the preceding layer are first linearly transformed and then fed into the univariate Gaussian RBF,which exploits the highly nonlinear property of RBF.Adaptive RBFs might address the issues of saturated outputs,low sensitivity,and vanishing gradients in MLPs activated by other prevailing nonlinear functions.Finally,we apply four MLP networks with the rectified linear unit(ReLU),sigmoid function(sigmoid),hyperbolic tangent function(tanh),and Gaussian RBF as the activation functions to approximate the one-dimensional(1D)sinusoidal function,the analytical solution of viscous Burgers’equation,and the two-dimensional(2D)steady lid-driven cavity flows.Using the same network structure,MLP-RBF generally predicts more accurately and converges faster than the other threeMLPs.MLP-RBF using less hidden layers and/or neurons per layer can yield comparable or even higher approximation accuracy than other MLPs equipped with more layers or neurons.
文摘Totally three articles focusing on functional magnetic resonance imaging features of brain function in the activated brain regions of stroke patients undergoing acupuncture on the healthy limbs and healthy controls undergoing acupuncture on the lower extremities are published in three issues. We hope that our readers find these papers useful to their research.
文摘Background and objective:Activated carbon is commonly used as an immobilisation matrix due to its large surface area,making it a highly desirable matrix for use in immobilising enzymes as preparation for use on the industrial scale.The objective of this research is to determine the effectiveness of different acids for functionalisation on immobilisation capacity and also to characterize the functionalized activated carbon for the functional groups present.Materials and methods:Activated carbon was functionalised with three acids(hydrochloric acid,nitric acid and sulphuric acid)along with a control sample washed with distilled water.Immobilisation capacity was calculated with hydrochloric acid functionalized activated carbon(HCl-FAC)giving the highest immobilization capacity(6.022 U/g).Characterisation of the functionalised activated carbon was conducted using FT-IR(Fourier Transform Infra-Red)spectroscopy analysis of the samples with the aim of analyzing the various functional groups present to determine the sample with distinct characteristics thus telling the degree of adsorption of lipase onto the activated carbon powder.Results:HNO3-FAC(functionalized activated carbon)showed a very distinct pattern as a larger number of surface functional groups emerged.The immobilisation on a matrix ensures thermal stability and increased reusability of the enzyme.Therefore,in this research,lipase sourced from Candida antarctica was immobilised on acid functionalised activated carbon.The best acid for functionalisation was found to be hydrochloric acid.Conclusion:Due to the very distinct patterns shown by the FT-IR spectrum of the HNO3-FAC after a fair comparison with others,it allows for a larger number of surface functional groups which will definitely enhance the stability of the enzyme lipase.
基金The researchers would like to thank the Deanship of Graduate Studies and Scientific Research at Qassim University for financial support(QU-APC-2025).
文摘Deep learning(DL),derived from the domain of Artificial Neural Networks(ANN),forms one of the most essential components of modern deep learning algorithms.DL segmentation models rely on layer-by-layer convolution-based feature representation,guided by forward and backward propagation.Acritical aspect of this process is the selection of an appropriate activation function(AF)to ensure robustmodel learning.However,existing activation functions often fail to effectively address the vanishing gradient problem or are complicated by the need for manual parameter tuning.Most current research on activation function design focuses on classification tasks using natural image datasets such asMNIST,CIFAR-10,and CIFAR-100.To address this gap,this study proposesMed-ReLU,a novel activation function specifically designed for medical image segmentation.Med-ReLU prevents deep learning models fromsuffering dead neurons or vanishing gradient issues.It is a hybrid activation function that combines the properties of ReLU and Softsign.For positive inputs,Med-ReLU adopts the linear behavior of ReLU to avoid vanishing gradients,while for negative inputs,it exhibits the Softsign’s polynomial convergence,ensuring robust training and avoiding inactive neurons across the training set.The training performance and segmentation accuracy ofMed-ReLU have been thoroughly evaluated,demonstrating stable learning behavior and resistance to overfitting.It consistently outperforms state-of-the-art activation functions inmedical image segmentation tasks.Designed as a parameter-free function,Med-ReLU is simple to implement in complex deep learning architectures,and its effectiveness spans various neural network models and anomaly detection scenarios.
基金supported by the National Natural Science Foundation of China (Nos. 21177129, 21207132) the Strategic Priority Research Program of the Chinese Academy of Sciences (No. XDB05050502)
文摘Activated carbon（AC） is very effective for multi-pollutant removal; however, the complicated components in flue gas can influence each other＇s adsorption. A series of adsorption experiments for multicomponents, including SO_2, NO, chlorobenzene and H2 O,on AC were performed in a fixed-bed reactor. For single-component adsorption, the adsorption amount for chlorobenzene was larger than for SO_2 and NO on the AC. In the multi-component atmosphere, the adsorption amount decreased by 27.6% for chlorobenzene and decreased by 95.6% for NO, whereas it increased by a factor of two for SO_2,demonstrating that a complex atmosphere is unfavorable for chlorobenzene adsorption and inhibits NO adsorption. In contrast, it is very beneficial for SO_2 adsorption. The temperature-programmed desorption（TPD） results indicated that the binding strength between the gas adsorbates and the AC follows the order of SO_2〉 chlorobenzene 〉 NO. The adsorption amount is independent of the binding strength. The presence of H2 O enhanced the component effects, while it weakened the binding force between the gas adsorbates and the AC. AC oxygen functional groups were analyzed using TPD and X-ray photoelectron spectroscopy（XPS） measurements. The results reveal the reason why the chlorobenzene adsorption is less affected by the presence of other components. Lactone groups partly transform into carbonyl and quinone groups after chlorobenzene desorption. The chlorobenzene adsorption increases the number of C = O groups, which explains the positive effect of chlorobenzene on SO_2 adsorption and the strong NO adsorption.
基金Supported by the National Natural Science Foundation of China(No.81660158No.81160118No.81400372)
文摘AIM： To evaluate the differences in the functional connectivity（FC） of the primary visual cortex（V1） between the youth comitant exotropia（CE） patients and health subjects using resting functional magnetic resonance imaging（f MRI） data.METHODS： Totally, 32 CEs（25 males and 7 females） and 32 healthy control subjects（HCs）（25 males and 7 females） were enrolled in the study and underwent the MRI scanning. Two-sample t-test was used to examine differences in FC maps between the CE patients and HCs. RESULTS： The CE patients showed significantly less FC between the left brodmann area（BA17） and left lingual gyrus/cerebellum posterior lobe, right middle occipital gyrus, left precentral gyrus/postcentral gyrus and right inferior parietal lobule/postcentral gyrus. Meanwhile, CE patients showed significantly less FC between right BA17 and right middle occipital gyrus（BA19, 37）.CONCLUSION： Our findings show that CE involves abnormal FC in primary visual cortex in many regions, which may underlie the pathologic mechanism of impaired fusion and stereoscopic vision in CEs.
基金funded by the National Natural Science Foundation of China(NSFC31301843)the National Nonprofit Institute Research Grant of Chinese Academy of Agricultural Sciences(IARRP-202-5)
文摘Exploration of soil environmental characteristics governing soil microbial community structure and activity may improve our understanding of biogeochemical processes and soil quality. The impact of soil environmental characteristics especially organic carbon availability after 15-yr different organic and inorganic fertilizer inputs on soil bacterial community structure and functional metabolic diversity of soil microbial communities were evaluated in a 15-yr fertilizer experiment in Changping County, Beijing, China. The experiment was a wheat-maize rotation system which was established in 1991 including four different fertilizer treatments. These treatments included： a non-amended control（CK）, a commonly used application rate of inorganic fertilizer treatment（NPK）; a commonly used application rate of inorganic fertilizer with swine manure incorporated treatment（NPKM）, and a commonly used application rate of inorganic fertilizer with maize straw incorporated treatment（NPKS）. Denaturing gradient gel electrophoresis（DGGE） of the 16 S r RNA gene was used to determine the bacterial community structure and single carbon source utilization profiles were determined to characterize the microbial community functional metabolic diversity of different fertilizer treatments using Biolog Eco plates. The results indicated that long-term fertilized treatments significantly increased soil bacterial community structure compared to CK. The use of inorganic fertilizer with organic amendments incorporated for long term（NPKM, NPKS） significantly promoted soil bacterial structure than the application of inorganic fertilizer only（NPK）, and NPKM treatment was the most important driver for increases in the soil microbial community richness（S） and structural diversity（H）. Overall utilization of carbon sources by soil microbial communities（average well color development, AWCD） and microbial substrate utilization diversity and evenness indices（H＇ and E） indicated that long-term inorganic fertilizer with organic amendments incorporated（NPKM, NPKS） could significantly stimulate soil microbial metabolic activity and functional diversity relative to CK, while no differences of them were found between NPKS and NPK treatments. Principal component analysis（PCA） based on carbon source utilization profiles also showed significant separation of soil microbial community under long-term fertilization regimes and NPKM treatment was significantly separated from the other three treatments primarily according to the higher microbial utilization of carbohydrates, carboxylic acids, polymers, phenolic compounds, and amino acid, while higher utilization of amines/amides differed soil microbial community in NPKS treatment from those in the other three treatments. Redundancy analysis（RDA） indicated that soil organic carbon（SOC） availability, especially soil microbial biomass carbon（Cmic） and Cmic/SOC ratio are the key factors of soil environmental characteristics contributing to the increase of both soil microbial community structure and functional metabolic diversity in the long-term fertilization trial. Our results showed that long-term inorganic fertilizer and swine manure application could significantly improve soil bacterial community structure and soil microbial metabolic activity through the increases in SOC availability, which could provide insights into the sustainable management of China＇s soil resource.
基金This work was supported by the National Research Foundation of Korea(NRF)grant funded by the Korea government(MSIT)(No.2022R1F1A1062953).
文摘Recently,deep learning has achieved remarkable results in fields that require human cognitive ability,learning ability,and reasoning ability.Activation functions are very important because they provide the ability of artificial neural networks to learn complex patterns through nonlinearity.Various activation functions are being studied to solve problems such as vanishing gradients and dying nodes that may occur in the deep learning process.However,it takes a lot of time and effort for researchers to use the existing activation function in their research.Therefore,in this paper,we propose a universal activation function(UA)so that researchers can easily create and apply various activation functions and improve the performance of neural networks.UA can generate new types of activation functions as well as functions like traditional activation functions by properly adjusting three hyperparameters.The famous Convolutional Neural Network(CNN)and benchmark datasetwere used to evaluate the experimental performance of the UA proposed in this study.We compared the performance of the artificial neural network to which the traditional activation function is applied and the artificial neural network to which theUA is applied.In addition,we evaluated the performance of the new activation function generated by adjusting the hyperparameters of theUA.The experimental performance evaluation results showed that the classification performance of CNNs improved by up to 5%through the UA,although most of them showed similar performance to the traditional activation function.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.61374094 and 61503338)the Natural Science Foundation of Zhejiang Province,China(Grant No.LQ15F030005)
文摘In this paper, the multistability issue is discussed for delayed complex-valued recurrent neural networks with discontinuous real-imaginary-type activation functions. Based on a fixed theorem and stability definition, sufficient criteria are established for the existence and stability of multiple equilibria of complex-valued recurrent neural networks. The number of stable equilibria is larger than that of real-valued recurrent neural networks, which can be used to achieve high-capacity associative memories. One numerical example is provided to show the effectiveness and superiority of the presented results.
基金Supported by the Natural Science Foundation of Hubei Province (2007ABA124)the Youth Project Foundation of Hubei Province Education Department (Q200722001)the Major Foundation of Hubei Province Education Department (D200722002)
文摘The stability of a periodic oscillation and the global exponential class of recurrent neural networks with non-monotone activation functions and time-varying delays are analyzed. For two sets of activation functions, some algebraic criteria for ascertaining global exponential periodicity and global exponential stability of the class of recurrent neural networks are derived by using the comparison principle and the theory of monotone operator. These conditions are easy to check in terms of system parameters. In addition, we provide a new and efficacious method for the qualitative analysis of various neural networks.
基金Funded by the Interdisciplinary Program of Shanghai Jiao Tong University(YG2016MS24)
文摘Silver coatings on the exterior surface of monolithic activated carbon（MAC） with different morphology were prepared by directly immersing MAC into [Ag（NH3）2]NO3 solution. Acid and base treatments were employed to modify the surface oxygenic groups of MAC, respectively. The MACs＇ Brunauer-EmmettTeller（BET） surface area, surface groups, and silver coating morphology were characterized by N2 adsorption, elemental analysis（EA）, X-ray photoelectron spectroscopy（XPS）, and scanning electron microscopy（SEM）, respectively. The coating morphology was found to be closely related to the surface area and surface functional groups of MAC. For a raw MAC which contained a variety of oxygenic groups, HNO3 treatment enhanced the relative amount of highly oxidized groups such as carboxyl and carbonates, which disfavored the deposition of silver particles. By contrast, Na OH treatment significantly improved the amount of carbonyl groups, which in turn improved the deposition amount of silver. Importantly, lamella silver was produced on raw MAC while Na OH treatment resulted in granular particles because of the capping effect of carbonyl groups. At appropriate [Ag（NH3）2]NO3 concentrations, silver nanoparticles smaller than 100 nm were homogeneously dispersed on Na OH-treated MAC. The successful tuning of the size and morphology of silver coatings on MAC is promising for novel applications in air purification and for antibacterial or aesthetic purposes.
文摘This paper describes our implementation of several neural networks built on a field programmable gate array (FPGA) and used to recognize a handwritten digit dataset—the Modified National Institute of Standards and Technology (MNIST) database. We also propose a novel hardware-friendly activation function called the dynamic Rectifid Linear Unit (ReLU)—D-ReLU function that achieves higher performance than traditional activation functions at no cost to accuracy. We built a 2-layer online training multilayer perceptron (MLP) neural network on an FPGA with varying data width. Reducing the data width from 8 to 4 bits only reduces prediction accuracy by 11%, but the FPGA area decreases by 41%. Compared to networks that use the sigmoid functions, our proposed D-ReLU function uses 24% - 41% less area with no loss to prediction accuracy. Further reducing the data width of the 3-layer networks from 8 to 4 bits, the prediction accuracies only decrease by 3% - 5%, with area being reduced by 9% - 28%. Moreover, FPGA solutions have 29 times faster execution time, even despite running at a 60× lower clock rate. Thus, FPGA implementations of neural networks offer a high-performance, low power alternative to traditional software methods, and our novel D-ReLU activation function offers additional improvements to performance and power saving.
文摘Activation functions play an essential role in converting the output of the artificial neural network into nonlinear results,since without this nonlinearity,the results of the network will be less accurate.Nonlinearity is the mission of all nonlinear functions,except for polynomials.The activation function must be dif-ferentiable for backpropagation learning.This study’s objective is to determine the best activation functions for the approximation of each fractal image.Different results have been attained using Matlab and Visual Basic programs,which indi-cate that the bounded function is more helpful than other functions.The non-lin-earity of the activation function is important when using neural networks for coding fractal images because the coefficients of the Iterated Function System are different according to the different types of fractals.The most commonly cho-sen activation function is the sigmoidal function,which produces a positive value.Other functions,such as tansh or arctan,whose values can be positive or negative depending on the network input,tend to train neural networks faster.The coding speed of the fractal image is different depending on the appropriate activation function chosen for each fractal shape.In this paper,we have provided the appro-priate activation functions for each type of system of iterated functions that help the network to identify the transactions of the system.
文摘Recently we have studied the rare earth ion-selective electrodes with active materials of the func-tional polymers and found that the process chosen for the functional polymers had an effect on the propertiesof gadolinium ion selective electrode besides the effects of their structures.1.Effect of preparation process of the grafted polymers on the properties ofgadolinium ion selective electrodesThe electrode membranes which consist of functional polymers as active materials were prepared by re-action of gadolinium chloride with the radiation grafted clmer of acrlic acid and polystyrene of which
基金supported by the Natural Science Foundation of Guangdong Province of China,No.2016A030313327the Science and Technology Planning Project of Guangzhou City of China,No.201607010185+1 种基金the Science and Technology Planning Project of Guangdong Province of China,No.2016A020215226the National Natural Science Foundation of China,No.81401869
文摘Aphasia is an acquired language disorder that is a common consequence of stroke.The pathogenesis of the disease is not fully understood,and as a result,current treatment options are not satisfactory.Here,we used blood oxygenation level-dependent functional magnetic resonance imaging to evaluate the activation of bilateral cortices in patients with Broca＇s aphasia 1 to 3 months after stroke.Our results showed that language expression was associated with multiple brain regions in which the right hemisphere participated in the generation of language.The activation areas in the left hemisphere of aphasia patients were significantly smaller compared with those in healthy adults.The activation frequency,volumes,and intensity in the regions related to language,such as the left inferior frontal gyrus（Broca＇s area）,the left superior temporal gyrus,and the right inferior frontal gyrus（the mirror region of Broca＇s area）,were lower in patients compared with healthy adults.In contrast,activation in the right superior temporal gyrus,the bilateral superior parietal lobule,and the left inferior temporal gyrus was stronger in patients compared with healthy controls.These results suggest that the right inferior frontal gyrus plays a role in the recovery of language function in the subacute stage of stroke-related aphasia by increasing the engagement of related brain areas.
基金supported by Defence Innovative Research Program(DIRP)Grant(PA No.9015102335)from Defence Research&Technology Office,Ministry of Defence,Singapore。
文摘Background:Excessive heat exposure can lead to hyperthermia in humans,which impairs physical performance and disrupts cognitive function.While heat is a known physiological stressor,it is unclear how severe heat stress affects brain physiology and function.Methods:Eleven healthy participants were subjected to heat stress from prolonged exercise or warm water immersion until their rectal temperatures(T_(re))attained 39.5℃,inducing exertional or passive hyperthermia,respectively.In a separate trial,blended ice was ingested before and during exercise as a cooling strategy.Data were compared to a control condition with seated rest(normothermic).Brain temperature(T_(br)),cerebral perfusion,and task-based brain activity were assessed using magnetic resonance imaging techniques.Results:T_(br)in motor cortex was found to be tightly regulated at rest(37.3℃±0.4℃(mean±SD))despite fluctuations in T_(re).With the development of hyperthermia,T_(br)increases and dovetails with the rising T_(re).Bilateral motor cortical activity was suppressed during high-intensity plantarflexion tasks,implying a reduced central motor drive in hyperthermic participants(T_(re)=38.5℃±0.1℃).Global gray matter perfusion and regional perfusion in sensorimotor cortex were reduced with passive hyperthermia.Executive function was poorer under a passive hyperthermic state,and this could relate to compromised visual processing as indicated by the reduced activation of left lateral-occipital cortex.Conversely,ingestion of blended ice before and during exercise alleviated the rise in both T_(re)and T_(bc)and mitigated heat-related neural perturbations.Conclusion:Severe heat exposure elevates T_(br),disrupts motor cortical activity and executive function,and this can lead to impairment of physical and cognitive performance.
基金supported by the International Publication Research Grant No.RDU223301.
文摘A vehicle engine cooling system is of utmost importance to ensure that the engine operates in a safe temperature range.In most radiators that are used to cool an engine,water serves as a cooling fluid.The performance of a radiator in terms of heat transmission is significantly influenced by the incorporation of nanoparticles into the cooling water.Concentration and uniformity of nanoparticle distribution are the two major factors for the practical use of nanofluids.The shape and size of nanoparticles also have a great impact on the performance of heat transfer.Many researchers are investigating the impact of nanoparticles on heat transfer.This study aims to develop an artificial neural network(ANN)model for predicting the thermal conductivity of an ethylene glycol(EG)/waterbased crystalline nanocellulose(CNC)nanofluid for cooling internal combustion engine.The implementation of an artificial neural network considering different activation functions in the hidden layer is made to find the bestmodel for the cooling of an engine using the nanofluid.Accuracies of the model with different activation functions in artificial neural networks are analyzed for different nanofluid concentrations and temperatures.In artificial neural networks,Levenberg–Marquardt is an optimization approach used with activation functions,including Tansig and Logsig functions in the training phase.The findings of each training,testing,and validation phase are presented to demonstrate the network that provides the highest level of accuracy.The best result was obtained with Tansig,which has a correlation of 0.99903 and an error of 3.7959×10^(–8).It has also been noticed that the Logsig function can also be a good model due to its correlation of 0.99890 and an error of 4.9218×10^(–8).Thus ourANNwith Tansig and Logsig functions demonstrates a high correlation between the actual output and the predicted output.
文摘In this paper,the functional polymeric active materials were prepared by the grafting copolymerization and their structure and properties were studied.The results show that the structure and properties of these ac- tive materials have the relative large effects on the properties of gadolinium ion selective electrodes.
文摘The purpose of this study was to address the challenges in predicting and classifying accuracy in modeling Container Dwell Time (CDT) using Artificial Neural Networks (ANN). This objective was driven by the suboptimal outcomes reported in previous studies and sought to apply an innovative approach to improve these results. To achieve this, the study applied the Fusion of Activation Functions (FAFs) to a substantial dataset. This dataset included 307,594 container records from the Port of Tema from 2014 to 2022, encompassing both import and transit containers. The RandomizedSearchCV algorithm from Python’s Scikit-learn library was utilized in the methodological approach to yield the optimal activation function for prediction accuracy. The results indicated that “ajaLT”, a fusion of the Logistic and Hyperbolic Tangent Activation Functions, provided the best prediction accuracy, reaching a high of 82%. Despite these encouraging findings, it’s crucial to recognize the study’s limitations. While Fusion of Activation Functions is a promising method, further evaluation is necessary across different container types and port operations to ascertain the broader applicability and generalizability of these findings. The original value of this study lies in its innovative application of FAFs to CDT. Unlike previous studies, this research evaluates the method based on prediction accuracy rather than training time. It opens new avenues for machine learning engineers and researchers in applying FAFs to enhance prediction accuracy in CDT modeling, contributing to a previously underexplored area.
文摘Objective: to investigate the effect of rehabilitation nursing on activity function in knee meniscus injury. Methods: 60 patients with knee meniscus injury from 12-2020-December 2021. The control group was given routine care, and the rehabilitation nursing group implements routine nursing combined rehabilitation nursing. The pain level, depression, anxiety, activity function, and satisfaction degree were compared between the two groups. Results: pain level, depression, activity function and satisfaction were lower than the control group, P <0.05. Conclusion: in case of knee meniscus injury, it can relieve depression and anxiety, improve activity function and reduce pain and improve satisfaction.
