Complex-valued neural networks(CVNNs)have shown their excellent efficiency compared to their real counterparts in speech enhancement,image and signal processing.Researchers throughout the years have made many efforts ...Complex-valued neural networks(CVNNs)have shown their excellent efficiency compared to their real counterparts in speech enhancement,image and signal processing.Researchers throughout the years have made many efforts to improve the learning algorithms and activation functions of CVNNs.Since CVNNs have proven to have better performance in handling the naturally complex-valued data and signals,this area of study will grow and expect the arrival of some effective improvements in the future.Therefore,there exists an obvious reason to provide a comprehensive survey paper that systematically collects and categorizes the advancement of CVNNs.In this paper,we discuss and summarize the recent advances based on their learning algorithms,activation functions,which is the most challenging part of building a CVNN,and applications.Besides,we outline the structure and applications of complex-valued convolutional,residual and recurrent neural networks.Finally,we also present some challenges and future research directions to facilitate the exploration of the ability of CVNNs.展开更多
In this paper, a novel design procedure is proposed for synthesizing high-capacity auto-associative memories based on complex-valued neural networks with real-imaginary-type activation functions and constant delays. S...In this paper, a novel design procedure is proposed for synthesizing high-capacity auto-associative memories based on complex-valued neural networks with real-imaginary-type activation functions and constant delays. Stability criteria dependent on external inputs of neural networks are derived. The designed networks can retrieve the stored patterns by external inputs rather than initial conditions. The derivation can memorize the desired patterns with lower-dimensional neural networks than real-valued neural networks, and eliminate spurious equilibria of complex-valued neural networks. One numerical example is provided to show the effectiveness and superiority of the presented results.展开更多
In this paper, the singularity and its effect on learning dynamics in the complex-valued neural network are elucidated. It has learned that the linear combination structure in the updating rule of the complex-valued n...In this paper, the singularity and its effect on learning dynamics in the complex-valued neural network are elucidated. It has learned that the linear combination structure in the updating rule of the complex-valued neural network increases the speed of moving away from the singular points, and the complex-valued neural network cannot be easily influenced by the singular points, whereas the learning of the usual real-valued neural network can be attracted in the neighborhood of singular points, which causes a standstill in learning. Simulation results on the learning dynamics of the three-layered real-valued and complex-valued neural networks in the neighborhood of singularities support the analytical results.展开更多
The problem of exponential module-phase synchronization of complex-valued neural networks(CVNNs)with time-varying delay and stochastic perturbations was investigated.The model of CVNNs with time-varying delay and stoc...The problem of exponential module-phase synchronization of complex-valued neural networks(CVNNs)with time-varying delay and stochastic perturbations was investigated.The model of CVNNs with time-varying delay and stochastic perturbations was considered.The error system was deduced and the module-phase synchronization was defined.Based on the principle of Lyapunov stability theory,the appropriate controller was designed to control the CVNNs.Finally,the effectiveness and reliability of the method were verified by the numerical simulations.展开更多
The thermal conductivity of nanofluids is an important property that influences the heat transfer capabilities of nanofluids.Researchers rely on experimental investigations to explore nanofluid properties,as it is a n...The thermal conductivity of nanofluids is an important property that influences the heat transfer capabilities of nanofluids.Researchers rely on experimental investigations to explore nanofluid properties,as it is a necessary step before their practical application.As these investigations are time and resource-consuming undertakings,an effective prediction model can significantly improve the efficiency of research operations.In this work,an Artificial Neural Network(ANN)model is developed to predict the thermal conductivity of metal oxide water-based nanofluid.For this,a comprehensive set of 691 data points was collected from the literature.This dataset is split into training(70%),validation(15%),and testing(15%)and used to train the ANN model.The developed model is a backpropagation artificial neural network with a 4–12–1 architecture.The performance of the developed model shows high accuracy with R values above 0.90 and rapid convergence.It shows that the developed ANN model accurately predicts the thermal conductivity of nanofluids.展开更多
Accurate state of health(SOH)estimation is essential for the safe and reliable operation of lithium-ion batteries.However,existing methods face significant challenges,primarily because they rely on complete charge–di...Accurate state of health(SOH)estimation is essential for the safe and reliable operation of lithium-ion batteries.However,existing methods face significant challenges,primarily because they rely on complete charge–discharge cycles and fixed-form physical constraints,which limit adaptability to different chemistries and real-world conditions.To address these issues,this study proposes an approach that extracts features from segmented state of charge(SOC)intervals and integrates them into an enhanced physics-informed neural network(PINN).Specifically,voltage data within the 25%–75%SOC range during charging are used to derive statistical,time–frequency,and mechanism-based features that capture degradation trends.A hybrid PINN-Lasso-Transformer-BiLSTM architecture is developed,where Lasso regression enables sparse feature selection,and a nonlinear empirical degradation model is embedded as a learnable physical term within a dynamically scaled composite loss.This design adaptively balances data-driven accuracy with physical consistency,thereby enhancing estimation precision,robustness,and generalization.The results show that the proposed method outperforms conventional neural networks across four battery chemistries,achieving root mean square error and mean absolute error below 1%.Notably,features from partial charging segments exhibit higher robustness than those from full cycles.Furthermore,the model maintains strong performance under high temperatures and demonstrates excellent generalization capacity in transfer learning across chemistries,temperatures,and C-rates.This work establishes a scalable and interpretable solution for accurate SOH estimation under diverse practical operating conditions.展开更多
The adjoint method is widely used in gradient-based optimization with high-dimensional design variables.However,the cost of solving the adjoint equations in each iteration is comparable to that of solving the flow fie...The adjoint method is widely used in gradient-based optimization with high-dimensional design variables.However,the cost of solving the adjoint equations in each iteration is comparable to that of solving the flow field,resulting in expensive computational costs.To improve the efficiency of solving adjoint equations,we propose a physics-constrained graph neural networks for solving adjoint equations,named ADJ-PCGN.ADJ-PCGN establishes a mapping relationship between flow characteristics and adjoint vector based on data,serving as a replacement for the computationally expensive numerical solution of adjoint equations.A physics-based graph structure and message-passing mechanism are designed to endow its strong fitting and generalization capabilities.Taking transonic drag reduction and maximum lift-drag ratio of the airfoil as examples,results indicate that ADJ-PCGN attains a similar optimal shape as the classical direct adjoint loop method.In addition,ADJ-PCGN demonstrates strong generalization capabilities across different mesh topologies,mesh densities,and out-of-distribution conditions.It holds the potential to become a universal model for aerodynamic shape optimization involving states,geometries,and meshes.展开更多
Facing the economic challenges of significant frequency regulation wear and tear on thermal power units and short energy storage lifespan in thermal-energy storage combined systems participating in grid primary freque...Facing the economic challenges of significant frequency regulation wear and tear on thermal power units and short energy storage lifespan in thermal-energy storage combined systems participating in grid primary frequency regulation(PFR),this paper proposes a novel hybrid energy storage system(HESS)control strategy based on Newton-Raphson optimization algorithm(NRBO)-VMD and a fuzzy neural network(FNN)for PFR.In the primary power allocation stage,the high inertia and slow response of thermal power units prevent them from promptly responding to the high-frequency components of PFR signals,leading to increased mechanical stress.To address the distinct response characteristics of thermal units and HESS,an NRBO-VMD based decomposition method for PFR signals is proposed,enabling a flexible system response to grid frequency deviations.Within the HESS,an adaptive coordinated control strategy and a State of Charge(SOC)self-recovery strategy are introduced.These strategies autonomously adjust the virtual inertia and droop coefficients based on the depth of frequency regulation and the real-time SOC.Furthermore,a FNN is constructed to perform secondary refinement of the internal power distribution within the HESS.Finally,simulations under various operational conditions demonstrate that the proposed strategy effectively mitigates frequent power adjustments of the thermal unit during PFR,adaptively achieves optimal power decomposition and distribution,maintains the flywheel energy storage’s SOC within an optimal range,and ensures the long-term stable operation of the HESS.展开更多
With the rapid development of the Artificial Intelligence of Things(AIoT),convolutional neural networks(CNNs)have demonstrated potential and remarkable performance in AIoT applications due to their excellent performan...With the rapid development of the Artificial Intelligence of Things(AIoT),convolutional neural networks(CNNs)have demonstrated potential and remarkable performance in AIoT applications due to their excellent performance in various inference tasks.However,the users have concerns about privacy leakage for the use of AI and the performance and efficiency of computing on resource-constrained IoT edge devices.Therefore,this paper proposes an efficient privacy-preserving CNN framework(i.e.,EPPA)based on the Fully Homomorphic Encryption(FHE)scheme for AIoT application scenarios.In the plaintext domain,we verify schemes with different activation structures to determine the actual activation functions applicable to the corresponding ciphertext domain.Within the encryption domain,we integrate batch normalization(BN)into the convolutional layers to simplify the computation process.For nonlinear activation functions,we use composite polynomials for approximate calculation.Regarding the noise accumulation caused by homomorphic multiplication operations,we realize the refreshment of ciphertext noise through minimal“decryption-encryption”interactions,instead of adopting bootstrapping operations.Additionally,in practical implementation,we convert three-dimensional convolution into two-dimensional convolution to reduce the amount of computation in the encryption domain.Finally,we conduct extensive experiments on four IoT datasets,different CNN architectures,and two platforms with different resource configurations to evaluate the performance of EPPA in detail.展开更多
Physics-informed neural networks(PINNs),as a novel artificial intelligence method for solving partial differential equations,are applicable to solve both forward and inverse problems.This study evaluates the performan...Physics-informed neural networks(PINNs),as a novel artificial intelligence method for solving partial differential equations,are applicable to solve both forward and inverse problems.This study evaluates the performance of PINNs in solving the temperature diffusion equation of the seawater across six scenarios,including forward and inverse problems under three different boundary conditions.Results demonstrate that PINNs achieved consistently higher accuracy with the Dirichlet and Neumann boundary conditions compared to the Robin boundary condition for both forward and inverse problems.Inaccurate weighting of terms in the loss function can reduce model accuracy.Additionally,the sensitivity of model performance to the positioning of sampling points varied between different boundary conditions.In particular,the model under the Dirichlet boundary condition exhibited superior robustness to variations in point positions during the solutions of inverse problems.In contrast,for the Neumann and Robin boundary conditions,accuracy declines when points were sampled from identical positions or at the same time.Subsequently,the Argo observations were used to reconstruct the vertical diffusion of seawater temperature in the north-central Pacific for the applicability of PINNs in the real ocean.The PINNs successfully captured the vertical diffusion characteristics of seawater temperature,reflected the seasonal changes of vertical temperature under different topographic conditions,and revealed the influence of topography on the temperature diffusion coefficient.The PINNs were proved effective in solving the temperature diffusion equation of seawater with limited data,providing a promising technique for simulating or predicting ocean phenomena using sparse observations.展开更多
This study proposes a novel forecasting framework that simultaneously captures the strong periodicity and irregular meteorological fluctuations inherent in solar radiation time series.Existing approaches typically def...This study proposes a novel forecasting framework that simultaneously captures the strong periodicity and irregular meteorological fluctuations inherent in solar radiation time series.Existing approaches typically define inter-regional correlations using either simple correlation coefficients or distance-based measures when applying spatio-temporal graph neural networks(STGNNs).However,such definitions are prone to generating spurious correlations due to the dominance of periodic structures.To address this limitation,we adopt the Elastic-Band Transform(EBT)to decompose solar radiation into periodic and amplitude-modulated components,which are then modeled independently with separate graph neural networks.The periodic component,characterized by strong nationwide correlations,is learned with a relatively simple architecture,whereas the amplitude-modulated component is modeled with more complex STGNNs that capture climatological similarities between regions.The predictions from the two components are subsequently recombined to yield final forecasts that integrate both periodic patterns and aperiodic variability.The proposed framework is validated with multiple STGNN architectures,and experimental results demonstrate improved predictive accuracy and interpretability compared to conventional methods.展开更多
Parkinson’s disease(PD)is a debilitating neurological disorder affecting over 10 million people worldwide.PD classification models using voice signals as input are common in the literature.It is believed that using d...Parkinson’s disease(PD)is a debilitating neurological disorder affecting over 10 million people worldwide.PD classification models using voice signals as input are common in the literature.It is believed that using deep learning algorithms further enhances performance;nevertheless,it is challenging due to the nature of small-scale and imbalanced PD datasets.This paper proposed a convolutional neural network-based deep support vector machine(CNN-DSVM)to automate the feature extraction process using CNN and extend the conventional SVM to a DSVM for better classification performance in small-scale PD datasets.A customized kernel function reduces the impact of biased classification towards the majority class(healthy candidates in our consideration).An improved generative adversarial network(IGAN)was designed to generate additional training data to enhance the model’s performance.For performance evaluation,the proposed algorithm achieves a sensitivity of 97.6%and a specificity of 97.3%.The performance comparison is evaluated from five perspectives,including comparisons with different data generation algorithms,feature extraction techniques,kernel functions,and existing works.Results reveal the effectiveness of the IGAN algorithm,which improves the sensitivity and specificity by 4.05%–4.72%and 4.96%–5.86%,respectively;and the effectiveness of the CNN-DSVM algorithm,which improves the sensitivity by 1.24%–57.4%and specificity by 1.04%–163%and reduces biased detection towards the majority class.The ablation experiments confirm the effectiveness of individual components.Two future research directions have also been suggested.展开更多
A new real and complex-valued hybrid time-delay neural network(TDNN)is proposed for modeling and linearizing the broad-band power amplifier(BPA).The neural network includes the generalized memory effect of input signa...A new real and complex-valued hybrid time-delay neural network(TDNN)is proposed for modeling and linearizing the broad-band power amplifier(BPA).The neural network includes the generalized memory effect of input signals,complex-valued input signals and the fractional order of a complex-valued input signal module,and,thus,the modeling accuracy is improved significantly.A comparative study of the normalized mean square error(NMSE)of the real and complex-valued hybrid TDNN for different spread constants,memory depths,node numbers,and order numbers is studied so as to establish an optimal TDNN as an effective baseband model,suitable for modeling strong nonlinearity of the BPA.A 51-dBm BPA with a 25-MHz bandwidth mixed test signal is used to verify the effectiveness of the proposed model.Compared with the memory polynomial(MP)model and the real-valued TDNN,the real and complex-valued hybrid TDNN is highly effective,leading to an improvement of 5 dB in the NMSE.In addition,the real and complex-valued hybrid TDNN has an improvement of 0.6 dB over the generalized MP model in the NMSE.Also,it has better numerical stability.Moreover,the proposed TDNN presents a significant improvement over the real-valued TDNN and the MP models in suppressing out-of-band spectral regrowth.展开更多
Recently,deep learning has been used to establish the nonlinear and nonintuitive mapping between physical structures and electromagnetic responses of meta-atoms for higher computational efficiency.However,to obtain su...Recently,deep learning has been used to establish the nonlinear and nonintuitive mapping between physical structures and electromagnetic responses of meta-atoms for higher computational efficiency.However,to obtain sufficiently accurate predictions,the conventional deep-learning-based method consumes excessive time to collect the data set,thus hindering its wide application in this interdisciplinary field.We introduce a spectral transfer-learning-based metasurface design method to achieve excellent performance on a small data set with only 1000 samples in the target waveband by utilizing open-source data from another spectral range.We demonstrate three transfer strategies and experimentally quantify their performance,among which the“frozen-none”robustly improves the prediction accuracy by∼26%compared to direct learning.We propose to use a complex-valued deep neural network during the training process to further improve the spectral predicting precision by∼30%compared to its real-valued counterparts.We design several typical teraherz metadevices by employing a hybrid inverse model consolidating this trained target network and a global optimization algorithm.The simulated results successfully validate the capability of our approach.Our work provides a universal methodology for efficient and accurate metasurface design in arbitrary wavebands,which will pave the way toward the automated and mass production of metasurfaces.展开更多
In this paper, the multistability issue is discussed for delayed complex-valued recurrent neural networks with discontinuous real-imaginary-type activation functions. Based on a fixed theorem and stability definition,...In this paper, the multistability issue is discussed for delayed complex-valued recurrent neural networks with discontinuous real-imaginary-type activation functions. Based on a fixed theorem and stability definition, sufficient criteria are established for the existence and stability of multiple equilibria of complex-valued recurrent neural networks. The number of stable equilibria is larger than that of real-valued recurrent neural networks, which can be used to achieve high-capacity associative memories. One numerical example is provided to show the effectiveness and superiority of the presented results.展开更多
This paper is concerned with the adaptive synchronization of fractional-order complex-valued chaotic neural networks(FOCVCNNs)with time-delay.The chaotic behaviors of a class of fractional-order complex-valued neural ...This paper is concerned with the adaptive synchronization of fractional-order complex-valued chaotic neural networks(FOCVCNNs)with time-delay.The chaotic behaviors of a class of fractional-order complex-valued neural network are investigated.Meanwhile,based on the complex-valued inequalities of fractional-order derivatives and the stability theory of fractional-order complex-valued systems,a new adaptive controller and new complex-valued update laws are proposed to construct a synchronization control model for fractional-order complex-valued chaotic neural networks.Finally,the numerical simulation results are presented to illustrate the effectiveness of the developed synchronization scheme.展开更多
Without dividing the complex-valued systems into two real-valued ones, a class of fractional-order complex-valued memristive neural networks(FCVMNNs) with time delay is investigated. Firstly, based on the complex-valu...Without dividing the complex-valued systems into two real-valued ones, a class of fractional-order complex-valued memristive neural networks(FCVMNNs) with time delay is investigated. Firstly, based on the complex-valued sign function, a novel complex-valued feedback controller is devised to research such systems. Under the framework of Filippov solution, differential inclusion theory and Lyapunov stability theorem, the finite-time Mittag-Leffler synchronization(FTMLS) of FCVMNNs with time delay can be realized. Meanwhile, the upper bound of the synchronization settling time(SST) is less conservative than previous results. In addition, by adjusting controller parameters, the global asymptotic synchronization of FCVMNNs with time delay can also be realized, which improves and enrich some existing results. Lastly,some simulation examples are designed to verify the validity of conclusions.展开更多
For a tridiagonal two-layer real six-neuron model,the Hopf bifurcation was investigated by studying the eigenvalue equations of the related linear system in the literature.In the present paper,we extend this two-layer...For a tridiagonal two-layer real six-neuron model,the Hopf bifurcation was investigated by studying the eigenvalue equations of the related linear system in the literature.In the present paper,we extend this two-layer real six-neuron network model into a complex-valued delayed network model.Based on the mathematical analysis method,some sufficient conditions to guarantee the existence of periodic oscillatory solutions are established under the assumption that the activation function can be separated into its real and imaginary parts.Our sufficient conditions obtained by the mathematical analysis method in this paper are simpler than those obtained by the Hopf bifurcation method.Computer simulation is provided to illustrate the correctness of the theoretical results.展开更多
Deep neural networks(DNNs)are effective in solving both forward and inverse problems for nonlinear partial differential equations(PDEs).However,conventional DNNs are not effective in handling problems such as delay di...Deep neural networks(DNNs)are effective in solving both forward and inverse problems for nonlinear partial differential equations(PDEs).However,conventional DNNs are not effective in handling problems such as delay differential equations(DDEs)and delay integrodifferential equations(DIDEs)with constant delays,primarily due to their low regularity at delayinduced breaking points.In this paper,a DNN method that combines multi-task learning(MTL)which is proposed to solve both the forward and inverse problems of DIDEs.The core idea of this approach is to divide the original equation into multiple tasks based on the delay,using auxiliary outputs to represent the integral terms,followed by the use of MTL to seamlessly incorporate the properties at the breaking points into the loss function.Furthermore,given the increased training dificulty associated with multiple tasks and outputs,we employ a sequential training scheme to reduce training complexity and provide reference solutions for subsequent tasks.This approach significantly enhances the approximation accuracy of solving DIDEs with DNNs,as demonstrated by comparisons with traditional DNN methods.We validate the effectiveness of this method through several numerical experiments,test various parameter sharing structures in MTL and compare the testing results of these structures.Finally,this method is implemented to solve the inverse problem of nonlinear DIDE and the results show that the unknown parameters of DIDE can be discovered with sparse or noisy data.展开更多
Metabolomics covers a wide range of applications in life sciences,biomedicine,and phytology.Data acquisition(to achieve high coverage and efficiency)and analysis(to pursue good classification)are two key segments invo...Metabolomics covers a wide range of applications in life sciences,biomedicine,and phytology.Data acquisition(to achieve high coverage and efficiency)and analysis(to pursue good classification)are two key segments involved in metabolomics workflows.Various chemometric approaches utilizing either pattern recognition or machine learning have been employed to separate different groups.However,insufficient feature extraction,inappropriate feature selection,overfitting,or underfitting lead to an insufficient capacity to discriminate plants that are often easily confused.Using two ginseng varieties,namely Panax japonicus(PJ)and Panax japonicus var.major(PJvm),containing the similar ginsenosides,we integrated pseudo-targeted metabolomics and deep neural network(DNN)modeling to achieve accurate species differentiation.A pseudo-targeted metabolomics approach was optimized through data acquisition mode,ion pairs generation,comparison between multiple reaction monitoring(MRM)and scheduled MRM(sMRM),and chromatographic elution gradient.In total,1980 ion pairs were monitored within 23 min,allowing for the most comprehensive ginseng metabolome analysis.The established DNN model demonstrated excellent classification performance(in terms of accuracy,precision,recall,F1 score,area under the curve,and receiver operating characteristic(ROC))using the entire metabolome data and feature-selection dataset,exhibiting superior advantages over random forest(RF),support vector machine(SVM),extreme gradient boosting(XGBoost),and multilayer perceptron(MLP).Moreover,DNNs were advantageous for automated feature learning,nonlinear modeling,adaptability,and generalization.This study confirmed practicality of the established strategy for efficient metabolomics data analysis and reliable classification performance even when using small-volume samples.This established approach holds promise for plant metabolomics and is not limited to ginseng.展开更多
基金partially supported by the JSPS KAKENHI(JP22H03643,JP19K22891)。
文摘Complex-valued neural networks(CVNNs)have shown their excellent efficiency compared to their real counterparts in speech enhancement,image and signal processing.Researchers throughout the years have made many efforts to improve the learning algorithms and activation functions of CVNNs.Since CVNNs have proven to have better performance in handling the naturally complex-valued data and signals,this area of study will grow and expect the arrival of some effective improvements in the future.Therefore,there exists an obvious reason to provide a comprehensive survey paper that systematically collects and categorizes the advancement of CVNNs.In this paper,we discuss and summarize the recent advances based on their learning algorithms,activation functions,which is the most challenging part of building a CVNN,and applications.Besides,we outline the structure and applications of complex-valued convolutional,residual and recurrent neural networks.Finally,we also present some challenges and future research directions to facilitate the exploration of the ability of CVNNs.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.61503338,61573316,61374152,and 11302195)the Natural Science Foundation of Zhejiang Province,China(Grant No.LQ15F030005)
文摘In this paper, a novel design procedure is proposed for synthesizing high-capacity auto-associative memories based on complex-valued neural networks with real-imaginary-type activation functions and constant delays. Stability criteria dependent on external inputs of neural networks are derived. The designed networks can retrieve the stored patterns by external inputs rather than initial conditions. The derivation can memorize the desired patterns with lower-dimensional neural networks than real-valued neural networks, and eliminate spurious equilibria of complex-valued neural networks. One numerical example is provided to show the effectiveness and superiority of the presented results.
文摘In this paper, the singularity and its effect on learning dynamics in the complex-valued neural network are elucidated. It has learned that the linear combination structure in the updating rule of the complex-valued neural network increases the speed of moving away from the singular points, and the complex-valued neural network cannot be easily influenced by the singular points, whereas the learning of the usual real-valued neural network can be attracted in the neighborhood of singular points, which causes a standstill in learning. Simulation results on the learning dynamics of the three-layered real-valued and complex-valued neural networks in the neighborhood of singularities support the analytical results.
基金supported by the National Natural Science Foundation of China under Grant No.61863025International S&T Cooperation Projects of Gansu province under Grant No.144WCGA166Longyuan Young Innovation Talents and the Doctoral Foundation of LUT。
文摘The problem of exponential module-phase synchronization of complex-valued neural networks(CVNNs)with time-varying delay and stochastic perturbations was investigated.The model of CVNNs with time-varying delay and stochastic perturbations was considered.The error system was deduced and the module-phase synchronization was defined.Based on the principle of Lyapunov stability theory,the appropriate controller was designed to control the CVNNs.Finally,the effectiveness and reliability of the method were verified by the numerical simulations.
基金supported by Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(2021R1A6A1A10044950).
文摘The thermal conductivity of nanofluids is an important property that influences the heat transfer capabilities of nanofluids.Researchers rely on experimental investigations to explore nanofluid properties,as it is a necessary step before their practical application.As these investigations are time and resource-consuming undertakings,an effective prediction model can significantly improve the efficiency of research operations.In this work,an Artificial Neural Network(ANN)model is developed to predict the thermal conductivity of metal oxide water-based nanofluid.For this,a comprehensive set of 691 data points was collected from the literature.This dataset is split into training(70%),validation(15%),and testing(15%)and used to train the ANN model.The developed model is a backpropagation artificial neural network with a 4–12–1 architecture.The performance of the developed model shows high accuracy with R values above 0.90 and rapid convergence.It shows that the developed ANN model accurately predicts the thermal conductivity of nanofluids.
基金supported by the Shanghai Pilot Program for Basic Research(22T01400100-18)the National Natural Science Foundation of China(22278127 and 12447149)+1 种基金the Fundamental Research Funds for the Central Universities(2022ZFJH004)the Postdoctoral Fellowship Program of CPSF(GZB20250159).
文摘Accurate state of health(SOH)estimation is essential for the safe and reliable operation of lithium-ion batteries.However,existing methods face significant challenges,primarily because they rely on complete charge–discharge cycles and fixed-form physical constraints,which limit adaptability to different chemistries and real-world conditions.To address these issues,this study proposes an approach that extracts features from segmented state of charge(SOC)intervals and integrates them into an enhanced physics-informed neural network(PINN).Specifically,voltage data within the 25%–75%SOC range during charging are used to derive statistical,time–frequency,and mechanism-based features that capture degradation trends.A hybrid PINN-Lasso-Transformer-BiLSTM architecture is developed,where Lasso regression enables sparse feature selection,and a nonlinear empirical degradation model is embedded as a learnable physical term within a dynamically scaled composite loss.This design adaptively balances data-driven accuracy with physical consistency,thereby enhancing estimation precision,robustness,and generalization.The results show that the proposed method outperforms conventional neural networks across four battery chemistries,achieving root mean square error and mean absolute error below 1%.Notably,features from partial charging segments exhibit higher robustness than those from full cycles.Furthermore,the model maintains strong performance under high temperatures and demonstrates excellent generalization capacity in transfer learning across chemistries,temperatures,and C-rates.This work establishes a scalable and interpretable solution for accurate SOH estimation under diverse practical operating conditions.
基金supported by the National Natural Science Foundation of China(Grant No.12272316).
文摘The adjoint method is widely used in gradient-based optimization with high-dimensional design variables.However,the cost of solving the adjoint equations in each iteration is comparable to that of solving the flow field,resulting in expensive computational costs.To improve the efficiency of solving adjoint equations,we propose a physics-constrained graph neural networks for solving adjoint equations,named ADJ-PCGN.ADJ-PCGN establishes a mapping relationship between flow characteristics and adjoint vector based on data,serving as a replacement for the computationally expensive numerical solution of adjoint equations.A physics-based graph structure and message-passing mechanism are designed to endow its strong fitting and generalization capabilities.Taking transonic drag reduction and maximum lift-drag ratio of the airfoil as examples,results indicate that ADJ-PCGN attains a similar optimal shape as the classical direct adjoint loop method.In addition,ADJ-PCGN demonstrates strong generalization capabilities across different mesh topologies,mesh densities,and out-of-distribution conditions.It holds the potential to become a universal model for aerodynamic shape optimization involving states,geometries,and meshes.
基金supported by the Lanzhou Science and Technology Plan Project(XM1753694781389).
文摘Facing the economic challenges of significant frequency regulation wear and tear on thermal power units and short energy storage lifespan in thermal-energy storage combined systems participating in grid primary frequency regulation(PFR),this paper proposes a novel hybrid energy storage system(HESS)control strategy based on Newton-Raphson optimization algorithm(NRBO)-VMD and a fuzzy neural network(FNN)for PFR.In the primary power allocation stage,the high inertia and slow response of thermal power units prevent them from promptly responding to the high-frequency components of PFR signals,leading to increased mechanical stress.To address the distinct response characteristics of thermal units and HESS,an NRBO-VMD based decomposition method for PFR signals is proposed,enabling a flexible system response to grid frequency deviations.Within the HESS,an adaptive coordinated control strategy and a State of Charge(SOC)self-recovery strategy are introduced.These strategies autonomously adjust the virtual inertia and droop coefficients based on the depth of frequency regulation and the real-time SOC.Furthermore,a FNN is constructed to perform secondary refinement of the internal power distribution within the HESS.Finally,simulations under various operational conditions demonstrate that the proposed strategy effectively mitigates frequent power adjustments of the thermal unit during PFR,adaptively achieves optimal power decomposition and distribution,maintains the flywheel energy storage’s SOC within an optimal range,and ensures the long-term stable operation of the HESS.
基金supported by the Natural Science Foundation of China No.62362008the Major Scientific and Technological Special Project of Guizhou Province([2024]014).
文摘With the rapid development of the Artificial Intelligence of Things(AIoT),convolutional neural networks(CNNs)have demonstrated potential and remarkable performance in AIoT applications due to their excellent performance in various inference tasks.However,the users have concerns about privacy leakage for the use of AI and the performance and efficiency of computing on resource-constrained IoT edge devices.Therefore,this paper proposes an efficient privacy-preserving CNN framework(i.e.,EPPA)based on the Fully Homomorphic Encryption(FHE)scheme for AIoT application scenarios.In the plaintext domain,we verify schemes with different activation structures to determine the actual activation functions applicable to the corresponding ciphertext domain.Within the encryption domain,we integrate batch normalization(BN)into the convolutional layers to simplify the computation process.For nonlinear activation functions,we use composite polynomials for approximate calculation.Regarding the noise accumulation caused by homomorphic multiplication operations,we realize the refreshment of ciphertext noise through minimal“decryption-encryption”interactions,instead of adopting bootstrapping operations.Additionally,in practical implementation,we convert three-dimensional convolution into two-dimensional convolution to reduce the amount of computation in the encryption domain.Finally,we conduct extensive experiments on four IoT datasets,different CNN architectures,and two platforms with different resource configurations to evaluate the performance of EPPA in detail.
基金Supported by the National Key Research and Development Program of China(No.2023YFC3008200)the Independent Research Project of Southern Marine Science and Engineering Guangdong Laboratory(Zhuhai)(No.SML2022SP505)。
文摘Physics-informed neural networks(PINNs),as a novel artificial intelligence method for solving partial differential equations,are applicable to solve both forward and inverse problems.This study evaluates the performance of PINNs in solving the temperature diffusion equation of the seawater across six scenarios,including forward and inverse problems under three different boundary conditions.Results demonstrate that PINNs achieved consistently higher accuracy with the Dirichlet and Neumann boundary conditions compared to the Robin boundary condition for both forward and inverse problems.Inaccurate weighting of terms in the loss function can reduce model accuracy.Additionally,the sensitivity of model performance to the positioning of sampling points varied between different boundary conditions.In particular,the model under the Dirichlet boundary condition exhibited superior robustness to variations in point positions during the solutions of inverse problems.In contrast,for the Neumann and Robin boundary conditions,accuracy declines when points were sampled from identical positions or at the same time.Subsequently,the Argo observations were used to reconstruct the vertical diffusion of seawater temperature in the north-central Pacific for the applicability of PINNs in the real ocean.The PINNs successfully captured the vertical diffusion characteristics of seawater temperature,reflected the seasonal changes of vertical temperature under different topographic conditions,and revealed the influence of topography on the temperature diffusion coefficient.The PINNs were proved effective in solving the temperature diffusion equation of seawater with limited data,providing a promising technique for simulating or predicting ocean phenomena using sparse observations.
基金supported by Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(RS-2023-00249743).
文摘This study proposes a novel forecasting framework that simultaneously captures the strong periodicity and irregular meteorological fluctuations inherent in solar radiation time series.Existing approaches typically define inter-regional correlations using either simple correlation coefficients or distance-based measures when applying spatio-temporal graph neural networks(STGNNs).However,such definitions are prone to generating spurious correlations due to the dominance of periodic structures.To address this limitation,we adopt the Elastic-Band Transform(EBT)to decompose solar radiation into periodic and amplitude-modulated components,which are then modeled independently with separate graph neural networks.The periodic component,characterized by strong nationwide correlations,is learned with a relatively simple architecture,whereas the amplitude-modulated component is modeled with more complex STGNNs that capture climatological similarities between regions.The predictions from the two components are subsequently recombined to yield final forecasts that integrate both periodic patterns and aperiodic variability.The proposed framework is validated with multiple STGNN architectures,and experimental results demonstrate improved predictive accuracy and interpretability compared to conventional methods.
基金The work described in this paper was fully supported by a grant from Hong Kong Metropolitan University(RIF/2021/05).
文摘Parkinson’s disease(PD)is a debilitating neurological disorder affecting over 10 million people worldwide.PD classification models using voice signals as input are common in the literature.It is believed that using deep learning algorithms further enhances performance;nevertheless,it is challenging due to the nature of small-scale and imbalanced PD datasets.This paper proposed a convolutional neural network-based deep support vector machine(CNN-DSVM)to automate the feature extraction process using CNN and extend the conventional SVM to a DSVM for better classification performance in small-scale PD datasets.A customized kernel function reduces the impact of biased classification towards the majority class(healthy candidates in our consideration).An improved generative adversarial network(IGAN)was designed to generate additional training data to enhance the model’s performance.For performance evaluation,the proposed algorithm achieves a sensitivity of 97.6%and a specificity of 97.3%.The performance comparison is evaluated from five perspectives,including comparisons with different data generation algorithms,feature extraction techniques,kernel functions,and existing works.Results reveal the effectiveness of the IGAN algorithm,which improves the sensitivity and specificity by 4.05%–4.72%and 4.96%–5.86%,respectively;and the effectiveness of the CNN-DSVM algorithm,which improves the sensitivity by 1.24%–57.4%and specificity by 1.04%–163%and reduces biased detection towards the majority class.The ablation experiments confirm the effectiveness of individual components.Two future research directions have also been suggested.
基金The National Natural Science Foundation of China(No.61561052,61701262)the Science and Technology Foundation of Henan Province(No.182102410062,182102210114)the Science and Technology Foundation of Henan Educational Committee(No.17A510018)
文摘A new real and complex-valued hybrid time-delay neural network(TDNN)is proposed for modeling and linearizing the broad-band power amplifier(BPA).The neural network includes the generalized memory effect of input signals,complex-valued input signals and the fractional order of a complex-valued input signal module,and,thus,the modeling accuracy is improved significantly.A comparative study of the normalized mean square error(NMSE)of the real and complex-valued hybrid TDNN for different spread constants,memory depths,node numbers,and order numbers is studied so as to establish an optimal TDNN as an effective baseband model,suitable for modeling strong nonlinearity of the BPA.A 51-dBm BPA with a 25-MHz bandwidth mixed test signal is used to verify the effectiveness of the proposed model.Compared with the memory polynomial(MP)model and the real-valued TDNN,the real and complex-valued hybrid TDNN is highly effective,leading to an improvement of 5 dB in the NMSE.In addition,the real and complex-valued hybrid TDNN has an improvement of 0.6 dB over the generalized MP model in the NMSE.Also,it has better numerical stability.Moreover,the proposed TDNN presents a significant improvement over the real-valued TDNN and the MP models in suppressing out-of-band spectral regrowth.
基金support from the National Natural Science Foundation of China (Grant Nos.62027820,61975143,61735012,and 62205380).
文摘Recently,deep learning has been used to establish the nonlinear and nonintuitive mapping between physical structures and electromagnetic responses of meta-atoms for higher computational efficiency.However,to obtain sufficiently accurate predictions,the conventional deep-learning-based method consumes excessive time to collect the data set,thus hindering its wide application in this interdisciplinary field.We introduce a spectral transfer-learning-based metasurface design method to achieve excellent performance on a small data set with only 1000 samples in the target waveband by utilizing open-source data from another spectral range.We demonstrate three transfer strategies and experimentally quantify their performance,among which the“frozen-none”robustly improves the prediction accuracy by∼26%compared to direct learning.We propose to use a complex-valued deep neural network during the training process to further improve the spectral predicting precision by∼30%compared to its real-valued counterparts.We design several typical teraherz metadevices by employing a hybrid inverse model consolidating this trained target network and a global optimization algorithm.The simulated results successfully validate the capability of our approach.Our work provides a universal methodology for efficient and accurate metasurface design in arbitrary wavebands,which will pave the way toward the automated and mass production of metasurfaces.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.61374094 and 61503338)the Natural Science Foundation of Zhejiang Province,China(Grant No.LQ15F030005)
文摘In this paper, the multistability issue is discussed for delayed complex-valued recurrent neural networks with discontinuous real-imaginary-type activation functions. Based on a fixed theorem and stability definition, sufficient criteria are established for the existence and stability of multiple equilibria of complex-valued recurrent neural networks. The number of stable equilibria is larger than that of real-valued recurrent neural networks, which can be used to achieve high-capacity associative memories. One numerical example is provided to show the effectiveness and superiority of the presented results.
基金Project supported by the Science and Technology Support Program of Xingtai,China(Grant No.2019ZC054)。
文摘This paper is concerned with the adaptive synchronization of fractional-order complex-valued chaotic neural networks(FOCVCNNs)with time-delay.The chaotic behaviors of a class of fractional-order complex-valued neural network are investigated.Meanwhile,based on the complex-valued inequalities of fractional-order derivatives and the stability theory of fractional-order complex-valued systems,a new adaptive controller and new complex-valued update laws are proposed to construct a synchronization control model for fractional-order complex-valued chaotic neural networks.Finally,the numerical simulation results are presented to illustrate the effectiveness of the developed synchronization scheme.
基金Project supported by the National Natural Science Foundation of China (Grant Nos. 62176189 and 62106181)the Hubei Province Key Laboratory of Systems Science in Metallurgical Process (Wuhan University of Science and Technology) (Grant No. Y202002)。
文摘Without dividing the complex-valued systems into two real-valued ones, a class of fractional-order complex-valued memristive neural networks(FCVMNNs) with time delay is investigated. Firstly, based on the complex-valued sign function, a novel complex-valued feedback controller is devised to research such systems. Under the framework of Filippov solution, differential inclusion theory and Lyapunov stability theorem, the finite-time Mittag-Leffler synchronization(FTMLS) of FCVMNNs with time delay can be realized. Meanwhile, the upper bound of the synchronization settling time(SST) is less conservative than previous results. In addition, by adjusting controller parameters, the global asymptotic synchronization of FCVMNNs with time delay can also be realized, which improves and enrich some existing results. Lastly,some simulation examples are designed to verify the validity of conclusions.
文摘For a tridiagonal two-layer real six-neuron model,the Hopf bifurcation was investigated by studying the eigenvalue equations of the related linear system in the literature.In the present paper,we extend this two-layer real six-neuron network model into a complex-valued delayed network model.Based on the mathematical analysis method,some sufficient conditions to guarantee the existence of periodic oscillatory solutions are established under the assumption that the activation function can be separated into its real and imaginary parts.Our sufficient conditions obtained by the mathematical analysis method in this paper are simpler than those obtained by the Hopf bifurcation method.Computer simulation is provided to illustrate the correctness of the theoretical results.
文摘Deep neural networks(DNNs)are effective in solving both forward and inverse problems for nonlinear partial differential equations(PDEs).However,conventional DNNs are not effective in handling problems such as delay differential equations(DDEs)and delay integrodifferential equations(DIDEs)with constant delays,primarily due to their low regularity at delayinduced breaking points.In this paper,a DNN method that combines multi-task learning(MTL)which is proposed to solve both the forward and inverse problems of DIDEs.The core idea of this approach is to divide the original equation into multiple tasks based on the delay,using auxiliary outputs to represent the integral terms,followed by the use of MTL to seamlessly incorporate the properties at the breaking points into the loss function.Furthermore,given the increased training dificulty associated with multiple tasks and outputs,we employ a sequential training scheme to reduce training complexity and provide reference solutions for subsequent tasks.This approach significantly enhances the approximation accuracy of solving DIDEs with DNNs,as demonstrated by comparisons with traditional DNN methods.We validate the effectiveness of this method through several numerical experiments,test various parameter sharing structures in MTL and compare the testing results of these structures.Finally,this method is implemented to solve the inverse problem of nonlinear DIDE and the results show that the unknown parameters of DIDE can be discovered with sparse or noisy data.
基金supported by the National Key R&D Program of China(Grant No.:2022YFC3501805)the National Natural Science Foundation of China(Grant No.:82374030)+2 种基金the Science and Technology Program of Tianjin in China(Grant No.:23ZYJDSS00030)the Tianjin Outstanding Youth Fund,China(Grant No.:23JCJQJC00030)the China Postdoctoral Science Foundation-Tianjin Joint Support Program(Grant No.:2023T030TJ).
文摘Metabolomics covers a wide range of applications in life sciences,biomedicine,and phytology.Data acquisition(to achieve high coverage and efficiency)and analysis(to pursue good classification)are two key segments involved in metabolomics workflows.Various chemometric approaches utilizing either pattern recognition or machine learning have been employed to separate different groups.However,insufficient feature extraction,inappropriate feature selection,overfitting,or underfitting lead to an insufficient capacity to discriminate plants that are often easily confused.Using two ginseng varieties,namely Panax japonicus(PJ)and Panax japonicus var.major(PJvm),containing the similar ginsenosides,we integrated pseudo-targeted metabolomics and deep neural network(DNN)modeling to achieve accurate species differentiation.A pseudo-targeted metabolomics approach was optimized through data acquisition mode,ion pairs generation,comparison between multiple reaction monitoring(MRM)and scheduled MRM(sMRM),and chromatographic elution gradient.In total,1980 ion pairs were monitored within 23 min,allowing for the most comprehensive ginseng metabolome analysis.The established DNN model demonstrated excellent classification performance(in terms of accuracy,precision,recall,F1 score,area under the curve,and receiver operating characteristic(ROC))using the entire metabolome data and feature-selection dataset,exhibiting superior advantages over random forest(RF),support vector machine(SVM),extreme gradient boosting(XGBoost),and multilayer perceptron(MLP).Moreover,DNNs were advantageous for automated feature learning,nonlinear modeling,adaptability,and generalization.This study confirmed practicality of the established strategy for efficient metabolomics data analysis and reliable classification performance even when using small-volume samples.This established approach holds promise for plant metabolomics and is not limited to ginseng.
