To accurately model flows with shock waves using staggered-grid Lagrangian hydrodynamics, the artificial viscosity has to be introduced to convert kinetic energy into internal energy, thereby increasing the entropy ac...To accurately model flows with shock waves using staggered-grid Lagrangian hydrodynamics, the artificial viscosity has to be introduced to convert kinetic energy into internal energy, thereby increasing the entropy across shocks. Determining the appropriate strength of the artificial viscosity is an art and strongly depends on the particular problem and experience of the researcher. The objective of this study is to pose the problem of finding the appropriate strength of the artificial viscosity as an optimization problem and solve this problem using machine learning (ML) tools, specifically using surrogate models based on Gaussian Process regression (GPR) and Bayesian analysis. We describe the optimization method and discuss various practical details of its implementation. The shock-containing problems for which we apply this method all have been implemented in the LANL code FLAG (Burton in Connectivity structures and differencing techniques for staggered-grid free-Lagrange hydrodynamics, Tech. Rep. UCRL-JC-110555, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1992, in Consistent finite-volume discretization of hydrodynamic conservation laws for unstructured grids, Tech. Rep. CRL-JC-118788, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1994, Multidimensional discretization of conservation laws for unstructured polyhedral grids, Tech. Rep. UCRL-JC-118306, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1994, in FLAG, a multi-dimensional, multiple mesh, adaptive free-Lagrange, hydrodynamics code. In: NECDC, 1992). First, we apply ML to find optimal values to isolated shock problems of different strengths. Second, we apply ML to optimize the viscosity for a one-dimensional (1D) propagating detonation problem based on Zel’dovich-von Neumann-Doring (ZND) (Fickett and Davis in Detonation: theory and experiment. Dover books on physics. Dover Publications, Mineola, 2000) detonation theory using a reactive burn model. We compare results for default (currently used values in FLAG) and optimized values of the artificial viscosity for these problems demonstrating the potential for significant improvement in the accuracy of computations.展开更多
The packaging quality of coaxial laser diodes(CLDs)plays a pivotal role in determining their optical performance and long-term reliability.As the core packaging process,high-precision laser welding requires precise co...The packaging quality of coaxial laser diodes(CLDs)plays a pivotal role in determining their optical performance and long-term reliability.As the core packaging process,high-precision laser welding requires precise control of process parameters to suppress optical power loss.However,the complex nonlinear relationship between welding parameters and optical power loss renders traditional trial-and-error methods inefficient and imprecise.To address this challenge,a physics-informed(PI)and data-driven collaboration approach for welding parameter optimization is proposed.First,thermal-fluid-solid coupling finite element method(FEM)was employed to quantify the sensitivity of welding parameters to physical characteristics,including residual stress.This analysis facilitated the identification of critical factors contributing to optical power loss.Subsequently,a Gaussian process regression(GPR)model incorporating finite element simulation prior knowledge was constructed based on the selected features.By introducing physics-informed kernel(PIK)functions,stress distribution patterns were embedded into the prediction model,achieving high-precision optical power loss prediction.Finally,a Bayesian optimization(BO)algorithm with an adaptive sampling strategy was implemented for efficient parameter space exploration.Experimental results demonstrate that the proposedmethod effectively establishes explicit physical correlations between welding parameters and optical power loss.The optimized welding parameters reduced optical power loss by 34.1%,providing theoretical guidance and technical support for reliable CLD packaging.展开更多
Global Navigation Satellite System(GNSS)imaging method(GIM)has been successfully applied to global regions to investigate vertical land motion(VLM)of the Earth's surface.GNSS images derived from conventional GIM m...Global Navigation Satellite System(GNSS)imaging method(GIM)has been successfully applied to global regions to investigate vertical land motion(VLM)of the Earth's surface.GNSS images derived from conventional GIM method may present fragmented patches and encounter problems caused by excessive smoothing of velocity peaks,leading to difficulty in short-wavelength deformation detection and improper geophysical interpretation.Therefore,we propose a novel GNSS imaging method based on Gaussian process regression with velocity uncertainty considered(GPR-VU).Gaussian processing regression is introduced to describe the spatial relationship between neighboring site pairs as a priori weights and then reweight velocities by known station uncertainties,converting the discrete velocity field to a continuous one.The GPR-VU method is applied to reconstruct VLM images in the southwestern United States and the eastern Qinghai-Xizang Plateau,China,using the GNSS position time series in vertical direction.Compared to the traditional GIM method,the root-mean-square(RMS)and overall accuracy of the confusion matrix of the GPR-VU method increase by 5.0%and 14.0%from the 1°×1°checkerboard test in the southwestern United States.Similarly,the RMS and overall accuracy increase by 33.7%and 15.8%from the 6°×6°checkerboard test in the eastern Qinghai-Xizang Plateau.These checkerboard tests validate the capability to effectively capture the spatiotemporal variations characteristics of VLM and show that this algorithm outperforms the sparsely distributed network in the Qinghai-Xizang Plateau.The images from the GPR-VU method using real data in both regions show significant subsidence around Lassen Volcanic in northern California within a 30 km radius,slight uplift in the northern Sichuan Basin,and subsidence in its central and southern sections.These results further qualitatively illustrate consistency with previous findings.The GPR-VU method outperforms in diminishing the effect by fragmented patches,excessive smoothing of velocity peaks,and detecting potential short-wavelength deformations.展开更多
The performance of lithium-ion batteries(LIBs)gradually declines over time,making it critical to predict the battery’s state of health(SOH)in real-time.This paper presents a model that incorporates health indicators ...The performance of lithium-ion batteries(LIBs)gradually declines over time,making it critical to predict the battery’s state of health(SOH)in real-time.This paper presents a model that incorporates health indicators and ensemble Gaussian process regression(EGPR)to predict the SOH of LIBs.Firstly,the degradation process of an LIB is analyzed through indirect health indicators(HIs)derived from voltage and temperature during discharge.Next,the parameters in the EGPR model are optimized using the gannet optimization algorithm(GOA),and the EGPR is employed to estimate the SOH of LIBs.Finally,the proposed model is tested under various experimental scenarios and compared with other machine learning models.The effectiveness of EGPR model is demonstrated using the National Aeronautics and Space Administration(NASA)LIB.The root mean square error(RMSE)is maintained within 0.20%,and the mean absolute error(MAE)is below 0.16%,illustrating the proposed approach’s excellent predictive accuracy and wide applicability.展开更多
Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation indust...Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation industrial processes.This paper addresses the fluctuation problem of CCG through an operational optimization method.Firstly,a density-based affinity propagationalgorithm is proposed so that more ideal working condition categories can be obtained for the complex raw ore properties.Next,a Bayesian network(BN)is applied to explore the relationship between the operational variables and the CCG.Based on the analysis results of BN,a weighted Gaussian process regression model is constructed to predict the CCG that a higher prediction accuracy can be obtained.To ensure the predicted CCG is close to the set value with a smaller magnitude of the operation adjustments and a smaller uncertainty of the prediction results,an index-oriented adaptive differential evolution(IOADE)algorithm is proposed,and the convergence performance of IOADE is superior to the traditional differential evolution and adaptive differential evolution methods.Finally,the effectiveness and feasibility of the proposed methods are verified by the experiments on a copper flotation industrial process.展开更多
The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regressi...The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.展开更多
The conventional single model strategy may be ill- suited due to the multiplicity of operation phases and system uncertainty. A novel global-local discriminant analysis （GLDA） based Gaussian process regression （GPR...The conventional single model strategy may be ill- suited due to the multiplicity of operation phases and system uncertainty. A novel global-local discriminant analysis （GLDA） based Gaussian process regression （GPR） approach is developed for the quality prediction of nonlinear and multiphase batch processes. After the collected data is preprocessed through batchwise unfolding, the hidden Markov model （HMM） is applied to identify different operation phases. A GLDA algorithm is also presented to extract the appropriate process variables highly correlated with the quality variables, decreasing the complexity of modeling. Besides, the multiple local GPR models are built in the reduced- dimensional space for all the identified operation phases. Furthermore, the HMM-based state estimation is used to classify each measurement sample of a test batch into a corresponding phase with the maximal likelihood estimation. Therefore, the local GPR model with respect to specific phase is selected for online prediction. The effectiveness of the proposed prediction approach is demonstrated through the multiphase penicillin fermentation process. The comparison results show that the proposed GLDA-GPR approach is superior to the regular GPR model and the GPR based on HMM （HMM-GPR） model.展开更多
High-precision filtering estimation is one of the key techniques for strapdown inertial navigation system/global navigation satellite system(SINS/GNSS)integrated navigation system,and its estimation plays an important...High-precision filtering estimation is one of the key techniques for strapdown inertial navigation system/global navigation satellite system(SINS/GNSS)integrated navigation system,and its estimation plays an important role in the performance evaluation of the navigation system.Traditional filter estimation methods usually assume that the measurement noise conforms to the Gaussian distribution,without considering the influence of the pollution introduced by the GNSS signal,which is susceptible to external interference.To address this problem,a high-precision filter estimation method using Gaussian process regression(GPR)is proposed to enhance the prediction and estimation capability of the unscented quaternion estimator(USQUE)to improve the navigation accuracy.Based on the advantage of the GPR machine learning function,the estimation performance of the sliding window for model training is measured.This method estimates the output of the observation information source through the measurement window and realizes the robust measurement update of the filter.The combination of GPR and the USQUE algorithm establishes a robust mechanism framework,which enhances the robustness and stability of traditional methods.The results of the trajectory simulation experiment and SINS/GNSS car-mounted tests indicate that the strategy has strong robustness and high estimation accuracy,which demonstrates the effectiveness of the proposed method.展开更多
It remains challenging to effectively estimate the remaining capacity of the secondary lithium-ion batteries that have been widely adopted for consumer electronics,energy storage,and electric vehicles.Herein,by integr...It remains challenging to effectively estimate the remaining capacity of the secondary lithium-ion batteries that have been widely adopted for consumer electronics,energy storage,and electric vehicles.Herein,by integrating regular real-time current short pulse tests with data-driven Gaussian process regression algorithm,an efficient battery estimation has been successfully developed and validated for batteries with capacity ranging from 100%of the state of health(SOH)to below 50%,reaching an average accuracy as high as 95%.Interestingly,the proposed pulse test strategy for battery capacity measurement could reduce test time by more than 80%compared with regular long charge/discharge tests.The short-term features of the current pulse test were selected for an optimal training process.Data at different voltage stages and state of charge(SOC)are collected and explored to find the most suitable estimation model.In particular,we explore the validity of five different machine-learning methods for estimating capacity driven by pulse features,whereas Gaussian process regression with Matern kernel performs the best,providing guidance for future exploration.The new strategy of combining short pulse tests with machine-learning algorithms could further open window for efficiently forecasting lithium-ion battery remaining capacity.展开更多
Cutting tool condition directly affects machining quality and efficiency.In order to avoid severely worn tools used during machining process and fully release the remaining useful life in the meanwhile,a reliable eval...Cutting tool condition directly affects machining quality and efficiency.In order to avoid severely worn tools used during machining process and fully release the remaining useful life in the meanwhile,a reliable evaluation method of remaining useful life of cutting tools is quite necessary.Due to the variation of cutting conditions,it is a challenge to predict remaining useful life of cutting tools by a unified model.In order to address this issue,this paper proposes a method for predicting the remaining useful life of cutting tools in variable cutting conditions based on Gaussian process regression model incorporated with tool wear mechanism,where the predicted value at adjacent moments is constrained to a linear relationship by the covariance matrix of Gaussian model based on the assumption of progressive tool wear process,so the wear process under continuous changing conditions can be modelled.In addition to that,the input feature space and the output of the model are also enhanced by considering the tool wear mechanism for improving prediction accuracy.Machining experiments are performed to verify the proposed method,and the results show that the proposed could improve the prediction of tool remaining useful life significantly.展开更多
The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation proce...The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation processes,may result in large prediction errors and complexity of the soft sensor.Therefore,a dynamic soft sensor based on Gaussian mixture regression(GMR) was proposed to overcome the problems.Two structure parameters,the number of Gaussian components and the order of the model,are crucial to the soft sensor model.To achieve a simple and effective soft sensor,an iterative strategy was proposed to optimize the two structure parameters synchronously.For the aim of comparisons,the proposed dynamic GMR soft sensor and the existing dynamic GPR soft sensor were both investigated to estimate biomass concentration in a Penicillin simulation process and an industrial Erythromycin fermentation process.Results show that the proposed dynamic GMR soft sensor has higher prediction accuracy and is more suitable for dynamic multiphase/multimode fermentation processes.展开更多
The hot deformation behaviors of FGH98 nickel-based powder superalloy were experimentally investigated and theoretically analyzed by Arrhenius models and machine learning(ML).Hot compression tests were conducted with ...The hot deformation behaviors of FGH98 nickel-based powder superalloy were experimentally investigated and theoretically analyzed by Arrhenius models and machine learning(ML).Hot compression tests were conducted with a Gleeble-3800 thermo-mechanical simulation machine on the FGH98 superalloy at strain rates of 0.001–1 s–1 and temperatures of 1025–1175℃.The peak stresses under different deformation conditions were analyzed via the Sellars model and an ML-inspired Gaussian process regression(GPR)model.The prediction of the GPR model outperformed that from the Sellars model.In addition,the stress-strain responses were predicted by the GPR model and tested by experimentally measured stress-strain curves.The results indicate that the developed GPR model has great power with wide generalization capability in the prediction of hot deformation behaviors of FGH98 superalloy,as evidenced by the R2 value higher than 0.99 on the test dataset.展开更多
The resolution of ocean reanalysis datasets is generally low because of the limited resolution of their associated numerical models.Low-resolution ocean reanalysis datasets are therefore usually interpolated to provid...The resolution of ocean reanalysis datasets is generally low because of the limited resolution of their associated numerical models.Low-resolution ocean reanalysis datasets are therefore usually interpolated to provide an initial or boundary field for higher-resolution regional ocean models.However,traditional interpolation methods(nearest neighbor interpolation,bilinear interpolation,and bicubic interpolation)lack physical constraints and can generate significant errors at land-sea boundaries and around islands.In this paper,a machine learning method is used to design an interpolation algorithm based on Gaussian process regression.The method uses a multiscale kernel function to process two-dimensional space meteorological ocean processes and introduces multiscale physical feature information(sea surface wind stress,sea surface heat flux,and ocean current velocity).This greatly improves the spatial resolution of ocean features and the interpolation accuracy.The eff ectiveness of the algorithm was validated through interpolation experiments relating to sea surface temperature(SST).The root mean square error(RMSE)of the interpolation algorithm was 38.9%,43.7%,and 62.4%lower than that of bilinear interpolation,bicubic interpolation,and nearest neighbor interpolation,respectively.The interpolation accuracy was also significantly better in off shore area and around islands.The algorithm has an acceptable runtime cost and good temporal and spatial generalizability.展开更多
Gaussian process(GP)regression is a flexible non-parametric approach to approximate complex models.In many cases,these models correspond to processes with bounded physical properties.Standard GP regression typically r...Gaussian process(GP)regression is a flexible non-parametric approach to approximate complex models.In many cases,these models correspond to processes with bounded physical properties.Standard GP regression typically results in a proxy model which is unbounded for all temporal or spacial points,and thus leaves the possibility of taking on infeasible values.We propose an approach to enforce the physical constraints in a probabilistic way under the GP regression framework.In addition,this new approach reduces the variance in the resulting GP model.展开更多
The prediction of magnitude （M） of reservoir induced earthquake is an important task in earthquake engineering. In this article, we employ a Support Vector Machine （SVM） and Gaussian Process Regression （GPR） for...The prediction of magnitude （M） of reservoir induced earthquake is an important task in earthquake engineering. In this article, we employ a Support Vector Machine （SVM） and Gaussian Process Regression （GPR） for prediction of reservoir induced earthquake M based on reservoir parameters. Comprehensive parameter （E） and maximum reservoir depth] （H） are considered as inputs to the SVM and GPR. We give an equation for determination oil reservoir induced earthquake M. The developed SVM and GPR have been compared with] the Artificial Neural Network （ANN） method. The results show that the developed SVM and] GPR are efficient tools for prediction of reservoir induced earthquake M. /展开更多
In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the ...In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the characteristics of strong coupling,nonlinearity and complex mechanism.To solve these problems,we put forward a multi-output Gaussian process regression(MGPR)model based on the combined kernel function for the polyester esterification process.Since the seasonal and trend decomposition using loess(STL)can extract the periodic and trend characteristics of time series,a combined kernel function based on the STL and the kernel function analysis is constructed for the MGPR.The effectiveness of the proposed model is verified by the actual polyester esterification process data collected from fiber production.展开更多
Gaussian Process Regression (GPR) can be applied to the problem of estimating a spatially-varying field on a regular grid, based on noisy observations made at irregular positions. In cases where the field has a weak t...Gaussian Process Regression (GPR) can be applied to the problem of estimating a spatially-varying field on a regular grid, based on noisy observations made at irregular positions. In cases where the field has a weak time dependence, one may desire to estimate the present-time value of the field using a time window of data that rolls forward as new data become available, leading to a sequence of solution updates. We introduce “rolling GPR” (or moving window GPR) and present a procedure for implementing that is more computationally efficient than solving the full GPR problem at each update. Furthermore, regime shifts (sudden large changes in the field) can be detected by monitoring the change in posterior covariance of the predicted data during the updates, and their detrimental effect is mitigated by shortening the time window as the variance rises, and then decreasing it as it falls (but within prior bounds). A set of numerical experiments is provided that demonstrates the viability of the procedure.展开更多
In engineering practice,it is often necessary to determine functional relationships between dependent and independent variables.These relationships can be highly nonlinear,and classical regression approaches cannot al...In engineering practice,it is often necessary to determine functional relationships between dependent and independent variables.These relationships can be highly nonlinear,and classical regression approaches cannot always provide sufficiently reliable solutions.Nevertheless,Machine Learning(ML)techniques,which offer advanced regression tools to address complicated engineering issues,have been developed and widely explored.This study investigates the selected ML techniques to evaluate their suitability for application in the hot deformation behavior of metallic materials.The ML-based regression methods of Artificial Neural Networks(ANNs),Support Vector Machine(SVM),Decision Tree Regression(DTR),and Gaussian Process Regression(GPR)are applied to mathematically describe hot flow stress curve datasets acquired experimentally for a medium-carbon steel.Although the GPR method has not been used for such a regression task before,the results showed that its performance is the most favorable and practically unrivaled;neither the ANN method nor the other studied ML techniques provide such precise results of the solved regression analysis.展开更多
Foam concrete is widely used in engineering due to its lightweight and high porosity.Its compressive strength,a key performance indicator,is influenced by multiple factors,showing nonlinear variation.As compressive st...Foam concrete is widely used in engineering due to its lightweight and high porosity.Its compressive strength,a key performance indicator,is influenced by multiple factors,showing nonlinear variation.As compressive strength tests for foam concrete take a long time,a fast and accurate prediction method is needed.In recent years,machine learning has become a powerful tool for predicting the compressive strength of cement-based materials.However,existing studies often use a limited number of input parameters,and the prediction accuracy of machine learning models under the influence of multiple parameters and nonlinearity remains unclear.This study selects foam concrete density,water-to-cement ratio(W/C),supplementary cementitious material replacement rate(SCM),fine aggregate to binder ratio(FA/Binder),superplasticizer content(SP),and age of the concrete(Age)as input parameters,with compressive strength as the output.Five different machine learning models were compared,and sensitivity analysis,based on Shapley Additive Explanations(SHAP),was used to assess the contribution of each input parameter.The results show that Gaussian Process Regression(GPR)outperforms the other models,with R2,RMSE,MAE,and MAPE values of 0.95,1.6,0.81,and 0.2,respectively.It is because GPR,optimized through Bayesian methods,better fits complex nonlinear relationships,especially considering a large number of input parameters.Sensitivity analysis indicates that the influence of input parameters on compressive strength decreases in the following order:foam concrete density,W/C,Age,FA/Binder,SP,and SCM.展开更多
Lithium-ion batteries(LIBs)have been widely used in mobile energy storage systems because of their high energy density,long life,and strong environmental adaptability.Accurately estimating the state of health(SOH)for ...Lithium-ion batteries(LIBs)have been widely used in mobile energy storage systems because of their high energy density,long life,and strong environmental adaptability.Accurately estimating the state of health(SOH)for LIBs is promising and has been extensively studied for many years.However,the current prediction methods are susceptible to noise interference,and the estimation accuracy has room for improvement.Motivated by this,this paper proposes a novel battery SOH estimation method,the Beluga Whale Optimization(BWO)and Noise-Input Gaussian Process(NIGP)Stacked Model(BGNSM).This method integrates the BWO-optimized Gaussian Process Regression(GPR)with the NIGP.It combines their predictions using a stacked GPR model which reduces the problem of large input data noise and improves the prediction accuracy.The experimental results show that the BGNSM method has good accuracy,generalization ability,and robustness,and performs well in small sample situations.The Root Mean Square Error(RMSE)and Mean Absolute Error(MAE)are as low as 0.218%and 0.164%,respectively,which is close to 0.At the same time,R-Square(R^(2))is as high as 0.9948,which is close to 1,indicating that the estimated results in this paper are highly consistent with the actual results.展开更多
基金This work was performed under the auspices of the National Nuclear Security Administration of the US Department of Energy at Los Alamos National Laboratory under Contract No.89233218CNA000001The Authors gratefully acknowledge the support of the US Department of Energy National Nuclear Security Administration Advanced Simulation and Computing Program.LA-UR-22-33159.
文摘To accurately model flows with shock waves using staggered-grid Lagrangian hydrodynamics, the artificial viscosity has to be introduced to convert kinetic energy into internal energy, thereby increasing the entropy across shocks. Determining the appropriate strength of the artificial viscosity is an art and strongly depends on the particular problem and experience of the researcher. The objective of this study is to pose the problem of finding the appropriate strength of the artificial viscosity as an optimization problem and solve this problem using machine learning (ML) tools, specifically using surrogate models based on Gaussian Process regression (GPR) and Bayesian analysis. We describe the optimization method and discuss various practical details of its implementation. The shock-containing problems for which we apply this method all have been implemented in the LANL code FLAG (Burton in Connectivity structures and differencing techniques for staggered-grid free-Lagrange hydrodynamics, Tech. Rep. UCRL-JC-110555, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1992, in Consistent finite-volume discretization of hydrodynamic conservation laws for unstructured grids, Tech. Rep. CRL-JC-118788, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1994, Multidimensional discretization of conservation laws for unstructured polyhedral grids, Tech. Rep. UCRL-JC-118306, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1994, in FLAG, a multi-dimensional, multiple mesh, adaptive free-Lagrange, hydrodynamics code. In: NECDC, 1992). First, we apply ML to find optimal values to isolated shock problems of different strengths. Second, we apply ML to optimize the viscosity for a one-dimensional (1D) propagating detonation problem based on Zel’dovich-von Neumann-Doring (ZND) (Fickett and Davis in Detonation: theory and experiment. Dover books on physics. Dover Publications, Mineola, 2000) detonation theory using a reactive burn model. We compare results for default (currently used values in FLAG) and optimized values of the artificial viscosity for these problems demonstrating the potential for significant improvement in the accuracy of computations.
基金funded by the National Key R&D Program of China,Grant No.2024YFF0504904.
文摘The packaging quality of coaxial laser diodes(CLDs)plays a pivotal role in determining their optical performance and long-term reliability.As the core packaging process,high-precision laser welding requires precise control of process parameters to suppress optical power loss.However,the complex nonlinear relationship between welding parameters and optical power loss renders traditional trial-and-error methods inefficient and imprecise.To address this challenge,a physics-informed(PI)and data-driven collaboration approach for welding parameter optimization is proposed.First,thermal-fluid-solid coupling finite element method(FEM)was employed to quantify the sensitivity of welding parameters to physical characteristics,including residual stress.This analysis facilitated the identification of critical factors contributing to optical power loss.Subsequently,a Gaussian process regression(GPR)model incorporating finite element simulation prior knowledge was constructed based on the selected features.By introducing physics-informed kernel(PIK)functions,stress distribution patterns were embedded into the prediction model,achieving high-precision optical power loss prediction.Finally,a Bayesian optimization(BO)algorithm with an adaptive sampling strategy was implemented for efficient parameter space exploration.Experimental results demonstrate that the proposedmethod effectively establishes explicit physical correlations between welding parameters and optical power loss.The optimized welding parameters reduced optical power loss by 34.1%,providing theoretical guidance and technical support for reliable CLD packaging.
基金supported by the National Natural Science Foundation of China(Grant No.42274035)the Major Science and Technology Program for Hubei Province(No.2022AAA002)the Hunan Provincial Land Surveying and Mapping Project(HNGTCH-2023-05)。
文摘Global Navigation Satellite System(GNSS)imaging method(GIM)has been successfully applied to global regions to investigate vertical land motion(VLM)of the Earth's surface.GNSS images derived from conventional GIM method may present fragmented patches and encounter problems caused by excessive smoothing of velocity peaks,leading to difficulty in short-wavelength deformation detection and improper geophysical interpretation.Therefore,we propose a novel GNSS imaging method based on Gaussian process regression with velocity uncertainty considered(GPR-VU).Gaussian processing regression is introduced to describe the spatial relationship between neighboring site pairs as a priori weights and then reweight velocities by known station uncertainties,converting the discrete velocity field to a continuous one.The GPR-VU method is applied to reconstruct VLM images in the southwestern United States and the eastern Qinghai-Xizang Plateau,China,using the GNSS position time series in vertical direction.Compared to the traditional GIM method,the root-mean-square(RMS)and overall accuracy of the confusion matrix of the GPR-VU method increase by 5.0%and 14.0%from the 1°×1°checkerboard test in the southwestern United States.Similarly,the RMS and overall accuracy increase by 33.7%and 15.8%from the 6°×6°checkerboard test in the eastern Qinghai-Xizang Plateau.These checkerboard tests validate the capability to effectively capture the spatiotemporal variations characteristics of VLM and show that this algorithm outperforms the sparsely distributed network in the Qinghai-Xizang Plateau.The images from the GPR-VU method using real data in both regions show significant subsidence around Lassen Volcanic in northern California within a 30 km radius,slight uplift in the northern Sichuan Basin,and subsidence in its central and southern sections.These results further qualitatively illustrate consistency with previous findings.The GPR-VU method outperforms in diminishing the effect by fragmented patches,excessive smoothing of velocity peaks,and detecting potential short-wavelength deformations.
基金supported by Fundamental Research Program of Shanxi Province(No.202203021211088)Shanxi Provincial Natural Science Foundation(No.202204021301049).
文摘The performance of lithium-ion batteries(LIBs)gradually declines over time,making it critical to predict the battery’s state of health(SOH)in real-time.This paper presents a model that incorporates health indicators and ensemble Gaussian process regression(EGPR)to predict the SOH of LIBs.Firstly,the degradation process of an LIB is analyzed through indirect health indicators(HIs)derived from voltage and temperature during discharge.Next,the parameters in the EGPR model are optimized using the gannet optimization algorithm(GOA),and the EGPR is employed to estimate the SOH of LIBs.Finally,the proposed model is tested under various experimental scenarios and compared with other machine learning models.The effectiveness of EGPR model is demonstrated using the National Aeronautics and Space Administration(NASA)LIB.The root mean square error(RMSE)is maintained within 0.20%,and the mean absolute error(MAE)is below 0.16%,illustrating the proposed approach’s excellent predictive accuracy and wide applicability.
基金supported in part by the National Key Research and Development Program of China(2021YFC2902703)the National Natural Science Foundation of China(62173078,61773105,61533007,61873049,61873053,61703085,61374147)。
文摘Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation industrial processes.This paper addresses the fluctuation problem of CCG through an operational optimization method.Firstly,a density-based affinity propagationalgorithm is proposed so that more ideal working condition categories can be obtained for the complex raw ore properties.Next,a Bayesian network(BN)is applied to explore the relationship between the operational variables and the CCG.Based on the analysis results of BN,a weighted Gaussian process regression model is constructed to predict the CCG that a higher prediction accuracy can be obtained.To ensure the predicted CCG is close to the set value with a smaller magnitude of the operation adjustments and a smaller uncertainty of the prediction results,an index-oriented adaptive differential evolution(IOADE)algorithm is proposed,and the convergence performance of IOADE is superior to the traditional differential evolution and adaptive differential evolution methods.Finally,the effectiveness and feasibility of the proposed methods are verified by the experiments on a copper flotation industrial process.
基金supported in part by the National Key Research and Development Program of China(2019YFB1503700)the Hunan Natural Science Foundation-Science and Education Joint Project(2019JJ70063)。
文摘The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.
基金The Fundamental Research Funds for the Central Universities(No.JUDCF12027,JUSRP51323B)the Scientific Innovation Research of College Graduates in Jiangsu Province(No.CXLX12_0734)
文摘The conventional single model strategy may be ill- suited due to the multiplicity of operation phases and system uncertainty. A novel global-local discriminant analysis （GLDA） based Gaussian process regression （GPR） approach is developed for the quality prediction of nonlinear and multiphase batch processes. After the collected data is preprocessed through batchwise unfolding, the hidden Markov model （HMM） is applied to identify different operation phases. A GLDA algorithm is also presented to extract the appropriate process variables highly correlated with the quality variables, decreasing the complexity of modeling. Besides, the multiple local GPR models are built in the reduced- dimensional space for all the identified operation phases. Furthermore, the HMM-based state estimation is used to classify each measurement sample of a test batch into a corresponding phase with the maximal likelihood estimation. Therefore, the local GPR model with respect to specific phase is selected for online prediction. The effectiveness of the proposed prediction approach is demonstrated through the multiphase penicillin fermentation process. The comparison results show that the proposed GLDA-GPR approach is superior to the regular GPR model and the GPR based on HMM （HMM-GPR） model.
基金supported by the National Natural Science Foundation of China(61873275,61703419,425317829).
文摘High-precision filtering estimation is one of the key techniques for strapdown inertial navigation system/global navigation satellite system(SINS/GNSS)integrated navigation system,and its estimation plays an important role in the performance evaluation of the navigation system.Traditional filter estimation methods usually assume that the measurement noise conforms to the Gaussian distribution,without considering the influence of the pollution introduced by the GNSS signal,which is susceptible to external interference.To address this problem,a high-precision filter estimation method using Gaussian process regression(GPR)is proposed to enhance the prediction and estimation capability of the unscented quaternion estimator(USQUE)to improve the navigation accuracy.Based on the advantage of the GPR machine learning function,the estimation performance of the sliding window for model training is measured.This method estimates the output of the observation information source through the measurement window and realizes the robust measurement update of the filter.The combination of GPR and the USQUE algorithm establishes a robust mechanism framework,which enhances the robustness and stability of traditional methods.The results of the trajectory simulation experiment and SINS/GNSS car-mounted tests indicate that the strategy has strong robustness and high estimation accuracy,which demonstrates the effectiveness of the proposed method.
基金support from Shenzhen Municipal Development and Reform Commission(Grant Number:SDRC[2016]172)Shenzhen Science and Technology Program(Grant No.KQTD20170810150821146)Interdisciplinary Research and Innovation Fund of Tsinghua Shenzhen International Graduate School,and Shanghai Shun Feng Machinery Co.,Ltd.
文摘It remains challenging to effectively estimate the remaining capacity of the secondary lithium-ion batteries that have been widely adopted for consumer electronics,energy storage,and electric vehicles.Herein,by integrating regular real-time current short pulse tests with data-driven Gaussian process regression algorithm,an efficient battery estimation has been successfully developed and validated for batteries with capacity ranging from 100%of the state of health(SOH)to below 50%,reaching an average accuracy as high as 95%.Interestingly,the proposed pulse test strategy for battery capacity measurement could reduce test time by more than 80%compared with regular long charge/discharge tests.The short-term features of the current pulse test were selected for an optimal training process.Data at different voltage stages and state of charge(SOC)are collected and explored to find the most suitable estimation model.In particular,we explore the validity of five different machine-learning methods for estimating capacity driven by pulse features,whereas Gaussian process regression with Matern kernel performs the best,providing guidance for future exploration.The new strategy of combining short pulse tests with machine-learning algorithms could further open window for efficiently forecasting lithium-ion battery remaining capacity.
基金National Natural Science Foundation Project of China(Nos.51925505,51921003)。
文摘Cutting tool condition directly affects machining quality and efficiency.In order to avoid severely worn tools used during machining process and fully release the remaining useful life in the meanwhile,a reliable evaluation method of remaining useful life of cutting tools is quite necessary.Due to the variation of cutting conditions,it is a challenge to predict remaining useful life of cutting tools by a unified model.In order to address this issue,this paper proposes a method for predicting the remaining useful life of cutting tools in variable cutting conditions based on Gaussian process regression model incorporated with tool wear mechanism,where the predicted value at adjacent moments is constrained to a linear relationship by the covariance matrix of Gaussian model based on the assumption of progressive tool wear process,so the wear process under continuous changing conditions can be modelled.In addition to that,the input feature space and the output of the model are also enhanced by considering the tool wear mechanism for improving prediction accuracy.Machining experiments are performed to verify the proposed method,and the results show that the proposed could improve the prediction of tool remaining useful life significantly.
基金Supported by the Natural Science Foundation of Jiangsu Province of China(BK20130531)the Priority Academic Program Development of Jiangsu Higher Education Institutions(PAPD[2011]6)Jiangsu Government Scholarship
文摘The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation processes,may result in large prediction errors and complexity of the soft sensor.Therefore,a dynamic soft sensor based on Gaussian mixture regression(GMR) was proposed to overcome the problems.Two structure parameters,the number of Gaussian components and the order of the model,are crucial to the soft sensor model.To achieve a simple and effective soft sensor,an iterative strategy was proposed to optimize the two structure parameters synchronously.For the aim of comparisons,the proposed dynamic GMR soft sensor and the existing dynamic GPR soft sensor were both investigated to estimate biomass concentration in a Penicillin simulation process and an industrial Erythromycin fermentation process.Results show that the proposed dynamic GMR soft sensor has higher prediction accuracy and is more suitable for dynamic multiphase/multimode fermentation processes.
基金supported by the National Natural Science Foundation of China(No.91860115)the Science,Technology,and Innovation Commission of Shenzhen Municipality(No.JSGG20210802093205015).
文摘The hot deformation behaviors of FGH98 nickel-based powder superalloy were experimentally investigated and theoretically analyzed by Arrhenius models and machine learning(ML).Hot compression tests were conducted with a Gleeble-3800 thermo-mechanical simulation machine on the FGH98 superalloy at strain rates of 0.001–1 s–1 and temperatures of 1025–1175℃.The peak stresses under different deformation conditions were analyzed via the Sellars model and an ML-inspired Gaussian process regression(GPR)model.The prediction of the GPR model outperformed that from the Sellars model.In addition,the stress-strain responses were predicted by the GPR model and tested by experimentally measured stress-strain curves.The results indicate that the developed GPR model has great power with wide generalization capability in the prediction of hot deformation behaviors of FGH98 superalloy,as evidenced by the R2 value higher than 0.99 on the test dataset.
基金Supported by the National Natural Science Foundation of China(Nos.41675097,41375113)。
文摘The resolution of ocean reanalysis datasets is generally low because of the limited resolution of their associated numerical models.Low-resolution ocean reanalysis datasets are therefore usually interpolated to provide an initial or boundary field for higher-resolution regional ocean models.However,traditional interpolation methods(nearest neighbor interpolation,bilinear interpolation,and bicubic interpolation)lack physical constraints and can generate significant errors at land-sea boundaries and around islands.In this paper,a machine learning method is used to design an interpolation algorithm based on Gaussian process regression.The method uses a multiscale kernel function to process two-dimensional space meteorological ocean processes and introduces multiscale physical feature information(sea surface wind stress,sea surface heat flux,and ocean current velocity).This greatly improves the spatial resolution of ocean features and the interpolation accuracy.The eff ectiveness of the algorithm was validated through interpolation experiments relating to sea surface temperature(SST).The root mean square error(RMSE)of the interpolation algorithm was 38.9%,43.7%,and 62.4%lower than that of bilinear interpolation,bicubic interpolation,and nearest neighbor interpolation,respectively.The interpolation accuracy was also significantly better in off shore area and around islands.The algorithm has an acceptable runtime cost and good temporal and spatial generalizability.
基金supported by Simons Foundationsupported by the U.S. Department of Energy Office of Science, Office of Advanced Scientific Computing Research as part of Physics-Informed Learning Machines for Multiscale and Multiphysics Problems (PhILMs)
文摘Gaussian process(GP)regression is a flexible non-parametric approach to approximate complex models.In many cases,these models correspond to processes with bounded physical properties.Standard GP regression typically results in a proxy model which is unbounded for all temporal or spacial points,and thus leaves the possibility of taking on infeasible values.We propose an approach to enforce the physical constraints in a probabilistic way under the GP regression framework.In addition,this new approach reduces the variance in the resulting GP model.
文摘The prediction of magnitude （M） of reservoir induced earthquake is an important task in earthquake engineering. In this article, we employ a Support Vector Machine （SVM） and Gaussian Process Regression （GPR） for prediction of reservoir induced earthquake M based on reservoir parameters. Comprehensive parameter （E） and maximum reservoir depth] （H） are considered as inputs to the SVM and GPR. We give an equation for determination oil reservoir induced earthquake M. The developed SVM and GPR have been compared with] the Artificial Neural Network （ANN） method. The results show that the developed SVM and] GPR are efficient tools for prediction of reservoir induced earthquake M. /
基金Natural Science Foundation of Shanghai,China(No.19ZR1402300)。
文摘In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the characteristics of strong coupling,nonlinearity and complex mechanism.To solve these problems,we put forward a multi-output Gaussian process regression(MGPR)model based on the combined kernel function for the polyester esterification process.Since the seasonal and trend decomposition using loess(STL)can extract the periodic and trend characteristics of time series,a combined kernel function based on the STL and the kernel function analysis is constructed for the MGPR.The effectiveness of the proposed model is verified by the actual polyester esterification process data collected from fiber production.
文摘Gaussian Process Regression (GPR) can be applied to the problem of estimating a spatially-varying field on a regular grid, based on noisy observations made at irregular positions. In cases where the field has a weak time dependence, one may desire to estimate the present-time value of the field using a time window of data that rolls forward as new data become available, leading to a sequence of solution updates. We introduce “rolling GPR” (or moving window GPR) and present a procedure for implementing that is more computationally efficient than solving the full GPR problem at each update. Furthermore, regime shifts (sudden large changes in the field) can be detected by monitoring the change in posterior covariance of the predicted data during the updates, and their detrimental effect is mitigated by shortening the time window as the variance rises, and then decreasing it as it falls (but within prior bounds). A set of numerical experiments is provided that demonstrates the viability of the procedure.
基金supported by the SP2024/089 Project by the Faculty of Materials Science and Technology,VˇSB-Technical University of Ostrava.
文摘In engineering practice,it is often necessary to determine functional relationships between dependent and independent variables.These relationships can be highly nonlinear,and classical regression approaches cannot always provide sufficiently reliable solutions.Nevertheless,Machine Learning(ML)techniques,which offer advanced regression tools to address complicated engineering issues,have been developed and widely explored.This study investigates the selected ML techniques to evaluate their suitability for application in the hot deformation behavior of metallic materials.The ML-based regression methods of Artificial Neural Networks(ANNs),Support Vector Machine(SVM),Decision Tree Regression(DTR),and Gaussian Process Regression(GPR)are applied to mathematically describe hot flow stress curve datasets acquired experimentally for a medium-carbon steel.Although the GPR method has not been used for such a regression task before,the results showed that its performance is the most favorable and practically unrivaled;neither the ANN method nor the other studied ML techniques provide such precise results of the solved regression analysis.
基金supported by the Postgraduate Innovation Program of Chongqing University of Science and Technology(Grant No.YKJCX2420605)Research Foundation of Chongqing University of Science and Technology(Grant No.ckrc20241225)+1 种基金Opening Projects of State Key Laboratory of Solid Waste Reuse for Building Materials(Grant No.SWR-2021-005)Science and Technology Research Program of Chongqing Municipal Education Commission(Grant No.KJQN202401510)。
文摘Foam concrete is widely used in engineering due to its lightweight and high porosity.Its compressive strength,a key performance indicator,is influenced by multiple factors,showing nonlinear variation.As compressive strength tests for foam concrete take a long time,a fast and accurate prediction method is needed.In recent years,machine learning has become a powerful tool for predicting the compressive strength of cement-based materials.However,existing studies often use a limited number of input parameters,and the prediction accuracy of machine learning models under the influence of multiple parameters and nonlinearity remains unclear.This study selects foam concrete density,water-to-cement ratio(W/C),supplementary cementitious material replacement rate(SCM),fine aggregate to binder ratio(FA/Binder),superplasticizer content(SP),and age of the concrete(Age)as input parameters,with compressive strength as the output.Five different machine learning models were compared,and sensitivity analysis,based on Shapley Additive Explanations(SHAP),was used to assess the contribution of each input parameter.The results show that Gaussian Process Regression(GPR)outperforms the other models,with R2,RMSE,MAE,and MAPE values of 0.95,1.6,0.81,and 0.2,respectively.It is because GPR,optimized through Bayesian methods,better fits complex nonlinear relationships,especially considering a large number of input parameters.Sensitivity analysis indicates that the influence of input parameters on compressive strength decreases in the following order:foam concrete density,W/C,Age,FA/Binder,SP,and SCM.
基金supported by the National Natural Science Foundation of China(Project No.62273176)“Joint Laboratory Project of Intelligent Power and Control Applications”(Project No.1003-KFA24090)the National Key Research and Development Program of China(Project No.2024YFB3311401).
文摘Lithium-ion batteries(LIBs)have been widely used in mobile energy storage systems because of their high energy density,long life,and strong environmental adaptability.Accurately estimating the state of health(SOH)for LIBs is promising and has been extensively studied for many years.However,the current prediction methods are susceptible to noise interference,and the estimation accuracy has room for improvement.Motivated by this,this paper proposes a novel battery SOH estimation method,the Beluga Whale Optimization(BWO)and Noise-Input Gaussian Process(NIGP)Stacked Model(BGNSM).This method integrates the BWO-optimized Gaussian Process Regression(GPR)with the NIGP.It combines their predictions using a stacked GPR model which reduces the problem of large input data noise and improves the prediction accuracy.The experimental results show that the BGNSM method has good accuracy,generalization ability,and robustness,and performs well in small sample situations.The Root Mean Square Error(RMSE)and Mean Absolute Error(MAE)are as low as 0.218%and 0.164%,respectively,which is close to 0.At the same time,R-Square(R^(2))is as high as 0.9948,which is close to 1,indicating that the estimated results in this paper are highly consistent with the actual results.
