Deep learning algorithm is an effective data mining method and has been used in many fields to solve practical problems.However,the deep learning algorithms often contain some hyper-parameters which may be continuous,...Deep learning algorithm is an effective data mining method and has been used in many fields to solve practical problems.However,the deep learning algorithms often contain some hyper-parameters which may be continuous,integer,or mixed,and are often given based on experience but largely affect the effectiveness of activity recognition.In order to adapt to different hyper-parameter optimization problems,our improved Cuckoo Search(CS)algorithm is proposed to optimize the mixed hyper-parameters in deep learning algorithm.The algorithm optimizes the hyper-parameters in the deep learning model robustly,and intelligently selects the combination of integer type and continuous hyper-parameters that make the model optimal.Then,the mixed hyper-parameter in Convolutional Neural Network(CNN),Long-Short-Term Memory(LSTM)and CNN-LSTM are optimized based on the methodology on the smart home activity recognition datasets.Results show that the methodology can improve the performance of the deep learning model and whether we are experienced or not,we can get a better deep learning model using our method.展开更多
Integrating Bayesian Optimization with Volume of Fluid (VOF) simulations, this work aims to optimize the operational conditions and geometric parameters of T-junction microchannels for target droplet sizes. Bayesian O...Integrating Bayesian Optimization with Volume of Fluid (VOF) simulations, this work aims to optimize the operational conditions and geometric parameters of T-junction microchannels for target droplet sizes. Bayesian Optimization utilizes Gaussian Process (GP) as its core model and employs an adaptive search strategy to efficiently explore and identify optimal combinations of operational parameters within a limited parameter space, thereby enabling rapid optimization of the required parameters to achieve the target droplet size. Traditional methods typically rely on manually selecting a series of operational parameters and conducting multiple simulations to gradually approach the target droplet size. This process is time-consuming and prone to getting trapped in local optima. In contrast, Bayesian Optimization adaptively adjusts its search strategy, significantly reducing computational costs and effectively exploring global optima, thus greatly improving optimization efficiency. Additionally, the study investigates the impact of rectangular rib structures within the T-junction microchannel on droplet generation, revealing how the channel geometry influences droplet formation and size. After determining the target droplet size, we further applied Bayesian Optimization to refine the rib geometry. The integration of Bayesian Optimization with computational fluid dynamics (CFD) offers a promising tool and provides new insights into the optimal design of microfluidic devices.展开更多
The application of Low Earth Orbit(LEO)satellite navigation can enhance geometric structure,increase observations and contribute to navigation and positioning.To improve the performance of the navigation constellation...The application of Low Earth Orbit(LEO)satellite navigation can enhance geometric structure,increase observations and contribute to navigation and positioning.To improve the performance of the navigation constellation in China,this study proposes an optimized method of LEO-enhanced navigation constellation for BDS based on Bayesian optimization algorithm.In this paper,four different optimal LEO constellation configurations are designed,and their enhancements to BDS3 navigation performance are analyzed,including Geometric Dilution of Precision(GDOP),the numbers of visible satellites,and the rapid convergence of precision point positioning(PPP).Additionally,the enhancement advantages in China compared to other regions are further discussed.The results demonstrate that regional enhanced constellations with 70,72,80,and 81 satellites at an altitude of 1000 km can significantly improve the navigation performance of the navigation constellation.Globally,the addition of optimized LEO constellations has reduced the hybrid constellation GDOP by 19.0%,18.3%,19.9%,and 20.3%.Similar results can be obtained using the genetic algorithm(GA),but the computational efficiency of Bayesian optimization algorithm is 53.9%higher than that of the genetic algorithm.The number of visible satellites of enhanced constellations in China has increased by more than four on average,which is better than that in other regions.In the PPP experiment,the convergence time of the stations in China and other regions is shortened by 83.0%and 76.2%,respectively,and the navigation performance of hybrid constellations in China is better.展开更多
Designing compositions and processing of biodegradable magnesium(Mg)alloys to synergistically en-hance mechanical properties and corrosion resistance using conventional trial-and-error method is a challenging task.Thi...Designing compositions and processing of biodegradable magnesium(Mg)alloys to synergistically en-hance mechanical properties and corrosion resistance using conventional trial-and-error method is a challenging task.This study presents a Bayesian optimization(BO)-based multi-objective framework inte-grated with explainable machine learning(ML)to efficiently explore and optimize the high-dimensional design space of biodegradable Mg alloys.Using ultimate tensile strength(UTS),elongation(EL)and cor-rosion potential(E_(corr))as objective properties,the framework balances these conflicting objectives and identifies optimal solutions.A novel biodegradable Mg alloy(Mg-4.6Zn-0.3Y-0.2Mn-0.1Nd-0.1Gd,wt.%)was successfully designed,demonstrating a UTS of 320 MPa,EL of 22%and E_(corr) of−1.60 V(tested in 37℃ simulated body fluid).Compared to JDBM,the UTS has increased by 13 MPa,the EL has improved by 6.1%,and the E_(corr) has risen by 0.02 V.The experimental results presented close agreement with predicted values,validating the proposed framework.The Shapley Additive Explanation method was em-ployed to interpret the ML models,revealing extrusion temperature and Zn content as key parameters driving the optimization design.The strategy provided in this study is universal and offers a potential approach for addressing high-dimensional multi-objective optimization challenges in material develop-ment.展开更多
Advanced programmable metamaterials with heterogeneous microstructures have become increasingly prevalent in scientific and engineering disciplines attributed to their tunable properties.However,exploring the structur...Advanced programmable metamaterials with heterogeneous microstructures have become increasingly prevalent in scientific and engineering disciplines attributed to their tunable properties.However,exploring the structure-property relationship in these materials,including forward prediction and inverse design,presents substantial challenges.The inhomogeneous microstructures significantly complicate traditional analytical or simulation-based approaches.Here,we establish a novel framework that integrates the machine learning(ML)-encoded multiscale computational method for forward prediction and Bayesian optimization for inverse design.Unlike prior end-to-end ML methods limited to specific problems,our framework is both load-independent and geometry-independent.This means that a single training session for a constitutive model suffices to tackle various problems directly,eliminating the need for repeated data collection or training.We demonstrate the efficacy and efficiency of this framework using metamaterials with designable elliptical holes or lattice honeycombs microstructures.Leveraging accelerated forward prediction,we can precisely customize the stiffness and shape of metamaterials under diverse loading scenarios,and extend this capability to multi-objective customization seamlessly.Moreover,we achieve topology optimization for stress alleviation at the crack tip,resulting in a significant reduction of Mises stress by up to 41.2%and yielding a theoretical interpretable pattern.This framework offers a general,efficient and precise tool for analyzing the structure-property relationships of novel metamaterials.展开更多
The packaging quality of coaxial laser diodes(CLDs)plays a pivotal role in determining their optical performance and long-term reliability.As the core packaging process,high-precision laser welding requires precise co...The packaging quality of coaxial laser diodes(CLDs)plays a pivotal role in determining their optical performance and long-term reliability.As the core packaging process,high-precision laser welding requires precise control of process parameters to suppress optical power loss.However,the complex nonlinear relationship between welding parameters and optical power loss renders traditional trial-and-error methods inefficient and imprecise.To address this challenge,a physics-informed(PI)and data-driven collaboration approach for welding parameter optimization is proposed.First,thermal-fluid-solid coupling finite element method(FEM)was employed to quantify the sensitivity of welding parameters to physical characteristics,including residual stress.This analysis facilitated the identification of critical factors contributing to optical power loss.Subsequently,a Gaussian process regression(GPR)model incorporating finite element simulation prior knowledge was constructed based on the selected features.By introducing physics-informed kernel(PIK)functions,stress distribution patterns were embedded into the prediction model,achieving high-precision optical power loss prediction.Finally,a Bayesian optimization(BO)algorithm with an adaptive sampling strategy was implemented for efficient parameter space exploration.Experimental results demonstrate that the proposedmethod effectively establishes explicit physical correlations between welding parameters and optical power loss.The optimized welding parameters reduced optical power loss by 34.1%,providing theoretical guidance and technical support for reliable CLD packaging.展开更多
Ant colony optimization(ACO)is a random search algorithm based on probability calculation.However,the uninformed search strategy has a slow convergence speed.The Bayesian algorithm uses the historical information of t...Ant colony optimization(ACO)is a random search algorithm based on probability calculation.However,the uninformed search strategy has a slow convergence speed.The Bayesian algorithm uses the historical information of the searched point to determine the next search point during the search process,reducing the uncertainty in the random search process.Due to the ability of the Bayesian algorithm to reduce uncertainty,a Bayesian ACO algorithm is proposed in this paper to increase the convergence speed of the conventional ACO algorithm for image edge detection.In addition,this paper has the following two innovations on the basis of the classical algorithm,one of which is to add random perturbations after completing the pheromone update.The second is the use of adaptive pheromone heuristics.Experimental results illustrate that the proposed Bayesian ACO algorithm has faster convergence and higher precision and recall than the traditional ant colony algorithm,due to the improvement of the pheromone utilization rate.Moreover,Bayesian ACO algorithm outperforms the other comparative methods in edge detection task.展开更多
Accurate identification of unknown internal parameters in photovoltaic(PV)cells is crucial and significantly affects the subsequent system-performance analysis and control.However,noise,insufficient data acquisition,a...Accurate identification of unknown internal parameters in photovoltaic(PV)cells is crucial and significantly affects the subsequent system-performance analysis and control.However,noise,insufficient data acquisition,and loss of recorded data can deteriorate the extraction accuracy of unknown parameters.Hence,this study proposes an intelligent parameter-identification strategy that integrates artificial ecosystem optimization(AEO)and a Bayesian neural network(BNN)for PV cell parameter extraction.A BNN is used for data preprocessing,including data denoising and prediction.Furthermore,the AEO algorithm is utilized to identify unknown parameters in the single-diode model(SDM),double-diode model(DDM),and three-diode model(TDM).Nine other metaheuristic algorithms(MhAs)are adopted for an unbiased and comprehensive validation.Simulation results show that BNN-based data preprocessing com-bined with effective MhAs significantly improve the parameter-extraction accuracy and stability compared with methods without data preprocessing.For instance,under denoised data,the accuracies of the SDM,DDM,and TDM increase by 99.69%,99.70%,and 99.69%,respectively,whereas their accuracy improvements increase by 66.71%,59.65%,and 70.36%,respectively.展开更多
Miniature air quality sensors are widely used in urban grid-based monitoring due to their flexibility in deployment and low cost.However,the raw data collected by these devices often suffer from low accuracy caused by...Miniature air quality sensors are widely used in urban grid-based monitoring due to their flexibility in deployment and low cost.However,the raw data collected by these devices often suffer from low accuracy caused by environmental interference and sensor drift,highlighting the need for effective calibration methods to improve data reliability.This study proposes a data correction method based on Bayesian Optimization Support Vector Regression(BO-SVR),which combines the nonlinear modeling capability of Support Vector Regression(SVR)with the efficient global hyperparameter search of Bayesian Optimization.By introducing cross-validation loss as the optimization objective and using Gaussian process modeling with an Expected Improvement acquisition strategy,the approach automatically determines optimal hyperparameters for accurate pollutant concentration prediction.Experiments on real-world micro-sensor datasets demonstrate that BO-SVR outperforms traditional SVR,grid search SVR,and random forest(RF)models across multiple pollutants,including PM_(2.5),PM_(10),CO,NO_(2),SO_(2),and O_(3).The proposed method achieves lower prediction residuals,higher fitting accuracy,and better generalization,offering an efficient and practical solution for enhancing the quality of micro-sensor air monitoring data.展开更多
The Wuding River Basin,situated in the Loess Plateau of northern China,is an ecologically fragile region facing severe soil erosion and imbalanced ecosystem service(ES)functions.However,the mechanisms driving the spat...The Wuding River Basin,situated in the Loess Plateau of northern China,is an ecologically fragile region facing severe soil erosion and imbalanced ecosystem service(ES)functions.However,the mechanisms driving the spatiotemporal evolution of ES functions,as well as the trade-offs and synergies among these functions,remain poorly understood,constraining effective watershed-scale management.To address this challenge,this study quantified four ES functions,i.e.,water yield(WY),carbon storage(CS),habitat quality(HQ),and soil conservation(SC)in the Wuding River Basin from 1990 to 2020 using the Integrated Valuation of Ecosystem Services and Tradeoff(InVEST)model,and proposed an innovative integration of InVEST with a Bayesian Belief Network(BBN)to nonlinearly identify trade-off and synergy relationships among ES functions through probabilistic inference.A trade-off and synergy index(TSI)was developed to assess the spatial interaction intensity among ES functions,while sensitivity and scenario analyses were employed to determine key driving factors,followed by spatial optimization to delineate functional zones.Results revealed distinct spatiotemporal variations:WY increased from 98.69 to 120.52 mm;SC rose to an average of 3.05×10^(4) t/hm^(2);CS remained relatively stable(about 15.50 t/km^(2));and HQ averaged 0.51 with localized declines.The BBN achieved a high accuracy of 81.9%and effectively identified strong synergies between WY and SC,as well as between CS and HQ,while clear trade-offs were observed between WY and SC versus CS and HQ.Sensitivity analysis indicated precipitation(variance reduction of 9.4%),land use(9.8%),and vegetation cover(9.1%)as key driving factors.Spatial optimization further showed that core supply and ecological regulation zones are concentrated in the central-southern and southeastern basin,while ecological strengthening and optimization core zones dominate the central-northern and southeastern margins,highlighting strong spatial heterogeneity.Overall,this study advances ES research by combining process-based quantification with probabilistic modeling,offering a robust framework for studying nonlinear interactions,driving mechanisms,and optimization strategies,and providing a transferable paradigm for watershed-scale ES management and ecological planning in arid and semi-arid areas.展开更多
Due to outstanding performance in cheminformatics,machine learning algorithms have been increasingly used to mine molecular properties and biomedical big data.The performance of machine learning models is known to cri...Due to outstanding performance in cheminformatics,machine learning algorithms have been increasingly used to mine molecular properties and biomedical big data.The performance of machine learning models is known to critically depend on the selection of the hyper-parameter configuration.However,many studies either explored the optimal hyper-parameters per the grid searching method or employed arbitrarily selected hyper-parameters,which can easily lead to achieving a suboptimal hyper-parameter configuration.In this study,Hyperopt library embedding with the Bayesian optimization is employed to find optimal hyper-parameters for different machine learning algorithms.Six drug discovery datasets,including solubility,probe-likeness,h ERG,Chagas disease,tuberculosis,and malaria,are used to compare different machine learning algorithms with ECFP6 fingerprints.This contribution aims to evaluate whether the Bernoulli Na?ve Bayes,logistic linear regression,Ada Boost decision tree,random forest,support vector machine,and deep neural networks algorithms with optimized hyper-parameters can offer any improvement in testing as compared with the referenced models assessed by an array of metrics including AUC,F1-score,Cohen’s kappa,Matthews correlation coefficient,recall,precision,and accuracy.Based on the rank normalized score approach,the Hyperopt models achieve better or comparable performance on 33 out 36 models for different drug discovery datasets,showing significant improvement achieved by employing the Hyperopt library.The open-source code of all the 6 machine learning frameworks employed in the Hyperopt python package is provided to make this approach accessible to more scientists,who are not familiar with writing code.展开更多
In laser wakefield acceleration,injecting an external electron beam at a certain energy is a promising approach for achieving a high-quality electron beam with low energy spread and low emittance.In this paper,the pro...In laser wakefield acceleration,injecting an external electron beam at a certain energy is a promising approach for achieving a high-quality electron beam with low energy spread and low emittance.In this paper,the process of laser wakefield acceleration with an external injection at 10 pC has been studied in simulations.A Bayesian optimization method is used to optimize the key laser and plasma parameters so that the electron beam is accelerated to the expected energy with a small emittance and energy spread growth.The effect of the rising edge of the plasma on the transverse properties of the electron beam is simulated and optimized in order to ensure that the external electron beam is injected into the plasma without significant emittance growth.Finally,a high-quality electron beam with an energy of 1.5 GeV,a normalized transverse emittance of 0.5 mm·mrad and a relative energy spread of 0.5%at 10 pC is obtained.展开更多
Hyperparameters are important for machine learning algorithms since they directly control the behaviors of training algorithms and have a significant effect on the performance of machine learning models. Several techn...Hyperparameters are important for machine learning algorithms since they directly control the behaviors of training algorithms and have a significant effect on the performance of machine learning models. Several techniques have been developed and successfully applied for certain application domains. However, this work demands professional knowledge and expert experience. And sometimes it has to resort to the brute-force search.Therefore, if an efficient hyperparameter optimization algorithm can be developed to optimize any given machine learning method, it will greatly improve the efficiency of machine learning. In this paper, we consider building the relationship between the performance of the machine learning models and their hyperparameters by Gaussian processes. In this way, the hyperparameter tuning problem can be abstracted as an optimization problem and Bayesian optimization is used to solve the problem. Bayesian optimization is based on the Bayesian theorem. It sets a prior over the optimization function and gathers the information from the previous sample to update the posterior of the optimization function. A utility function selects the next sample point to maximize the optimization function.Several experiments were conducted on standard test datasets. Experiment results show that the proposed method can find the best hyperparameters for the widely used machine learning models, such as the random forest algorithm and the neural networks, even multi-grained cascade forest under the consideration of time cost.展开更多
To reach a higher level of autonomy for unmanned combat aerial vehicle(UCAV) in air combat games, this paper builds an autonomous maneuver decision system. In this system,the air combat game is regarded as a Markov pr...To reach a higher level of autonomy for unmanned combat aerial vehicle(UCAV) in air combat games, this paper builds an autonomous maneuver decision system. In this system,the air combat game is regarded as a Markov process, so that the air combat situation can be effectively calculated via Bayesian inference theory. According to the situation assessment result,adaptively adjusts the weights of maneuver decision factors, which makes the objective function more reasonable and ensures the superiority situation for UCAV. As the air combat game is characterized by highly dynamic and a significant amount of uncertainty,to enhance the robustness and effectiveness of maneuver decision results, fuzzy logic is used to build the functions of four maneuver decision factors. Accuracy prediction of opponent aircraft is also essential to ensure making a good decision; therefore, a prediction model of opponent aircraft is designed based on the elementary maneuver method. Finally, the moving horizon optimization strategy is used to effectively model the whole air combat maneuver decision process. Various simulations are performed on typical scenario test and close-in dogfight, the results sufficiently demonstrate the superiority of the designed maneuver decision method.展开更多
Accurate assessment of undrained shear strength(USS)for soft sensitive clays is a great concern in geotechnical engineering practice.This study applies novel data-driven extreme gradient boosting(XGBoost)and random fo...Accurate assessment of undrained shear strength(USS)for soft sensitive clays is a great concern in geotechnical engineering practice.This study applies novel data-driven extreme gradient boosting(XGBoost)and random forest(RF)ensemble learning methods for capturing the relationships between the USS and various basic soil parameters.Based on the soil data sets from TC304 database,a general approach is developed to predict the USS of soft clays using the two machine learning methods above,where five feature variables including the preconsolidation stress(PS),vertical effective stress(VES),liquid limit(LL),plastic limit(PL)and natural water content(W)are adopted.To reduce the dependence on the rule of thumb and inefficient brute-force search,the Bayesian optimization method is applied to determine the appropriate model hyper-parameters of both XGBoost and RF.The developed models are comprehensively compared with three comparison machine learning methods and two transformation models with respect to predictive accuracy and robustness under 5-fold cross-validation(CV).It is shown that XGBoost-based and RF-based methods outperform these approaches.Besides,the XGBoostbased model provides feature importance ranks,which makes it a promising tool in the prediction of geotechnical parameters and enhances the interpretability of model.展开更多
Target distribution in cooperative combat is a difficult and emphases. We build up the optimization model according to the rule of fire distribution. We have researched on the optimization model with BOA. The BOA can ...Target distribution in cooperative combat is a difficult and emphases. We build up the optimization model according to the rule of fire distribution. We have researched on the optimization model with BOA. The BOA can estimate the joint probability distribution of the variables with Bayesian network, and the new candidate solutions also can be generated by the joint distribution. The simulation example verified that the method could be used to solve the complex question, the operation was quickly and the solution was best.展开更多
This paper focuses on a method to solve structural optimization problems using particle swarm optimization （PSO）, surrogate models and Bayesian statistics. PSO is a random/stochastic search algorithm designed to fin...This paper focuses on a method to solve structural optimization problems using particle swarm optimization （PSO）, surrogate models and Bayesian statistics. PSO is a random/stochastic search algorithm designed to find the global optimum. However, PSO needs many evaluations compared to gradient-based optimization. This means PSO increases the analysis costs of structural optimization. One of the methods to reduce computing costs in stochastic optimization is to use approximation techniques. In this work, surrogate models are used, including the response surface method （RSM） and Kriging. When surrogate models are used, there are some errors between exact values and approximated values. These errors decrease the reliability of the optimum values and discard the realistic approximation of using surrogate models. In this paper, Bayesian statistics is used to obtain more reliable results. To verify and confirm the efficiency of the proposed method using surrogate models and Bayesian statistics for stochastic structural optimization, two numerical examples are optimized, and the optimization of a hub sleeve is demonstrated as a practical problem.展开更多
Structure learning of Bayesian networks is a wellresearched but computationally hard task.For learning Bayesian networks,this paper proposes an improved algorithm based on unconstrained optimization and ant colony opt...Structure learning of Bayesian networks is a wellresearched but computationally hard task.For learning Bayesian networks,this paper proposes an improved algorithm based on unconstrained optimization and ant colony optimization（U-ACO-B） to solve the drawbacks of the ant colony optimization（ACO-B）.In this algorithm,firstly,an unconstrained optimization problem is solved to obtain an undirected skeleton,and then the ACO algorithm is used to orientate the edges,thus returning the final structure.In the experimental part of the paper,we compare the performance of the proposed algorithm with ACO-B algorithm.The experimental results show that our method is effective and greatly enhance convergence speed than ACO-B algorithm.展开更多
It is difficult to rapidly design the process parameters of copper alloys by using the traditional trial-and-error method and simultaneously improve the conflicting mechanical and electrical properties.The purpose of ...It is difficult to rapidly design the process parameters of copper alloys by using the traditional trial-and-error method and simultaneously improve the conflicting mechanical and electrical properties.The purpose of this work is to develop a new type of Cu-Ni-Co-Si alloy saving scarce and expensive Co element,in which the Co content is less than half of the lower limit in ASTM standard C70350 alloy,while the properties are as the same level as C70350 alloy.Here we adopted a strategy combining Bayesian optimization machine learning and experimental iteration and quickly designed the secondary deformation-aging parameters(cold rolling deformation 90%,aging temperature 450℃,and aging time 1.25 h)of the new copper alloy with only 32 experiments(27 basic sample data acquisition experiments and 5 iteration experiments),which broke through the barrier of low efficiency and high cost of trial-and-error design of deformation-aging parameters in precipitation strengthened copper alloy.The experimental hardness,tensile strength,and electrical conductivity of the new copper alloy are HV(285±4),(872±3)MPa,and(44.2±0.7)%IACS(international annealed copper standard),reaching the property level of the commercial lead frame C70350 alloy.This work provides a new idea for the rapid design of material process parameters and the simultaneous improvement of mechanical and electrical properties.展开更多
Learning Bayesian network is an NP-hard problem. When the number of variables is large, the process of searching optimal network structure could be very time consuming and tends to return a structure which is local op...Learning Bayesian network is an NP-hard problem. When the number of variables is large, the process of searching optimal network structure could be very time consuming and tends to return a structure which is local optimal.The particle swarm optimization (PSO) was introduced to the problem of learning Bayesian networks and a novel structure learning algorithm using PSO was proposed. To search in directed acyclic graphs spaces efficiently, a discrete PSO algorithm especially for structure learning was proposed based on the characteristics of Bayesian networks. The results of experiments show that our PSO based algorithm is fast for convergence and can obtain better structures compared with genetic algorithm based algorithms.展开更多
基金Supported by the Anhui Province Sports Health Information Monitoring Technology Engineering Research Center Open Project (KF2023012)。
文摘Deep learning algorithm is an effective data mining method and has been used in many fields to solve practical problems.However,the deep learning algorithms often contain some hyper-parameters which may be continuous,integer,or mixed,and are often given based on experience but largely affect the effectiveness of activity recognition.In order to adapt to different hyper-parameter optimization problems,our improved Cuckoo Search(CS)algorithm is proposed to optimize the mixed hyper-parameters in deep learning algorithm.The algorithm optimizes the hyper-parameters in the deep learning model robustly,and intelligently selects the combination of integer type and continuous hyper-parameters that make the model optimal.Then,the mixed hyper-parameter in Convolutional Neural Network(CNN),Long-Short-Term Memory(LSTM)and CNN-LSTM are optimized based on the methodology on the smart home activity recognition datasets.Results show that the methodology can improve the performance of the deep learning model and whether we are experienced or not,we can get a better deep learning model using our method.
基金support from National Key Research and Development Program of China(2023YFC3905400)the Strategic Priority Research Program of the Chinese Academy of Sciences(XDA0490102)National Natural Science Foundation of China(22178354,2242100322408374).
文摘Integrating Bayesian Optimization with Volume of Fluid (VOF) simulations, this work aims to optimize the operational conditions and geometric parameters of T-junction microchannels for target droplet sizes. Bayesian Optimization utilizes Gaussian Process (GP) as its core model and employs an adaptive search strategy to efficiently explore and identify optimal combinations of operational parameters within a limited parameter space, thereby enabling rapid optimization of the required parameters to achieve the target droplet size. Traditional methods typically rely on manually selecting a series of operational parameters and conducting multiple simulations to gradually approach the target droplet size. This process is time-consuming and prone to getting trapped in local optima. In contrast, Bayesian Optimization adaptively adjusts its search strategy, significantly reducing computational costs and effectively exploring global optima, thus greatly improving optimization efficiency. Additionally, the study investigates the impact of rectangular rib structures within the T-junction microchannel on droplet generation, revealing how the channel geometry influences droplet formation and size. After determining the target droplet size, we further applied Bayesian Optimization to refine the rib geometry. The integration of Bayesian Optimization with computational fluid dynamics (CFD) offers a promising tool and provides new insights into the optimal design of microfluidic devices.
基金founded by the National Natural Science Foundation of China(42030109)the Startup Foundation for Doctors of Liaoning Province(2021-BS-275)+4 种基金the Scientific Study Project for Institutes of Higher LearningMinistry of EducationLiaoning Province(LJKMZ20220673)the Project supported by the State Key Laboratory of Geodesy and Earths'DynamicsInnovation Academy for Precision Measurement Science and Technology(SKLGED2023-3-2)。
文摘The application of Low Earth Orbit(LEO)satellite navigation can enhance geometric structure,increase observations and contribute to navigation and positioning.To improve the performance of the navigation constellation in China,this study proposes an optimized method of LEO-enhanced navigation constellation for BDS based on Bayesian optimization algorithm.In this paper,four different optimal LEO constellation configurations are designed,and their enhancements to BDS3 navigation performance are analyzed,including Geometric Dilution of Precision(GDOP),the numbers of visible satellites,and the rapid convergence of precision point positioning(PPP).Additionally,the enhancement advantages in China compared to other regions are further discussed.The results demonstrate that regional enhanced constellations with 70,72,80,and 81 satellites at an altitude of 1000 km can significantly improve the navigation performance of the navigation constellation.Globally,the addition of optimized LEO constellations has reduced the hybrid constellation GDOP by 19.0%,18.3%,19.9%,and 20.3%.Similar results can be obtained using the genetic algorithm(GA),but the computational efficiency of Bayesian optimization algorithm is 53.9%higher than that of the genetic algorithm.The number of visible satellites of enhanced constellations in China has increased by more than four on average,which is better than that in other regions.In the PPP experiment,the convergence time of the stations in China and other regions is shortened by 83.0%and 76.2%,respectively,and the navigation performance of hybrid constellations in China is better.
基金financially supported by the National Natu-ral Science Foundation of China(No.52301133)the China Post-doctoral Science Foundation(No.2023M730276)+1 种基金the Young Elite Scientists Sponsorship Program by China Association for Science and Technology(No.YESS20210415)the Graduate Innovation Pro-gram of Chongqing University of Science and Technology(No.YKJCX2320218).
文摘Designing compositions and processing of biodegradable magnesium(Mg)alloys to synergistically en-hance mechanical properties and corrosion resistance using conventional trial-and-error method is a challenging task.This study presents a Bayesian optimization(BO)-based multi-objective framework inte-grated with explainable machine learning(ML)to efficiently explore and optimize the high-dimensional design space of biodegradable Mg alloys.Using ultimate tensile strength(UTS),elongation(EL)and cor-rosion potential(E_(corr))as objective properties,the framework balances these conflicting objectives and identifies optimal solutions.A novel biodegradable Mg alloy(Mg-4.6Zn-0.3Y-0.2Mn-0.1Nd-0.1Gd,wt.%)was successfully designed,demonstrating a UTS of 320 MPa,EL of 22%and E_(corr) of−1.60 V(tested in 37℃ simulated body fluid).Compared to JDBM,the UTS has increased by 13 MPa,the EL has improved by 6.1%,and the E_(corr) has risen by 0.02 V.The experimental results presented close agreement with predicted values,validating the proposed framework.The Shapley Additive Explanation method was em-ployed to interpret the ML models,revealing extrusion temperature and Zn content as key parameters driving the optimization design.The strategy provided in this study is universal and offers a potential approach for addressing high-dimensional multi-objective optimization challenges in material develop-ment.
基金supported by the National Natural Science Foundation of China (Grant Nos.12102021,12372105,12172026,and 12225201)the Fundamental Research Funds for the Central Universities and the Academic Excellence Foundation of BUAA for PhD Students.
文摘Advanced programmable metamaterials with heterogeneous microstructures have become increasingly prevalent in scientific and engineering disciplines attributed to their tunable properties.However,exploring the structure-property relationship in these materials,including forward prediction and inverse design,presents substantial challenges.The inhomogeneous microstructures significantly complicate traditional analytical or simulation-based approaches.Here,we establish a novel framework that integrates the machine learning(ML)-encoded multiscale computational method for forward prediction and Bayesian optimization for inverse design.Unlike prior end-to-end ML methods limited to specific problems,our framework is both load-independent and geometry-independent.This means that a single training session for a constitutive model suffices to tackle various problems directly,eliminating the need for repeated data collection or training.We demonstrate the efficacy and efficiency of this framework using metamaterials with designable elliptical holes or lattice honeycombs microstructures.Leveraging accelerated forward prediction,we can precisely customize the stiffness and shape of metamaterials under diverse loading scenarios,and extend this capability to multi-objective customization seamlessly.Moreover,we achieve topology optimization for stress alleviation at the crack tip,resulting in a significant reduction of Mises stress by up to 41.2%and yielding a theoretical interpretable pattern.This framework offers a general,efficient and precise tool for analyzing the structure-property relationships of novel metamaterials.
基金funded by the National Key R&D Program of China,Grant No.2024YFF0504904.
文摘The packaging quality of coaxial laser diodes(CLDs)plays a pivotal role in determining their optical performance and long-term reliability.As the core packaging process,high-precision laser welding requires precise control of process parameters to suppress optical power loss.However,the complex nonlinear relationship between welding parameters and optical power loss renders traditional trial-and-error methods inefficient and imprecise.To address this challenge,a physics-informed(PI)and data-driven collaboration approach for welding parameter optimization is proposed.First,thermal-fluid-solid coupling finite element method(FEM)was employed to quantify the sensitivity of welding parameters to physical characteristics,including residual stress.This analysis facilitated the identification of critical factors contributing to optical power loss.Subsequently,a Gaussian process regression(GPR)model incorporating finite element simulation prior knowledge was constructed based on the selected features.By introducing physics-informed kernel(PIK)functions,stress distribution patterns were embedded into the prediction model,achieving high-precision optical power loss prediction.Finally,a Bayesian optimization(BO)algorithm with an adaptive sampling strategy was implemented for efficient parameter space exploration.Experimental results demonstrate that the proposedmethod effectively establishes explicit physical correlations between welding parameters and optical power loss.The optimized welding parameters reduced optical power loss by 34.1%,providing theoretical guidance and technical support for reliable CLD packaging.
基金supported by the National Natural Science Foundation of China(62276055).
文摘Ant colony optimization(ACO)is a random search algorithm based on probability calculation.However,the uninformed search strategy has a slow convergence speed.The Bayesian algorithm uses the historical information of the searched point to determine the next search point during the search process,reducing the uncertainty in the random search process.Due to the ability of the Bayesian algorithm to reduce uncertainty,a Bayesian ACO algorithm is proposed in this paper to increase the convergence speed of the conventional ACO algorithm for image edge detection.In addition,this paper has the following two innovations on the basis of the classical algorithm,one of which is to add random perturbations after completing the pheromone update.The second is the use of adaptive pheromone heuristics.Experimental results illustrate that the proposed Bayesian ACO algorithm has faster convergence and higher precision and recall than the traditional ant colony algorithm,due to the improvement of the pheromone utilization rate.Moreover,Bayesian ACO algorithm outperforms the other comparative methods in edge detection task.
基金supported by the National Natural Science Foundation of China(62263014)the Yunnan Provincial Basic Research Project(202301AT070443,202401AT070344).
文摘Accurate identification of unknown internal parameters in photovoltaic(PV)cells is crucial and significantly affects the subsequent system-performance analysis and control.However,noise,insufficient data acquisition,and loss of recorded data can deteriorate the extraction accuracy of unknown parameters.Hence,this study proposes an intelligent parameter-identification strategy that integrates artificial ecosystem optimization(AEO)and a Bayesian neural network(BNN)for PV cell parameter extraction.A BNN is used for data preprocessing,including data denoising and prediction.Furthermore,the AEO algorithm is utilized to identify unknown parameters in the single-diode model(SDM),double-diode model(DDM),and three-diode model(TDM).Nine other metaheuristic algorithms(MhAs)are adopted for an unbiased and comprehensive validation.Simulation results show that BNN-based data preprocessing com-bined with effective MhAs significantly improve the parameter-extraction accuracy and stability compared with methods without data preprocessing.For instance,under denoised data,the accuracies of the SDM,DDM,and TDM increase by 99.69%,99.70%,and 99.69%,respectively,whereas their accuracy improvements increase by 66.71%,59.65%,and 70.36%,respectively.
文摘Miniature air quality sensors are widely used in urban grid-based monitoring due to their flexibility in deployment and low cost.However,the raw data collected by these devices often suffer from low accuracy caused by environmental interference and sensor drift,highlighting the need for effective calibration methods to improve data reliability.This study proposes a data correction method based on Bayesian Optimization Support Vector Regression(BO-SVR),which combines the nonlinear modeling capability of Support Vector Regression(SVR)with the efficient global hyperparameter search of Bayesian Optimization.By introducing cross-validation loss as the optimization objective and using Gaussian process modeling with an Expected Improvement acquisition strategy,the approach automatically determines optimal hyperparameters for accurate pollutant concentration prediction.Experiments on real-world micro-sensor datasets demonstrate that BO-SVR outperforms traditional SVR,grid search SVR,and random forest(RF)models across multiple pollutants,including PM_(2.5),PM_(10),CO,NO_(2),SO_(2),and O_(3).The proposed method achieves lower prediction residuals,higher fitting accuracy,and better generalization,offering an efficient and practical solution for enhancing the quality of micro-sensor air monitoring data.
基金supported by the Science and Technology Project of Shaanxi Province Water Conservancy,China(2025slkj-10)the Natural Science Basic Research Program of Shaanxi Province,China(S2025-JC-QN-2416).
文摘The Wuding River Basin,situated in the Loess Plateau of northern China,is an ecologically fragile region facing severe soil erosion and imbalanced ecosystem service(ES)functions.However,the mechanisms driving the spatiotemporal evolution of ES functions,as well as the trade-offs and synergies among these functions,remain poorly understood,constraining effective watershed-scale management.To address this challenge,this study quantified four ES functions,i.e.,water yield(WY),carbon storage(CS),habitat quality(HQ),and soil conservation(SC)in the Wuding River Basin from 1990 to 2020 using the Integrated Valuation of Ecosystem Services and Tradeoff(InVEST)model,and proposed an innovative integration of InVEST with a Bayesian Belief Network(BBN)to nonlinearly identify trade-off and synergy relationships among ES functions through probabilistic inference.A trade-off and synergy index(TSI)was developed to assess the spatial interaction intensity among ES functions,while sensitivity and scenario analyses were employed to determine key driving factors,followed by spatial optimization to delineate functional zones.Results revealed distinct spatiotemporal variations:WY increased from 98.69 to 120.52 mm;SC rose to an average of 3.05×10^(4) t/hm^(2);CS remained relatively stable(about 15.50 t/km^(2));and HQ averaged 0.51 with localized declines.The BBN achieved a high accuracy of 81.9%and effectively identified strong synergies between WY and SC,as well as between CS and HQ,while clear trade-offs were observed between WY and SC versus CS and HQ.Sensitivity analysis indicated precipitation(variance reduction of 9.4%),land use(9.8%),and vegetation cover(9.1%)as key driving factors.Spatial optimization further showed that core supply and ecological regulation zones are concentrated in the central-southern and southeastern basin,while ecological strengthening and optimization core zones dominate the central-northern and southeastern margins,highlighting strong spatial heterogeneity.Overall,this study advances ES research by combining process-based quantification with probabilistic modeling,offering a robust framework for studying nonlinear interactions,driving mechanisms,and optimization strategies,and providing a transferable paradigm for watershed-scale ES management and ecological planning in arid and semi-arid areas.
基金financial support provided by the National Key Research and Development Project(2019YFC0214403)Chongqing Joint Chinese Medicine Scientific Research Project(2021ZY023984)。
文摘Due to outstanding performance in cheminformatics,machine learning algorithms have been increasingly used to mine molecular properties and biomedical big data.The performance of machine learning models is known to critically depend on the selection of the hyper-parameter configuration.However,many studies either explored the optimal hyper-parameters per the grid searching method or employed arbitrarily selected hyper-parameters,which can easily lead to achieving a suboptimal hyper-parameter configuration.In this study,Hyperopt library embedding with the Bayesian optimization is employed to find optimal hyper-parameters for different machine learning algorithms.Six drug discovery datasets,including solubility,probe-likeness,h ERG,Chagas disease,tuberculosis,and malaria,are used to compare different machine learning algorithms with ECFP6 fingerprints.This contribution aims to evaluate whether the Bernoulli Na?ve Bayes,logistic linear regression,Ada Boost decision tree,random forest,support vector machine,and deep neural networks algorithms with optimized hyper-parameters can offer any improvement in testing as compared with the referenced models assessed by an array of metrics including AUC,F1-score,Cohen’s kappa,Matthews correlation coefficient,recall,precision,and accuracy.Based on the rank normalized score approach,the Hyperopt models achieve better or comparable performance on 33 out 36 models for different drug discovery datasets,showing significant improvement achieved by employing the Hyperopt library.The open-source code of all the 6 machine learning frameworks employed in the Hyperopt python package is provided to make this approach accessible to more scientists,who are not familiar with writing code.
基金supported by Science and Technology Major Project of Hubei Province in China(No.2021AFB001)。
文摘In laser wakefield acceleration,injecting an external electron beam at a certain energy is a promising approach for achieving a high-quality electron beam with low energy spread and low emittance.In this paper,the process of laser wakefield acceleration with an external injection at 10 pC has been studied in simulations.A Bayesian optimization method is used to optimize the key laser and plasma parameters so that the electron beam is accelerated to the expected energy with a small emittance and energy spread growth.The effect of the rising edge of the plasma on the transverse properties of the electron beam is simulated and optimized in order to ensure that the external electron beam is injected into the plasma without significant emittance growth.Finally,a high-quality electron beam with an energy of 1.5 GeV,a normalized transverse emittance of 0.5 mm·mrad and a relative energy spread of 0.5%at 10 pC is obtained.
基金supported in part by the National Natural Science Foundation of China under Grant No.61503059
文摘Hyperparameters are important for machine learning algorithms since they directly control the behaviors of training algorithms and have a significant effect on the performance of machine learning models. Several techniques have been developed and successfully applied for certain application domains. However, this work demands professional knowledge and expert experience. And sometimes it has to resort to the brute-force search.Therefore, if an efficient hyperparameter optimization algorithm can be developed to optimize any given machine learning method, it will greatly improve the efficiency of machine learning. In this paper, we consider building the relationship between the performance of the machine learning models and their hyperparameters by Gaussian processes. In this way, the hyperparameter tuning problem can be abstracted as an optimization problem and Bayesian optimization is used to solve the problem. Bayesian optimization is based on the Bayesian theorem. It sets a prior over the optimization function and gathers the information from the previous sample to update the posterior of the optimization function. A utility function selects the next sample point to maximize the optimization function.Several experiments were conducted on standard test datasets. Experiment results show that the proposed method can find the best hyperparameters for the widely used machine learning models, such as the random forest algorithm and the neural networks, even multi-grained cascade forest under the consideration of time cost.
基金supported by the National Natural Science Foundation of China(61601505)the Aeronautical Science Foundation of China(20155196022)the Shaanxi Natural Science Foundation of China(2016JQ6050)
文摘To reach a higher level of autonomy for unmanned combat aerial vehicle(UCAV) in air combat games, this paper builds an autonomous maneuver decision system. In this system,the air combat game is regarded as a Markov process, so that the air combat situation can be effectively calculated via Bayesian inference theory. According to the situation assessment result,adaptively adjusts the weights of maneuver decision factors, which makes the objective function more reasonable and ensures the superiority situation for UCAV. As the air combat game is characterized by highly dynamic and a significant amount of uncertainty,to enhance the robustness and effectiveness of maneuver decision results, fuzzy logic is used to build the functions of four maneuver decision factors. Accuracy prediction of opponent aircraft is also essential to ensure making a good decision; therefore, a prediction model of opponent aircraft is designed based on the elementary maneuver method. Finally, the moving horizon optimization strategy is used to effectively model the whole air combat maneuver decision process. Various simulations are performed on typical scenario test and close-in dogfight, the results sufficiently demonstrate the superiority of the designed maneuver decision method.
基金financial support from High-end Foreign Expert Introduction program(No.G20190022002)Chongqing Construction Science and Technology Plan Project(2019-0045)as well as Chongqing Engineering Research Center of Disaster Prevention&Control for Banks and Structures in Three Gorges Reservoir Area(Nos.SXAPGC18ZD01 and SXAPGC18YB03)。
文摘Accurate assessment of undrained shear strength(USS)for soft sensitive clays is a great concern in geotechnical engineering practice.This study applies novel data-driven extreme gradient boosting(XGBoost)and random forest(RF)ensemble learning methods for capturing the relationships between the USS and various basic soil parameters.Based on the soil data sets from TC304 database,a general approach is developed to predict the USS of soft clays using the two machine learning methods above,where five feature variables including the preconsolidation stress(PS),vertical effective stress(VES),liquid limit(LL),plastic limit(PL)and natural water content(W)are adopted.To reduce the dependence on the rule of thumb and inefficient brute-force search,the Bayesian optimization method is applied to determine the appropriate model hyper-parameters of both XGBoost and RF.The developed models are comprehensively compared with three comparison machine learning methods and two transformation models with respect to predictive accuracy and robustness under 5-fold cross-validation(CV).It is shown that XGBoost-based and RF-based methods outperform these approaches.Besides,the XGBoostbased model provides feature importance ranks,which makes it a promising tool in the prediction of geotechnical parameters and enhances the interpretability of model.
基金This project was supported by the Fund of College Doctor Degree (20020699009)
文摘Target distribution in cooperative combat is a difficult and emphases. We build up the optimization model according to the rule of fire distribution. We have researched on the optimization model with BOA. The BOA can estimate the joint probability distribution of the variables with Bayesian network, and the new candidate solutions also can be generated by the joint distribution. The simulation example verified that the method could be used to solve the complex question, the operation was quickly and the solution was best.
文摘This paper focuses on a method to solve structural optimization problems using particle swarm optimization （PSO）, surrogate models and Bayesian statistics. PSO is a random/stochastic search algorithm designed to find the global optimum. However, PSO needs many evaluations compared to gradient-based optimization. This means PSO increases the analysis costs of structural optimization. One of the methods to reduce computing costs in stochastic optimization is to use approximation techniques. In this work, surrogate models are used, including the response surface method （RSM） and Kriging. When surrogate models are used, there are some errors between exact values and approximated values. These errors decrease the reliability of the optimum values and discard the realistic approximation of using surrogate models. In this paper, Bayesian statistics is used to obtain more reliable results. To verify and confirm the efficiency of the proposed method using surrogate models and Bayesian statistics for stochastic structural optimization, two numerical examples are optimized, and the optimization of a hub sleeve is demonstrated as a practical problem.
基金supported by the National Natural Science Foundation of China (60974082,11171094)the Fundamental Research Funds for the Central Universities (K50510700004)+1 种基金the Foundation and Advanced Technology Research Program of Henan Province (102300410264)the Basic Research Program of the Education Department of Henan Province (2010A110010)
文摘Structure learning of Bayesian networks is a wellresearched but computationally hard task.For learning Bayesian networks,this paper proposes an improved algorithm based on unconstrained optimization and ant colony optimization（U-ACO-B） to solve the drawbacks of the ant colony optimization（ACO-B）.In this algorithm,firstly,an unconstrained optimization problem is solved to obtain an undirected skeleton,and then the ACO algorithm is used to orientate the edges,thus returning the final structure.In the experimental part of the paper,we compare the performance of the proposed algorithm with ACO-B algorithm.The experimental results show that our method is effective and greatly enhance convergence speed than ACO-B algorithm.
基金supported by the National Key Research and Development Program of China(No.2021YFB 3803101)the National Natural Science Foundation of China(Nos.52090041,52022011,and 51974028)。
文摘It is difficult to rapidly design the process parameters of copper alloys by using the traditional trial-and-error method and simultaneously improve the conflicting mechanical and electrical properties.The purpose of this work is to develop a new type of Cu-Ni-Co-Si alloy saving scarce and expensive Co element,in which the Co content is less than half of the lower limit in ASTM standard C70350 alloy,while the properties are as the same level as C70350 alloy.Here we adopted a strategy combining Bayesian optimization machine learning and experimental iteration and quickly designed the secondary deformation-aging parameters(cold rolling deformation 90%,aging temperature 450℃,and aging time 1.25 h)of the new copper alloy with only 32 experiments(27 basic sample data acquisition experiments and 5 iteration experiments),which broke through the barrier of low efficiency and high cost of trial-and-error design of deformation-aging parameters in precipitation strengthened copper alloy.The experimental hardness,tensile strength,and electrical conductivity of the new copper alloy are HV(285±4),(872±3)MPa,and(44.2±0.7)%IACS(international annealed copper standard),reaching the property level of the commercial lead frame C70350 alloy.This work provides a new idea for the rapid design of material process parameters and the simultaneous improvement of mechanical and electrical properties.
基金National Natural Science Foundation of Chi-na (No.60374071)Zhenjiang Commissionof Science and Technology ( No.2003C11009)
文摘Learning Bayesian network is an NP-hard problem. When the number of variables is large, the process of searching optimal network structure could be very time consuming and tends to return a structure which is local optimal.The particle swarm optimization (PSO) was introduced to the problem of learning Bayesian networks and a novel structure learning algorithm using PSO was proposed. To search in directed acyclic graphs spaces efficiently, a discrete PSO algorithm especially for structure learning was proposed based on the characteristics of Bayesian networks. The results of experiments show that our PSO based algorithm is fast for convergence and can obtain better structures compared with genetic algorithm based algorithms.
