In this paper,an adaptive cubic regularisation algorithm based on affine scaling methods(ARCBASM)is proposed for solving nonlinear equality constrained programming with nonnegative constraints on variables.From the op...In this paper,an adaptive cubic regularisation algorithm based on affine scaling methods(ARCBASM)is proposed for solving nonlinear equality constrained programming with nonnegative constraints on variables.From the optimality conditions of the problem,we introduce appropriate affine matrix and construct an affine scaling ARC subproblem with linearized constraints.Composite step methods and reduced Hessian methods are applied to tackle the linearized constraints.As a result,a standard unconstrained ARC subproblem is deduced and its solution can supply sufficient decrease.The fraction to the boundary rule maintains the strict feasibility(for nonnegative constraints on variables)of every iteration point.Reflection techniques are employed to prevent the iterations from approaching zero too early.Under mild assumptions,global convergence of the algorithm is analysed.Preliminary numerical results are reported.展开更多
In a wide range of engineering applications,complex constrained multi-objective optimization problems(CMOPs)present significant challenges,as the complexity of constraints often hampers algorithmic convergence and red...In a wide range of engineering applications,complex constrained multi-objective optimization problems(CMOPs)present significant challenges,as the complexity of constraints often hampers algorithmic convergence and reduces population diversity.To address these challenges,we propose a novel algorithm named Constraint IntensityDriven Evolutionary Multitasking(CIDEMT),which employs a two-stage,tri-task framework to dynamically integrates problem structure and knowledge transfer.In the first stage,three cooperative tasks are designed to explore the Constrained Pareto Front(CPF),the Unconstrained Pareto Front(UPF),and theε-relaxed constraint boundary,respectively.A CPF-UPF relationship classifier is employed to construct a problem-type-aware evolutionary strategy pool.At the end of the first stage,each task selects strategies from this strategy pool based on the specific type of problem,thereby guiding the subsequent evolutionary process.In the second stage,while each task continues to evolve,aτ-driven knowledge transfer mechanism is introduced to selectively incorporate effective solutions across tasks.enhancing the convergence and feasibility of the main task.Extensive experiments conducted on 32 benchmark problems from three test suites(LIRCMOP,DASCMOP,and DOC)demonstrate that CIDEMT achieves the best Inverted Generational Distance(IGD)values on 24 problems and the best Hypervolume values(HV)on 22 problems.Furthermore,CIDEMT significantly outperforms six state-of-the-art constrained multi-objective evolutionary algorithms(CMOEAs).These results confirm CIDEMT’s superiority in promoting convergence,diversity,and robustness in solving complex CMOPs.展开更多
Solving constrained multi-objective optimization problems(CMOPs)is a challenging task due to the presence of multiple conflicting objectives and intricate constraints.In order to better address CMOPs and achieve a bal...Solving constrained multi-objective optimization problems(CMOPs)is a challenging task due to the presence of multiple conflicting objectives and intricate constraints.In order to better address CMOPs and achieve a balance between objectives and constraints,existing constrained multi-objective evolutionary algorithms(CMOEAs)predominantly focus on devising various strategies by leveraging the relationships between objectives and constraints,and the designed strategies usually are effective for the problems with simple constraints.However,these methods most ignore the relationship between decision variables and constraints.In fact,the essence of optimization is to find appropriate decision variables to meet various complex constraints.Therefore,it is hoped that the problem can be analyzed from the perspective of decision variables,so as to obtain more excellent results.Based on the above motivation,this paper proposes a decision variables classification approach,according to the relationship between decision variables and constraints,variables are divided into constraint-related(CR)variables and constraintindependent(CI)variables.Consequently,by optimizing these two types of variables independently,the population can sustain a favorable balance between feasibility and diversity.Furthermore,specific offspring generation strategies are proposed for the two categories of decision variables in order to achieve rapid convergence while maintaining population diversity.Experimental results on 31 test problems as well as 20 real-world problems demonstrate that the proposed algorithm is competitive compared to some state-of-the-art constrained multi-objective optimization algorithms.展开更多
This paper investigates a class of constrained distributed zeroth-order optimization(ZOO) problems over timevarying unbalanced graphs while ensuring privacy preservation among individual agents. Not taking into accoun...This paper investigates a class of constrained distributed zeroth-order optimization(ZOO) problems over timevarying unbalanced graphs while ensuring privacy preservation among individual agents. Not taking into account recent progress and addressing these concerns separately, there remains a lack of solutions offering theoretical guarantees for both privacy protection and constrained ZOO over time-varying unbalanced graphs.We hereby propose a novel algorithm, termed the differential privacy(DP) distributed push-sum based zeroth-order constrained optimization algorithm(DP-ZOCOA). Operating over time-varying unbalanced graphs, DP-ZOCOA obviates the need for supplemental suboptimization problem computations, thereby reducing overhead in comparison to distributed primary-dual methods. DP-ZOCOA is specifically tailored to tackle constrained ZOO problems over time-varying unbalanced graphs,offering a guarantee of convergence to the optimal solution while robustly preserving privacy. Moreover, we provide rigorous proofs of convergence and privacy for DP-ZOCOA, underscoring its efficacy in attaining optimal convergence without constraints. To enhance its applicability, we incorporate DP-ZOCOA into the federated learning framework and formulate a decentralized zeroth-order constrained federated learning algorithm(ZOCOA-FL) to address challenges stemming from the timevarying imbalance of communication topology. Finally, the performance and effectiveness of the proposed algorithms are thoroughly evaluated through simulations on distributed least squares(DLS) and decentralized federated learning(DFL) tasks.展开更多
In recent years,numerous recurrent neural network(RNN)models have been reported for solving time-dependent nonlinear optimization problems.However,few existing RNN models simultaneously involve nonlinear equality cons...In recent years,numerous recurrent neural network(RNN)models have been reported for solving time-dependent nonlinear optimization problems.However,few existing RNN models simultaneously involve nonlinear equality constraints,direct discretization,and noise suppression.This limitation presents challenges when existing models are applied to practical engineering problems.Additionally,most current discrete-time RNN models are derived from continuous-time models,which may not perform well for solving essentially discrete problems.To handle these issues,a robust direct-discretized RNN(RDD-RNN)model is proposed to efficiently realize time-dependent optimization constrained by nonlinear equalities(TDOCNE)in the presence of various time-dependent noises.Theoretical analyses are provided to reveal that the proposed RDD-RNN model possesses excellent convergence and noise-suppressing capability.Furthermore,numerical experiments and manipulator control instances are conducted and analyzed to validate the superior robustness of the proposed RDD-RNN model under various time-dependent noises,particularly quadratic polynomial noise.Eventually,small target detection experiments further demonstrate the practicality of the RDD-RNN model in image processing applications.展开更多
There are three common types of predictability problems in weather and climate, which each involve different constrained nonlinear optimization problems： the lower bound of maximum predictable time, the upper bound o...There are three common types of predictability problems in weather and climate, which each involve different constrained nonlinear optimization problems： the lower bound of maximum predictable time, the upper bound of maximum prediction error, and the lower bound of maximum allowable initial error and parameter error. Highly effcient algorithms have been developed to solve the second optimization problem. And this optimization problem can be used in realistic models for weather and climate to study the upper bound of the maximum prediction error. Although a filtering strategy has been adopted to solve the other two problems, direct solutions are very time-consuming even for a very simple model, which therefore limits the applicability of these two predictability problems in realistic models. In this paper, a new strategy is designed to solve these problems, involving the use of the existing highly effcient algorithms for the second predictability problem in particular. Furthermore, a series of comparisons between the older filtering strategy and the new method are performed. It is demonstrated that the new strategy not only outputs the same results as the old one, but is also more computationally effcient. This would suggest that it is possible to study the predictability problems associated with these two nonlinear optimization problems in realistic forecast models of weather or climate.展开更多
Most of the current evolutionary algorithms for constrained optimization algorithm are low computational efficiency. In order to improve efficiency, an improved differential evolution with shrinking space technique an...Most of the current evolutionary algorithms for constrained optimization algorithm are low computational efficiency. In order to improve efficiency, an improved differential evolution with shrinking space technique and adaptive trade-off model, named ATMDE, is proposed to solve constrained optimization problems. The proposed ATMDE algorithm employs an improved differential evolution as the search optimizer to generate new offspring individuals into evolutionary population. For the con- straints, the adaptive trade-off model as one of the most important constraint-handling techniques is employed to select better individuals to retain into the next population, which could effectively handle multiple constraints. Then the shrinking space technique is designed to shrink the search region according to feedback information in order to improve computational efficiency without losing accuracy. The improved DE algorithm introduces three different mutant strategies to generate different offspring into evo- lutionary population. Moreover, a new mutant strategy called ＂DE/rand/best/l＂ is constructed to generate new individuals according to the feasibility proportion ofcurrent population. Finally, the effectiveness of the pro- posed method is verified by a suite of benchmark functions and practical engineering problems. This research presents a constrained evolutionary algorithm with high efficiency and accuracy for constrained optimization problems.展开更多
A new SQP type feasible method for inequality constrained optimization is presented,it is a combination of a master algorithm and an auxiliary algorithm which is taken only in finite iterations.The directions of the m...A new SQP type feasible method for inequality constrained optimization is presented,it is a combination of a master algorithm and an auxiliary algorithm which is taken only in finite iterations.The directions of the master algorithm are generated by only one quadratic programming, and its step\|size is always one, the directions of the auxiliary algorithm are new “second\|order” feasible descent. Under suitable assumptions,the algorithm is proved to possess global and strong convergence, superlinear and quadratic convergence.展开更多
Selecting the optimal machining parameters for impeller surface is a challenging task in the automatic manufacturing industry, due to its free-form surface and deep-crooked flow channel.Existing experimental methods r...Selecting the optimal machining parameters for impeller surface is a challenging task in the automatic manufacturing industry, due to its free-form surface and deep-crooked flow channel.Existing experimental methods require lots of machining experiments and off-line tests, which may lead to high machining cost and low efficiency. This paper proposes a novel method of machining parameters optimization for an impeller based on the on-machine measuring technique. The absolute average error and standard deviation of the measured points are used to define the grey relational grade for reconstructing the objective function, and the complex problem of multi-objective optimization is simplified into a problem of single-objective optimization. Then, by comparing the values of the defined grey relational grade in a designed orthogonal experiment, the optimal combination of the machining parameters is obtained. The experiment-solving process of the objective function corresponds to the minimization of the used errors, which is advantageous to reducing the machining error. The proposed method is efficient and low-cost, since it does not require re-clamping the workpiece for off-line tests. Its effectiveness is verified by an on-machine inspection experiment of the impeller blade.展开更多
Recent research on deterministic methods for circulating cooling water systems optimization has been well developed. However, the actual operating conditions of the system are mostly variable, so the system obtained u...Recent research on deterministic methods for circulating cooling water systems optimization has been well developed. However, the actual operating conditions of the system are mostly variable, so the system obtained under deterministic conditions may not be stable and economical. This paper studies the optimization of circulating cooling water systems under uncertain circumstance. To improve the reliability of the system and reduce the water and energy consumption, the influence of different uncertain parameters is taken into consideration. The chance constrained programming method is used to build a model under uncertain conditions, where the confidence level indicates the degree of constraint violation. Probability distribution functions are used to describe the form of uncertain parameters. The objective is to minimize the total cost and obtain the optimal cooling network configuration simultaneously.An algorithm based on Monte Carlo method is proposed, and GAMS software is used to solve the mixed integer nonlinear programming model. A case is optimized to verify the validity of the model. Compared with the deterministic optimization method, the results show that when considering the different types of uncertain parameters, a system with better economy and reliability can be obtained(total cost can be reduced at least 2%).展开更多
A new method to solve dynamic nonlinear constrained optimization problems （DNCOP） is proposed. First, the time （environment） variable period of DNCOP is divided into several equal subperiods. In each subperiod, th...A new method to solve dynamic nonlinear constrained optimization problems （DNCOP） is proposed. First, the time （environment） variable period of DNCOP is divided into several equal subperiods. In each subperiod, the DNCOP is approximated by a static nonlinear constrained optimization problem （SNCOP）. Second, for each SNCOP, inspired by the idea of multiobjective optimization, it is transformed into a static bi-objective optimization problem. As a result, the original DNCOP is approximately transformed into several static bi-objective optimization problems. Third, a new multiobjective evolutionary algorithm is proposed based on a new selection operator and an improved nonuniformity mutation operator. The simulation results indicate that the proposed algorithm is effective for DNCOP.展开更多
Constrained multi-objective optimization problems(CMOPs) include the optimization of objective functions and the satisfaction of constraint conditions, which challenge the solvers.To solve CMOPs, constrained multi-obj...Constrained multi-objective optimization problems(CMOPs) include the optimization of objective functions and the satisfaction of constraint conditions, which challenge the solvers.To solve CMOPs, constrained multi-objective evolutionary algorithms(CMOEAs) have been developed. However, most of them tend to converge into local areas due to the loss of diversity. Evolutionary multitasking(EMT) is new model of solving complex optimization problems, through the knowledge transfer between the source task and other related tasks. Inspired by EMT, this paper develops a new EMT-based CMOEA to solve CMOPs, in which the main task, a global auxiliary task, and a local auxiliary task are created and optimized by one specific population respectively. The main task focuses on finding the feasible Pareto front(PF), and global and local auxiliary tasks are used to respectively enhance global and local diversity. Moreover, the global auxiliary task is used to implement the global search by ignoring constraints, so as to help the population of the main task pass through infeasible obstacles. The local auxiliary task is used to provide local diversity around the population of the main task, so as to exploit promising regions. Through the knowledge transfer among the three tasks, the search ability of the population of the main task will be significantly improved. Compared with other state-of-the-art CMOEAs, the experimental results on three benchmark test suites demonstrate the superior or competitive performance of the proposed CMOEA.展开更多
Constrained optimization problems are very important as they are encountered in many science and engineering applications.As a novel evolutionary computation technique,cuckoo search(CS) algorithm has attracted much at...Constrained optimization problems are very important as they are encountered in many science and engineering applications.As a novel evolutionary computation technique,cuckoo search(CS) algorithm has attracted much attention and wide applications,owing to its easy implementation and quick convergence.A hybrid cuckoo pattern search algorithm(HCPS) with feasibility-based rule is proposed for solving constrained numerical and engineering design optimization problems.This algorithm can combine the stochastic exploration of the cuckoo search algorithm and the exploitation capability of the pattern search method.Simulation and comparisons based on several well-known benchmark test functions and structural design optimization problems demonstrate the effectiveness,efficiency and robustness of the proposed HCPS algorithm.展开更多
In recent years, a large number of approaches to constrained multi-objective optimization problems(CMOPs) have been proposed, focusing on developing tweaked strategies and techniques for handling constraints. However,...In recent years, a large number of approaches to constrained multi-objective optimization problems(CMOPs) have been proposed, focusing on developing tweaked strategies and techniques for handling constraints. However, an overly finetuned strategy or technique might overfit some problem types,resulting in a lack of versatility. In this article, we propose a generic search strategy that performs an even search in a promising region. The promising region, determined by obtained feasible non-dominated solutions, possesses two general properties.First, the constrained Pareto front(CPF) is included in the promising region. Second, as the number of feasible solutions increases or the convergence performance(i.e., approximation to the CPF) of these solutions improves, the promising region shrinks. Then we develop a new strategy named even search,which utilizes the non-dominated solutions to accelerate convergence and escape from local optima, and the feasible solutions under a constraint relaxation condition to exploit and detect feasible regions. Finally, a diversity measure is adopted to make sure that the individuals in the population evenly cover the valuable areas in the promising region. Experimental results on 45 instances from four benchmark test suites and 14 real-world CMOPs have demonstrated that searching evenly in the promising region can achieve competitive performance and excellent versatility compared to 11 most state-of-the-art methods tailored for CMOPs.展开更多
This paper proposes a modified version of the Dwarf Mongoose Optimization Algorithm (IDMO) for constrained engineering design problems. This optimization technique modifies the base algorithm (DMO) in three simple but...This paper proposes a modified version of the Dwarf Mongoose Optimization Algorithm (IDMO) for constrained engineering design problems. This optimization technique modifies the base algorithm (DMO) in three simple but effective ways. First, the alpha selection in IDMO differs from the DMO, where evaluating the probability value of each fitness is just a computational overhead and contributes nothing to the quality of the alpha or other group members. The fittest dwarf mongoose is selected as the alpha, and a new operator ω is introduced, which controls the alpha movement, thereby enhancing the exploration ability and exploitability of the IDMO. Second, the scout group movements are modified by randomization to introduce diversity in the search process and explore unvisited areas. Finally, the babysitter's exchange criterium is modified such that once the criterium is met, the babysitters that are exchanged interact with the dwarf mongoose exchanging them to gain information about food sources and sleeping mounds, which could result in better-fitted mongooses instead of initializing them afresh as done in DMO, then the counter is reset to zero. The proposed IDMO was used to solve the classical and CEC 2020 benchmark functions and 12 continuous/discrete engineering optimization problems. The performance of the IDMO, using different performance metrics and statistical analysis, is compared with the DMO and eight other existing algorithms. In most cases, the results show that solutions achieved by the IDMO are better than those obtained by the existing algorithms.展开更多
The significant increase in speed of high-speed train will cause the dynamic contact force of the pantograph-catenary system to fluctuate more severely,which poses a challenge to the study of the pantograph-catenary r...The significant increase in speed of high-speed train will cause the dynamic contact force of the pantograph-catenary system to fluctuate more severely,which poses a challenge to the study of the pantograph-catenary relationship and the design of highspeed pantographs.Good pantograph-catenary coupling quality is the essential condition to ensure safe and efficient operation of high-speed train,stable and reliable current collection,and reduction in the wear of contact wires and pantograph contact strips.Among them,the dynamic parameters of high-speed pantographs are crucial to pantograph-catenary coupling quality.With the reduction of the standard deviation of the pantograph-catenary contact force as the optimization goal,multi-parameter joint optimization designs for the high-speed pantograph with two contact strips at multiple running speeds are proposed.Moreover,combining the sensitivity analysis at the optimal solutions,with the parameters and characteristics of in-service DSA380 highspeed pantograph,the optimization proposal of DSA380 was given.展开更多
A novel hybrid algorithm named ABC-BBO, which integrates artificial bee colony(ABC) algorithm with biogeography-based optimization(BBO) algorithm, is proposed to solve constrained mechanical design problems. ABC-BBO c...A novel hybrid algorithm named ABC-BBO, which integrates artificial bee colony(ABC) algorithm with biogeography-based optimization(BBO) algorithm, is proposed to solve constrained mechanical design problems. ABC-BBO combined the exploration of ABC algorithm with the exploitation of BBO algorithm effectively, and hence it can generate the promising candidate individuals. The proposed hybrid algorithm speeds up the convergence and improves the algorithm's performance. Several benchmark test functions and mechanical design problems are applied to verifying the effects of these improvements and it is demonstrated that the performance of this proposed ABC-BBO is superior to or at least highly competitive with other population-based optimization approaches.展开更多
In order to improve the distribution and convergence of constrained optimization algorithms,this paper proposes a constrained optimization algorithm based on double populations. Firstly the feasible solutions and infe...In order to improve the distribution and convergence of constrained optimization algorithms,this paper proposes a constrained optimization algorithm based on double populations. Firstly the feasible solutions and infeasible solutions are stored separately through two populations,which can avoid direct comparison between them. The usage of efficient information carried by the infeasible solutions will enlarge exploitation scope and strength diversity of populations. At the same time,adopting the presented concept of constraints domination to update the infeasible set may keep good variety of population and give consideration to convergence. Also the improved mutation operation is employed to further raise the diversity and convergence.The suggested algorithm is compared with 3 state- of- the- art constrained optimization algorithms on standard test problems g01- g13. Simulation results show that the presented algorithm has certain advantages than other algorithms because it can ensure good convergence accuracy while it has good robustness.展开更多
The constrained global optimization problem being considered, a modified integral_level set method was illustrated based on Chew_Zheng's paper on Integral Global Optimization and (Wu's) paper on Implementable ...The constrained global optimization problem being considered, a modified integral_level set method was illustrated based on Chew_Zheng's paper on Integral Global Optimization and (Wu's) paper on Implementable Algorithm Convergence of Modified Integral_Level Set Method for Global Optimization Problem. It has two characters: 1) Each phase must construct a new function which has the same global optimal value as that of primitive objective function; 2) Comparing it with (Zheng's) method, solving level set procedure is avoided. An implementable algorithm also is given and it is proved that this algorithm is convergent.展开更多
By applying a new existence theorem of quasi-equilibrium problems due to the author, some existence theorems of solutions for noncompact infinite optimization problems and noncompact constrained game problems are prov...By applying a new existence theorem of quasi-equilibrium problems due to the author, some existence theorems of solutions for noncompact infinite optimization problems and noncompact constrained game problems are proved in generalized convex spaces without linear structure. These theorems improve and generalize a number of important results in recent literature.展开更多
基金Supported by the National Natural Science Foundation of China(12071133)Natural Science Foundation of Henan Province(252300421993)Key Scientific Research Project of Higher Education Institutions in Henan Province(25B110005)。
文摘In this paper,an adaptive cubic regularisation algorithm based on affine scaling methods(ARCBASM)is proposed for solving nonlinear equality constrained programming with nonnegative constraints on variables.From the optimality conditions of the problem,we introduce appropriate affine matrix and construct an affine scaling ARC subproblem with linearized constraints.Composite step methods and reduced Hessian methods are applied to tackle the linearized constraints.As a result,a standard unconstrained ARC subproblem is deduced and its solution can supply sufficient decrease.The fraction to the boundary rule maintains the strict feasibility(for nonnegative constraints on variables)of every iteration point.Reflection techniques are employed to prevent the iterations from approaching zero too early.Under mild assumptions,global convergence of the algorithm is analysed.Preliminary numerical results are reported.
基金supported by the National Natural Science Foundation of China under Grant No.61972040the Science and Technology Research and Development Project funded by China Railway Material Trade Group Luban Company.
文摘In a wide range of engineering applications,complex constrained multi-objective optimization problems(CMOPs)present significant challenges,as the complexity of constraints often hampers algorithmic convergence and reduces population diversity.To address these challenges,we propose a novel algorithm named Constraint IntensityDriven Evolutionary Multitasking(CIDEMT),which employs a two-stage,tri-task framework to dynamically integrates problem structure and knowledge transfer.In the first stage,three cooperative tasks are designed to explore the Constrained Pareto Front(CPF),the Unconstrained Pareto Front(UPF),and theε-relaxed constraint boundary,respectively.A CPF-UPF relationship classifier is employed to construct a problem-type-aware evolutionary strategy pool.At the end of the first stage,each task selects strategies from this strategy pool based on the specific type of problem,thereby guiding the subsequent evolutionary process.In the second stage,while each task continues to evolve,aτ-driven knowledge transfer mechanism is introduced to selectively incorporate effective solutions across tasks.enhancing the convergence and feasibility of the main task.Extensive experiments conducted on 32 benchmark problems from three test suites(LIRCMOP,DASCMOP,and DOC)demonstrate that CIDEMT achieves the best Inverted Generational Distance(IGD)values on 24 problems and the best Hypervolume values(HV)on 22 problems.Furthermore,CIDEMT significantly outperforms six state-of-the-art constrained multi-objective evolutionary algorithms(CMOEAs).These results confirm CIDEMT’s superiority in promoting convergence,diversity,and robustness in solving complex CMOPs.
基金supported in part by the National Natural Science Foundation of China(U23A20340,62176238,62476254,62106230)the Key Research and Development Projects of the Ministry of Science and Technology of China(2022YFD2001200)+3 种基金the Natural Science Foundation Project of Henan Province(242300420277)the Key Research and Development Program of Henan(251111113900)the Frontier Exploration Projects of Longmen Laboratory(LMQYTSKT031)Chongqing University of Posts and Telecommunications Key Laboratory of Big Data Open Fund Project(BDIC-2023-B-005).
文摘Solving constrained multi-objective optimization problems(CMOPs)is a challenging task due to the presence of multiple conflicting objectives and intricate constraints.In order to better address CMOPs and achieve a balance between objectives and constraints,existing constrained multi-objective evolutionary algorithms(CMOEAs)predominantly focus on devising various strategies by leveraging the relationships between objectives and constraints,and the designed strategies usually are effective for the problems with simple constraints.However,these methods most ignore the relationship between decision variables and constraints.In fact,the essence of optimization is to find appropriate decision variables to meet various complex constraints.Therefore,it is hoped that the problem can be analyzed from the perspective of decision variables,so as to obtain more excellent results.Based on the above motivation,this paper proposes a decision variables classification approach,according to the relationship between decision variables and constraints,variables are divided into constraint-related(CR)variables and constraintindependent(CI)variables.Consequently,by optimizing these two types of variables independently,the population can sustain a favorable balance between feasibility and diversity.Furthermore,specific offspring generation strategies are proposed for the two categories of decision variables in order to achieve rapid convergence while maintaining population diversity.Experimental results on 31 test problems as well as 20 real-world problems demonstrate that the proposed algorithm is competitive compared to some state-of-the-art constrained multi-objective optimization algorithms.
基金supported in part by the National Key Research and Development Program of China(2022ZD0120001)the National Natural Science Foundation of China(62233004,62273090,62073076)the Jiangsu Provincial Scientific Research Center of Applied Mathematics(BK20233002)
文摘This paper investigates a class of constrained distributed zeroth-order optimization(ZOO) problems over timevarying unbalanced graphs while ensuring privacy preservation among individual agents. Not taking into account recent progress and addressing these concerns separately, there remains a lack of solutions offering theoretical guarantees for both privacy protection and constrained ZOO over time-varying unbalanced graphs.We hereby propose a novel algorithm, termed the differential privacy(DP) distributed push-sum based zeroth-order constrained optimization algorithm(DP-ZOCOA). Operating over time-varying unbalanced graphs, DP-ZOCOA obviates the need for supplemental suboptimization problem computations, thereby reducing overhead in comparison to distributed primary-dual methods. DP-ZOCOA is specifically tailored to tackle constrained ZOO problems over time-varying unbalanced graphs,offering a guarantee of convergence to the optimal solution while robustly preserving privacy. Moreover, we provide rigorous proofs of convergence and privacy for DP-ZOCOA, underscoring its efficacy in attaining optimal convergence without constraints. To enhance its applicability, we incorporate DP-ZOCOA into the federated learning framework and formulate a decentralized zeroth-order constrained federated learning algorithm(ZOCOA-FL) to address challenges stemming from the timevarying imbalance of communication topology. Finally, the performance and effectiveness of the proposed algorithms are thoroughly evaluated through simulations on distributed least squares(DLS) and decentralized federated learning(DFL) tasks.
基金supported in part by the National Key Research and Development Program of China(2023YFC3011100)the National Natural Science Foundation of China(62476294)+1 种基金the Science and Technology Planning Project of Guangdong Province,China(2021B1212040017)the Guangdong Basic and Applied Basic Research Foundation(2025A1515010377,2023A1515110697).
文摘In recent years,numerous recurrent neural network(RNN)models have been reported for solving time-dependent nonlinear optimization problems.However,few existing RNN models simultaneously involve nonlinear equality constraints,direct discretization,and noise suppression.This limitation presents challenges when existing models are applied to practical engineering problems.Additionally,most current discrete-time RNN models are derived from continuous-time models,which may not perform well for solving essentially discrete problems.To handle these issues,a robust direct-discretized RNN(RDD-RNN)model is proposed to efficiently realize time-dependent optimization constrained by nonlinear equalities(TDOCNE)in the presence of various time-dependent noises.Theoretical analyses are provided to reveal that the proposed RDD-RNN model possesses excellent convergence and noise-suppressing capability.Furthermore,numerical experiments and manipulator control instances are conducted and analyzed to validate the superior robustness of the proposed RDD-RNN model under various time-dependent noises,particularly quadratic polynomial noise.Eventually,small target detection experiments further demonstrate the practicality of the RDD-RNN model in image processing applications.
基金sponsored by the Key Knowledge Innovation Program of the Chinese Academy of Sciences (Grant. No. KZCX2-YW-QN203)the National Basic Research Program of China(2007CB411800),the GYHY200906009 of China Meteorological Administration
文摘There are three common types of predictability problems in weather and climate, which each involve different constrained nonlinear optimization problems： the lower bound of maximum predictable time, the upper bound of maximum prediction error, and the lower bound of maximum allowable initial error and parameter error. Highly effcient algorithms have been developed to solve the second optimization problem. And this optimization problem can be used in realistic models for weather and climate to study the upper bound of the maximum prediction error. Although a filtering strategy has been adopted to solve the other two problems, direct solutions are very time-consuming even for a very simple model, which therefore limits the applicability of these two predictability problems in realistic models. In this paper, a new strategy is designed to solve these problems, involving the use of the existing highly effcient algorithms for the second predictability problem in particular. Furthermore, a series of comparisons between the older filtering strategy and the new method are performed. It is demonstrated that the new strategy not only outputs the same results as the old one, but is also more computationally effcient. This would suggest that it is possible to study the predictability problems associated with these two nonlinear optimization problems in realistic forecast models of weather or climate.
基金Supported by National Science Foundation for Excellent Young Scholars,China(Grant No.51222502)Funds for Distinguished Young Scientists of Hunan Province,China(Grant No.14JJ1016)Major Program of National Natural Science Foundation of China(Grant No.51490662)
文摘Most of the current evolutionary algorithms for constrained optimization algorithm are low computational efficiency. In order to improve efficiency, an improved differential evolution with shrinking space technique and adaptive trade-off model, named ATMDE, is proposed to solve constrained optimization problems. The proposed ATMDE algorithm employs an improved differential evolution as the search optimizer to generate new offspring individuals into evolutionary population. For the con- straints, the adaptive trade-off model as one of the most important constraint-handling techniques is employed to select better individuals to retain into the next population, which could effectively handle multiple constraints. Then the shrinking space technique is designed to shrink the search region according to feedback information in order to improve computational efficiency without losing accuracy. The improved DE algorithm introduces three different mutant strategies to generate different offspring into evo- lutionary population. Moreover, a new mutant strategy called ＂DE/rand/best/l＂ is constructed to generate new individuals according to the feasibility proportion ofcurrent population. Finally, the effectiveness of the pro- posed method is verified by a suite of benchmark functions and practical engineering problems. This research presents a constrained evolutionary algorithm with high efficiency and accuracy for constrained optimization problems.
基金Supported by the National Natural Science Foundation of China(1 980 1 0 0 9) and by the Natural Sci-ence Foundation of Guangxi
文摘A new SQP type feasible method for inequality constrained optimization is presented,it is a combination of a master algorithm and an auxiliary algorithm which is taken only in finite iterations.The directions of the master algorithm are generated by only one quadratic programming, and its step\|size is always one, the directions of the auxiliary algorithm are new “second\|order” feasible descent. Under suitable assumptions,the algorithm is proved to possess global and strong convergence, superlinear and quadratic convergence.
基金co-supported by the National Basic Research Program of China(No.2015CB057304)the National Natural Science Foundation of China(Nos.51535004 and91648111)
文摘Selecting the optimal machining parameters for impeller surface is a challenging task in the automatic manufacturing industry, due to its free-form surface and deep-crooked flow channel.Existing experimental methods require lots of machining experiments and off-line tests, which may lead to high machining cost and low efficiency. This paper proposes a novel method of machining parameters optimization for an impeller based on the on-machine measuring technique. The absolute average error and standard deviation of the measured points are used to define the grey relational grade for reconstructing the objective function, and the complex problem of multi-objective optimization is simplified into a problem of single-objective optimization. Then, by comparing the values of the defined grey relational grade in a designed orthogonal experiment, the optimal combination of the machining parameters is obtained. The experiment-solving process of the objective function corresponds to the minimization of the used errors, which is advantageous to reducing the machining error. The proposed method is efficient and low-cost, since it does not require re-clamping the workpiece for off-line tests. Its effectiveness is verified by an on-machine inspection experiment of the impeller blade.
基金Financial support from the National Natural Science Foundation of China (22022816, 22078358)。
文摘Recent research on deterministic methods for circulating cooling water systems optimization has been well developed. However, the actual operating conditions of the system are mostly variable, so the system obtained under deterministic conditions may not be stable and economical. This paper studies the optimization of circulating cooling water systems under uncertain circumstance. To improve the reliability of the system and reduce the water and energy consumption, the influence of different uncertain parameters is taken into consideration. The chance constrained programming method is used to build a model under uncertain conditions, where the confidence level indicates the degree of constraint violation. Probability distribution functions are used to describe the form of uncertain parameters. The objective is to minimize the total cost and obtain the optimal cooling network configuration simultaneously.An algorithm based on Monte Carlo method is proposed, and GAMS software is used to solve the mixed integer nonlinear programming model. A case is optimized to verify the validity of the model. Compared with the deterministic optimization method, the results show that when considering the different types of uncertain parameters, a system with better economy and reliability can be obtained(total cost can be reduced at least 2%).
基金supported by the National Natural Science Foundation of China (60374063)the Natural Science Basic Research Plan Project in Shaanxi Province (2006A12)+1 种基金the Science and Technology Research Project of the Educational Department in Shaanxi Province (07JK180)the Emphasis Research Plan Project of Baoji University of Arts and Science (ZK0840)
文摘A new method to solve dynamic nonlinear constrained optimization problems （DNCOP） is proposed. First, the time （environment） variable period of DNCOP is divided into several equal subperiods. In each subperiod, the DNCOP is approximated by a static nonlinear constrained optimization problem （SNCOP）. Second, for each SNCOP, inspired by the idea of multiobjective optimization, it is transformed into a static bi-objective optimization problem. As a result, the original DNCOP is approximately transformed into several static bi-objective optimization problems. Third, a new multiobjective evolutionary algorithm is proposed based on a new selection operator and an improved nonuniformity mutation operator. The simulation results indicate that the proposed algorithm is effective for DNCOP.
基金supported in part by the National Natural Science Fund for Outstanding Young Scholars of China (61922072)the National Natural Science Foundation of China (62176238, 61806179, 61876169, 61976237)+2 种基金China Postdoctoral Science Foundation (2020M682347)the Training Program of Young Backbone Teachers in Colleges and Universities in Henan Province (2020GGJS006)Henan Provincial Young Talents Lifting Project (2021HYTP007)。
文摘Constrained multi-objective optimization problems(CMOPs) include the optimization of objective functions and the satisfaction of constraint conditions, which challenge the solvers.To solve CMOPs, constrained multi-objective evolutionary algorithms(CMOEAs) have been developed. However, most of them tend to converge into local areas due to the loss of diversity. Evolutionary multitasking(EMT) is new model of solving complex optimization problems, through the knowledge transfer between the source task and other related tasks. Inspired by EMT, this paper develops a new EMT-based CMOEA to solve CMOPs, in which the main task, a global auxiliary task, and a local auxiliary task are created and optimized by one specific population respectively. The main task focuses on finding the feasible Pareto front(PF), and global and local auxiliary tasks are used to respectively enhance global and local diversity. Moreover, the global auxiliary task is used to implement the global search by ignoring constraints, so as to help the population of the main task pass through infeasible obstacles. The local auxiliary task is used to provide local diversity around the population of the main task, so as to exploit promising regions. Through the knowledge transfer among the three tasks, the search ability of the population of the main task will be significantly improved. Compared with other state-of-the-art CMOEAs, the experimental results on three benchmark test suites demonstrate the superior or competitive performance of the proposed CMOEA.
基金Projects([2013]2082,[2009]2061)supported by the Science Technology Foundation of Guizhou Province,ChinaProject([2013]140)supported by the Excellent Science Technology Innovation Talents in Universities of Guizhou Province,ChinaProject(2008040)supported by the Natural Science Research in Education Department of Guizhou Province,China
文摘Constrained optimization problems are very important as they are encountered in many science and engineering applications.As a novel evolutionary computation technique,cuckoo search(CS) algorithm has attracted much attention and wide applications,owing to its easy implementation and quick convergence.A hybrid cuckoo pattern search algorithm(HCPS) with feasibility-based rule is proposed for solving constrained numerical and engineering design optimization problems.This algorithm can combine the stochastic exploration of the cuckoo search algorithm and the exploitation capability of the pattern search method.Simulation and comparisons based on several well-known benchmark test functions and structural design optimization problems demonstrate the effectiveness,efficiency and robustness of the proposed HCPS algorithm.
基金partly supported by the National Natural Science Foundation of China(62076225)。
文摘In recent years, a large number of approaches to constrained multi-objective optimization problems(CMOPs) have been proposed, focusing on developing tweaked strategies and techniques for handling constraints. However, an overly finetuned strategy or technique might overfit some problem types,resulting in a lack of versatility. In this article, we propose a generic search strategy that performs an even search in a promising region. The promising region, determined by obtained feasible non-dominated solutions, possesses two general properties.First, the constrained Pareto front(CPF) is included in the promising region. Second, as the number of feasible solutions increases or the convergence performance(i.e., approximation to the CPF) of these solutions improves, the promising region shrinks. Then we develop a new strategy named even search,which utilizes the non-dominated solutions to accelerate convergence and escape from local optima, and the feasible solutions under a constraint relaxation condition to exploit and detect feasible regions. Finally, a diversity measure is adopted to make sure that the individuals in the population evenly cover the valuable areas in the promising region. Experimental results on 45 instances from four benchmark test suites and 14 real-world CMOPs have demonstrated that searching evenly in the promising region can achieve competitive performance and excellent versatility compared to 11 most state-of-the-art methods tailored for CMOPs.
文摘This paper proposes a modified version of the Dwarf Mongoose Optimization Algorithm (IDMO) for constrained engineering design problems. This optimization technique modifies the base algorithm (DMO) in three simple but effective ways. First, the alpha selection in IDMO differs from the DMO, where evaluating the probability value of each fitness is just a computational overhead and contributes nothing to the quality of the alpha or other group members. The fittest dwarf mongoose is selected as the alpha, and a new operator ω is introduced, which controls the alpha movement, thereby enhancing the exploration ability and exploitability of the IDMO. Second, the scout group movements are modified by randomization to introduce diversity in the search process and explore unvisited areas. Finally, the babysitter's exchange criterium is modified such that once the criterium is met, the babysitters that are exchanged interact with the dwarf mongoose exchanging them to gain information about food sources and sleeping mounds, which could result in better-fitted mongooses instead of initializing them afresh as done in DMO, then the counter is reset to zero. The proposed IDMO was used to solve the classical and CEC 2020 benchmark functions and 12 continuous/discrete engineering optimization problems. The performance of the IDMO, using different performance metrics and statistical analysis, is compared with the DMO and eight other existing algorithms. In most cases, the results show that solutions achieved by the IDMO are better than those obtained by the existing algorithms.
基金the National Natural Science Foundation of China(Grant No.11672297)the Strategic Priority Research Program of the Chinese Academy of Sciences(Grant No.XDB22020200).
文摘The significant increase in speed of high-speed train will cause the dynamic contact force of the pantograph-catenary system to fluctuate more severely,which poses a challenge to the study of the pantograph-catenary relationship and the design of highspeed pantographs.Good pantograph-catenary coupling quality is the essential condition to ensure safe and efficient operation of high-speed train,stable and reliable current collection,and reduction in the wear of contact wires and pantograph contact strips.Among them,the dynamic parameters of high-speed pantographs are crucial to pantograph-catenary coupling quality.With the reduction of the standard deviation of the pantograph-catenary contact force as the optimization goal,multi-parameter joint optimization designs for the high-speed pantograph with two contact strips at multiple running speeds are proposed.Moreover,combining the sensitivity analysis at the optimal solutions,with the parameters and characteristics of in-service DSA380 highspeed pantograph,the optimization proposal of DSA380 was given.
基金Projects(61463009,11264005,11361014)supported by the National Natural Science Foundation of ChinaProject([2013]2082)supported by the Science Technology Foundation of Guizhou Province,China
文摘A novel hybrid algorithm named ABC-BBO, which integrates artificial bee colony(ABC) algorithm with biogeography-based optimization(BBO) algorithm, is proposed to solve constrained mechanical design problems. ABC-BBO combined the exploration of ABC algorithm with the exploitation of BBO algorithm effectively, and hence it can generate the promising candidate individuals. The proposed hybrid algorithm speeds up the convergence and improves the algorithm's performance. Several benchmark test functions and mechanical design problems are applied to verifying the effects of these improvements and it is demonstrated that the performance of this proposed ABC-BBO is superior to or at least highly competitive with other population-based optimization approaches.
文摘In order to improve the distribution and convergence of constrained optimization algorithms,this paper proposes a constrained optimization algorithm based on double populations. Firstly the feasible solutions and infeasible solutions are stored separately through two populations,which can avoid direct comparison between them. The usage of efficient information carried by the infeasible solutions will enlarge exploitation scope and strength diversity of populations. At the same time,adopting the presented concept of constraints domination to update the infeasible set may keep good variety of population and give consideration to convergence. Also the improved mutation operation is employed to further raise the diversity and convergence.The suggested algorithm is compared with 3 state- of- the- art constrained optimization algorithms on standard test problems g01- g13. Simulation results show that the presented algorithm has certain advantages than other algorithms because it can ensure good convergence accuracy while it has good robustness.
文摘The constrained global optimization problem being considered, a modified integral_level set method was illustrated based on Chew_Zheng's paper on Integral Global Optimization and (Wu's) paper on Implementable Algorithm Convergence of Modified Integral_Level Set Method for Global Optimization Problem. It has two characters: 1) Each phase must construct a new function which has the same global optimal value as that of primitive objective function; 2) Comparing it with (Zheng's) method, solving level set procedure is avoided. An implementable algorithm also is given and it is proved that this algorithm is convergent.
文摘By applying a new existence theorem of quasi-equilibrium problems due to the author, some existence theorems of solutions for noncompact infinite optimization problems and noncompact constrained game problems are proved in generalized convex spaces without linear structure. These theorems improve and generalize a number of important results in recent literature.
