In this paper, an approximate smoothing approach to the non-differentiable exact penalty function is proposed for the constrained optimization problem. A simple smoothed penalty algorithm is given, and its convergence...In this paper, an approximate smoothing approach to the non-differentiable exact penalty function is proposed for the constrained optimization problem. A simple smoothed penalty algorithm is given, and its convergence is discussed. A practical algorithm to compute approximate optimal solution is given as well as computational experiments to demonstrate its efficiency.展开更多
In this paper, a new augmented Lagrangian penalty function for constrained optimization problems is studied. The dual properties of the augmented Lagrangian objective penalty function for constrained optimization prob...In this paper, a new augmented Lagrangian penalty function for constrained optimization problems is studied. The dual properties of the augmented Lagrangian objective penalty function for constrained optimization problems are proved. Under some conditions, the saddle point of the augmented Lagrangian objective penalty function satisfies the first-order Karush-Kuhn-Tucker (KKT) condition. Especially, when the KKT condition holds for convex programming its saddle point exists. Based on the augmented Lagrangian objective penalty function, an algorithm is developed for finding a global solution to an inequality constrained optimization problem and its global convergence is also proved under some conditions.展开更多
This paper introduces a new exact and smooth penalty function to tackle constrained min-max problems. By using this new penalty function and adding just one extra variable, a constrained rain-max problem is transforme...This paper introduces a new exact and smooth penalty function to tackle constrained min-max problems. By using this new penalty function and adding just one extra variable, a constrained rain-max problem is transformed into an unconstrained optimization one. It is proved that, under certain reasonable assumptions and when the penalty parameter is sufficiently large, the minimizer of this unconstrained optimization problem is equivalent to the minimizer of the original constrained one. Numerical results demonstrate that this penalty function method is an effective and promising approach for solving constrained finite min-max problems.展开更多
We propose a new unified path to approximately smoothing the nonsmooth exact penalty function in this paper. Based on the new smooth penalty function, we give a penalty algorithm to solve the constrained optimization ...We propose a new unified path to approximately smoothing the nonsmooth exact penalty function in this paper. Based on the new smooth penalty function, we give a penalty algorithm to solve the constrained optimization problem, and discuss the convergence of the algorithm under mild conditions.展开更多
A class of discontinuous penalty functions was proposed to solve constrained minimization problems with the integral approach to global optimization, m-mean value and v-variance optimality conditions of a constrained ...A class of discontinuous penalty functions was proposed to solve constrained minimization problems with the integral approach to global optimization, m-mean value and v-variance optimality conditions of a constrained and penalized minimization problem were investigated. A nonsequential algorithm was proposed. Numerical examples were given to illustrate the effectiveness of the algorithm.展开更多
By using the penalty function method with objective parameters, the paper presents an interactive algorithm to solve the inequality constrained multi-objective programming (MP). The MP is transformed into a single obj...By using the penalty function method with objective parameters, the paper presents an interactive algorithm to solve the inequality constrained multi-objective programming (MP). The MP is transformed into a single objective optimal problem (SOOP) with inequality constrains;and it is proved that, under some conditions, an optimal solution to SOOP is a Pareto efficient solution to MP. Then, an interactive algorithm of MP is designed accordingly. Numerical examples show that the algorithm can find a satisfactory solution to MP with objective weight value adjusted by decision maker.展开更多
For smooth optimization problem with equMity constraints, new continuously differentiable penalty function is derived. It is proved exact in the sense that local optimizers of a nonlinear program are precisely the opt...For smooth optimization problem with equMity constraints, new continuously differentiable penalty function is derived. It is proved exact in the sense that local optimizers of a nonlinear program are precisely the optimizers of the associated penalty function under some nondegeneracy assumption. It is simple in the sense that the penalty function only includes the objective function and constrained functions, and it doesn＇t include their gradients. This is achieved by augmenting the dimension of the program by a variable that controls the weight of the penalty terms.展开更多
In this paper,a new objective penalty function approach is proposed for solving minimax programming problems with equality and inequality constraints.This new objective penalty function combines the objective penalty ...In this paper,a new objective penalty function approach is proposed for solving minimax programming problems with equality and inequality constraints.This new objective penalty function combines the objective penalty and constraint penalty.By the new objective penalty function,a constrained minimax problem is converted to minimizations of a sequence of continuously differentiable functions with a simple box constraint.One can thus apply any efficient gradient minimization methods to solve the minimizations with box constraint at each step of the sequence.Some relationships between the original constrained minimax problem and the corresponding minimization problems with box constraint are established.Based on these results,an algorithm for finding a global solution of the constrained minimax problems is proposed by integrating the particular structure of minimax problems and its global convergence is proved under some conditions.Furthermore,an algorithm is developed for finding a local solution of the constrained minimax problems,with its convergence proved under certain conditions.Preliminary results of numerical experiments with well-known test problems show that satisfactorilyapproximate solutions for some constrained minimax problems can be obtained.展开更多
In this paper, a trust region method for equality constrained optimizationbased on nondifferentiable exact penalty is proposed. In this algorithm, the trail step ischaracterized by computation of its normal component ...In this paper, a trust region method for equality constrained optimizationbased on nondifferentiable exact penalty is proposed. In this algorithm, the trail step ischaracterized by computation of its normal component being separated from computation of itstangential component, i.e., only the tangential component of the trail step is constrained by trustradius while the normal component and trail step itself have no constraints. The other maincharacteristic of the algorithm is the decision of trust region radius. Here, the decision of trustregion radius uses the information of the gradient of objective function and reduced Hessian.However, Maratos effect will occur when we use the nondifferentiable exact penalty function as themerit function. In order to obtain the superlinear convergence of the algorithm, we use the twiceorder correction technique. Because of the speciality of the adaptive trust region method, we usetwice order correction when p = 0 (the definition is as in Section 2) and this is different from thetraditional trust region methods for equality constrained optimization. So the computation of thealgorithm in this paper is reduced. What is more, we can prove that the algorithm is globally andsuperlinearly convergent.展开更多
In this paper, we use the smoothing penalty function proposed in [1] as the merit function of SQP method for nonlinear optimization with inequality constraints. The global convergence of the method is obtained.
Most material distribution-based topology optimization methods work on a relaxed form of the optimization problem and then push the solution toward the binary limits.However,when benchmarking these methods,researchers...Most material distribution-based topology optimization methods work on a relaxed form of the optimization problem and then push the solution toward the binary limits.However,when benchmarking these methods,researchers use known solutions to only a single form of benchmark problem.This paper proposes a comparison platform for systematic benchmarking of topology optimization methods using both binary and relaxed forms.A greyness measure is implemented to evaluate how far a solution is from the desired binary form.The well-known ZhouRozvany(ZR)problem is selected as the benchmarking problem here,making use of available global solutions for both its relaxed and binary forms.The recently developed non-penalization Smooth-edged Material Distribution for Optimizing Topology(SEMDOT),well-established Solid Isotropic Material with Penalization(SIMP),and continuation methods are studied on this platform.Interestingly,in most cases,the grayscale solutions obtained by SEMDOT demonstrate better performance in dealing with the ZR problem than SIMP.The reasons are investigated and attributed to the usage of two different regularization techniques,namely,the Heaviside smooth function in SEMDOT and the power-law penalty in SIMP.More importantly,a simple-to-use benchmarking graph is proposed for evaluating newly developed topology optimization methods.展开更多
An interval algorlthm for inequality coustrained discrete minimax problems is described, in which the constrained and objective functions are C1 functions. First, based on the penalty function methods, we trans form t...An interval algorlthm for inequality coustrained discrete minimax problems is described, in which the constrained and objective functions are C1 functions. First, based on the penalty function methods, we trans form this problem to unconstrained optimization. Second, the interval extensions of the penalty functions and the test rules of region deletion are discussed. At last, we design an interval algorithm with the bisection rule of Moore. The algorithm provides bounds on both the minimax value and the localization of the minimax points of the problem. Numerical results show that algorithm is reliable and efficiency.展开更多
The problems of optimal control (OCPs) related to PDEs are a very active area of research. These problems deal with the processes of mechanical engineering, heat aeronautics, physics, hydro and gas dynamics, the physi...The problems of optimal control (OCPs) related to PDEs are a very active area of research. These problems deal with the processes of mechanical engineering, heat aeronautics, physics, hydro and gas dynamics, the physics of plasma and other real life problems. In this paper, we deal with a class of the constrained OCP for parabolic systems. It is converted to new unconstrained OCP by adding a penalty function to the cost functional. The existence solution of the considering system of parabolic optimal control problem (POCP) is introduced. In this way, the uniqueness theorem for the solving POCP is introduced. Therefore, a theorem for the sufficient differentiability conditions has been proved.展开更多
A new smooth gap function for the box constrained variational inequality problem （VIP） is proposed based on an integral global optimality condition. The smooth gap function is simple and has some good differentiable...A new smooth gap function for the box constrained variational inequality problem （VIP） is proposed based on an integral global optimality condition. The smooth gap function is simple and has some good differentiable properties. The box constrained VIP can be reformulated as a differentiable optimization problem by the proposed smooth gap function. The conditions, under which any stationary point of the optimization problem is the solution to the box constrained VIP, are discussed. A simple frictional contact problem is analyzed to show the applications of the smooth gap function. Finally, the numerical experiments confirm the good theoretical properties of the method.展开更多
Some classical penalty function algorithms may not always be convergent under big penalty parameters in Matlab software,which makes them impossible to find out an optimal solution to constrained optimization problems....Some classical penalty function algorithms may not always be convergent under big penalty parameters in Matlab software,which makes them impossible to find out an optimal solution to constrained optimization problems.In this paper,a novel penalty function(called M-objective penalty function) with one penalty parameter added to both objective and constrained functions of inequality constrained optimization problems is proposed.Based on the M-objective penalty function,an algorithm is developed to solve an optimal solution to the inequality constrained optimization problems,with its convergence proved under some conditions.Furthermore,numerical results show that the proposed algorithm has a much better convergence than the classical penalty function algorithms under big penalty parameters,and is efficient in choosing a penalty parameter in a large range in Matlab software.展开更多
This paper presents an entropy-based smoothing technique for solving a class of non-smooth optimization problems that are in some way related to the maximum function.Basic ideas concerning this approach are that we re...This paper presents an entropy-based smoothing technique for solving a class of non-smooth optimization problems that are in some way related to the maximum function.Basic ideas concerning this approach are that we replace the non-smooth maximum function by a smooth one,called aggregate function,which is derived by employing the maximum entropy principle and its useful properties are proved.Wilh this smoothing technique,both unconstrained and constrained mimma.x problems are transformed into unconstrained optimization problems of smooth functions such that this class of non-smooth optimization problems can be solved by some existing unconstrained optimization softwares for smooth functions The present approach can be very easily implemented on computers with very fast and-.Inhie convergence.展开更多
文摘In this paper, an approximate smoothing approach to the non-differentiable exact penalty function is proposed for the constrained optimization problem. A simple smoothed penalty algorithm is given, and its convergence is discussed. A practical algorithm to compute approximate optimal solution is given as well as computational experiments to demonstrate its efficiency.
文摘In this paper, a new augmented Lagrangian penalty function for constrained optimization problems is studied. The dual properties of the augmented Lagrangian objective penalty function for constrained optimization problems are proved. Under some conditions, the saddle point of the augmented Lagrangian objective penalty function satisfies the first-order Karush-Kuhn-Tucker (KKT) condition. Especially, when the KKT condition holds for convex programming its saddle point exists. Based on the augmented Lagrangian objective penalty function, an algorithm is developed for finding a global solution to an inequality constrained optimization problem and its global convergence is also proved under some conditions.
基金supported by the Grant of the Academy of Mathematics and System Science of Chinese Academy of Sciences-The Hong Kong Polytechnic University Joint Research Institute (AMSS-PolyU)the Research Grands Council Grant of The Hong Kong Polytechnic University (No. 5365/09E)
文摘This paper introduces a new exact and smooth penalty function to tackle constrained min-max problems. By using this new penalty function and adding just one extra variable, a constrained rain-max problem is transformed into an unconstrained optimization one. It is proved that, under certain reasonable assumptions and when the penalty parameter is sufficiently large, the minimizer of this unconstrained optimization problem is equivalent to the minimizer of the original constrained one. Numerical results demonstrate that this penalty function method is an effective and promising approach for solving constrained finite min-max problems.
文摘We propose a new unified path to approximately smoothing the nonsmooth exact penalty function in this paper. Based on the new smooth penalty function, we give a penalty algorithm to solve the constrained optimization problem, and discuss the convergence of the algorithm under mild conditions.
文摘A class of discontinuous penalty functions was proposed to solve constrained minimization problems with the integral approach to global optimization, m-mean value and v-variance optimality conditions of a constrained and penalized minimization problem were investigated. A nonsequential algorithm was proposed. Numerical examples were given to illustrate the effectiveness of the algorithm.
文摘By using the penalty function method with objective parameters, the paper presents an interactive algorithm to solve the inequality constrained multi-objective programming (MP). The MP is transformed into a single objective optimal problem (SOOP) with inequality constrains;and it is proved that, under some conditions, an optimal solution to SOOP is a Pareto efficient solution to MP. Then, an interactive algorithm of MP is designed accordingly. Numerical examples show that the algorithm can find a satisfactory solution to MP with objective weight value adjusted by decision maker.
基金supported by the National Natural Science Foundation of China under Grant No.10971118the Science foundation of Shandong Province(J10LG04)
文摘For smooth optimization problem with equMity constraints, new continuously differentiable penalty function is derived. It is proved exact in the sense that local optimizers of a nonlinear program are precisely the optimizers of the associated penalty function under some nondegeneracy assumption. It is simple in the sense that the penalty function only includes the objective function and constrained functions, and it doesn＇t include their gradients. This is achieved by augmenting the dimension of the program by a variable that controls the weight of the penalty terms.
基金This research was supported by Natural Science Foundation of Chongqing(Nos.cstc2013jjB00001 and cstc2011jjA00010)by Chongqing Municipal Education Commission(No.KJ120616).
文摘In this paper,a new objective penalty function approach is proposed for solving minimax programming problems with equality and inequality constraints.This new objective penalty function combines the objective penalty and constraint penalty.By the new objective penalty function,a constrained minimax problem is converted to minimizations of a sequence of continuously differentiable functions with a simple box constraint.One can thus apply any efficient gradient minimization methods to solve the minimizations with box constraint at each step of the sequence.Some relationships between the original constrained minimax problem and the corresponding minimization problems with box constraint are established.Based on these results,an algorithm for finding a global solution of the constrained minimax problems is proposed by integrating the particular structure of minimax problems and its global convergence is proved under some conditions.Furthermore,an algorithm is developed for finding a local solution of the constrained minimax problems,with its convergence proved under certain conditions.Preliminary results of numerical experiments with well-known test problems show that satisfactorilyapproximate solutions for some constrained minimax problems can be obtained.
基金This research is supported in part by the National Natural Science Foundation of China(Grant No. 39830070,10171055)and China Postdoctoral Science Foundation
文摘In this paper, a trust region method for equality constrained optimizationbased on nondifferentiable exact penalty is proposed. In this algorithm, the trail step ischaracterized by computation of its normal component being separated from computation of itstangential component, i.e., only the tangential component of the trail step is constrained by trustradius while the normal component and trail step itself have no constraints. The other maincharacteristic of the algorithm is the decision of trust region radius. Here, the decision of trustregion radius uses the information of the gradient of objective function and reduced Hessian.However, Maratos effect will occur when we use the nondifferentiable exact penalty function as themerit function. In order to obtain the superlinear convergence of the algorithm, we use the twiceorder correction technique. Because of the speciality of the adaptive trust region method, we usetwice order correction when p = 0 (the definition is as in Section 2) and this is different from thetraditional trust region methods for equality constrained optimization. So the computation of thealgorithm in this paper is reduced. What is more, we can prove that the algorithm is globally andsuperlinearly convergent.
基金This research is supported in part by the National Natural Science Foundation of China(No. 39830070).
文摘In this paper, we use the smoothing penalty function proposed in [1] as the merit function of SQP method for nonlinear optimization with inequality constraints. The global convergence of the method is obtained.
基金Supported by the National Natural Sciences Foundation of China (No.39830070 and 10171055).
文摘In this paper, a new SQP method for inequality constrained optimization is proposed and the global convergence is obtained under very mild conditions.
文摘Most material distribution-based topology optimization methods work on a relaxed form of the optimization problem and then push the solution toward the binary limits.However,when benchmarking these methods,researchers use known solutions to only a single form of benchmark problem.This paper proposes a comparison platform for systematic benchmarking of topology optimization methods using both binary and relaxed forms.A greyness measure is implemented to evaluate how far a solution is from the desired binary form.The well-known ZhouRozvany(ZR)problem is selected as the benchmarking problem here,making use of available global solutions for both its relaxed and binary forms.The recently developed non-penalization Smooth-edged Material Distribution for Optimizing Topology(SEMDOT),well-established Solid Isotropic Material with Penalization(SIMP),and continuation methods are studied on this platform.Interestingly,in most cases,the grayscale solutions obtained by SEMDOT demonstrate better performance in dealing with the ZR problem than SIMP.The reasons are investigated and attributed to the usage of two different regularization techniques,namely,the Heaviside smooth function in SEMDOT and the power-law penalty in SIMP.More importantly,a simple-to-use benchmarking graph is proposed for evaluating newly developed topology optimization methods.
文摘An interval algorlthm for inequality coustrained discrete minimax problems is described, in which the constrained and objective functions are C1 functions. First, based on the penalty function methods, we trans form this problem to unconstrained optimization. Second, the interval extensions of the penalty functions and the test rules of region deletion are discussed. At last, we design an interval algorithm with the bisection rule of Moore. The algorithm provides bounds on both the minimax value and the localization of the minimax points of the problem. Numerical results show that algorithm is reliable and efficiency.
文摘The problems of optimal control (OCPs) related to PDEs are a very active area of research. These problems deal with the processes of mechanical engineering, heat aeronautics, physics, hydro and gas dynamics, the physics of plasma and other real life problems. In this paper, we deal with a class of the constrained OCP for parabolic systems. It is converted to new unconstrained OCP by adding a penalty function to the cost functional. The existence solution of the considering system of parabolic optimal control problem (POCP) is introduced. In this way, the uniqueness theorem for the solving POCP is introduced. Therefore, a theorem for the sufficient differentiability conditions has been proved.
基金Project supported by the National Natural Science Foundation of China(Nos.10902077,11172209, and 10572031)
文摘A new smooth gap function for the box constrained variational inequality problem （VIP） is proposed based on an integral global optimality condition. The smooth gap function is simple and has some good differentiable properties. The box constrained VIP can be reformulated as a differentiable optimization problem by the proposed smooth gap function. The conditions, under which any stationary point of the optimization problem is the solution to the box constrained VIP, are discussed. A simple frictional contact problem is analyzed to show the applications of the smooth gap function. Finally, the numerical experiments confirm the good theoretical properties of the method.
基金supported by the National Natural Science Foundation of China under Grant No.11271329
文摘Some classical penalty function algorithms may not always be convergent under big penalty parameters in Matlab software,which makes them impossible to find out an optimal solution to constrained optimization problems.In this paper,a novel penalty function(called M-objective penalty function) with one penalty parameter added to both objective and constrained functions of inequality constrained optimization problems is proposed.Based on the M-objective penalty function,an algorithm is developed to solve an optimal solution to the inequality constrained optimization problems,with its convergence proved under some conditions.Furthermore,numerical results show that the proposed algorithm has a much better convergence than the classical penalty function algorithms under big penalty parameters,and is efficient in choosing a penalty parameter in a large range in Matlab software.
基金Project supported by the National"Climbing Hill"Program
文摘This paper presents an entropy-based smoothing technique for solving a class of non-smooth optimization problems that are in some way related to the maximum function.Basic ideas concerning this approach are that we replace the non-smooth maximum function by a smooth one,called aggregate function,which is derived by employing the maximum entropy principle and its useful properties are proved.Wilh this smoothing technique,both unconstrained and constrained mimma.x problems are transformed into unconstrained optimization problems of smooth functions such that this class of non-smooth optimization problems can be solved by some existing unconstrained optimization softwares for smooth functions The present approach can be very easily implemented on computers with very fast and-.Inhie convergence.
