In order to slove the large-scale nonlinear programming （NLP） problems efficiently, an efficient optimization algorithm based on reduced sequential quadratic programming （rSQP） and automatic differentiation （AD）...In order to slove the large-scale nonlinear programming （NLP） problems efficiently, an efficient optimization algorithm based on reduced sequential quadratic programming （rSQP） and automatic differentiation （AD） is presented in this paper. With the characteristics of sparseness, relatively low degrees of freedom and equality constraints utilized, the nonlinear programming problem is solved by improved rSQP solver. In the solving process, AD technology is used to obtain accurate gradient information. The numerical results show that the combined algorithm, which is suitable for large-scale process optimization problems, can calculate more efficiently than rSQP itself.展开更多
A new hybrid optimization algorithm was presented by integrating the gravitational search algorithm （GSA） with the sequential quadratic programming （SQP）, namely GSA-SQP, for solving global optimization problems a...A new hybrid optimization algorithm was presented by integrating the gravitational search algorithm （GSA） with the sequential quadratic programming （SQP）, namely GSA-SQP, for solving global optimization problems and minimization of factor of safety in slope stability analysis. The new algorithm combines the global exploration ability of the GSA to converge rapidly to a near optimum solution. In addition, it uses the accurate local exploitation ability of the SQP to accelerate the search process and find an accurate solution. A set of five well-known benchmark optimization problems was used to validate the performance of the GSA-SQP as a global optimization algorithm and facilitate comparison with the classical GSA. In addition, the effectiveness of the proposed method for slope stability analysis was investigated using three ease studies of slope stability problems from the literature. The factor of safety of earth slopes was evaluated using the Morgenstern-Price method. The numerical experiments demonstrate that the hybrid algorithm converges faster to a significantly more accurate final solution for a variety of benchmark test functions and slope stability problems.展开更多
A heuristic technique is developed for a nonlinear magnetohydrodynamics （MHD） Jeffery-Hamel problem with the help of the feed-forward artificial neural net- work （ANN） optimized with the genetic algorithm （GA） a...A heuristic technique is developed for a nonlinear magnetohydrodynamics （MHD） Jeffery-Hamel problem with the help of the feed-forward artificial neural net- work （ANN） optimized with the genetic algorithm （GA） and the sequential quadratic programming （SQP） method. The twodimensional （2D） MHD Jeffery-Hamel problem is transformed into a higher order boundary value problem （BVP） of ordinary differential equations （ODEs）. The mathematical model of the transformed BVP is formulated with the ANN in an unsupervised manner. The training of the weights of the ANN is carried out with the evolutionary calculation based on the GA hybridized with the SQP method for the rapid local convergence. The proposed scheme is evaluated on the variants of the Jeffery-Hamel flow by varying the Reynold number, the Hartmann number, and the an- gles of the walls. A large number of simulations are performed with an extensive analysis to validate the accuracy, convergence, and effectiveness of the scheme. The comparison of the standard numerical solution and the analytic solution establishes the correctness of the proposed designed methodologies.展开更多
In this paper, we propose a new hybrid method called SQPBSA which combines backtracking search optimization algorithm （BSA） and sequential quadratic programming （SQP）. BSA, as an exploration search engine, gives a...In this paper, we propose a new hybrid method called SQPBSA which combines backtracking search optimization algorithm （BSA） and sequential quadratic programming （SQP）. BSA, as an exploration search engine, gives a good direction to the global optimal region, while SQP is used as a local search technique to exploit the optimal solution. The experiments are carried on two suits of 28 functions proposed in the CEC-2013 competitions to verify the performance of SQPBSA. The results indicate the proposed method is effective and competitive.展开更多
Loading distribution for heavy plate mill is to find optimal control solutions under the granted performance indicators and constraints including mill capacity and hypothesis of rolling models.The solutions are quite ...Loading distribution for heavy plate mill is to find optimal control solutions under the granted performance indicators and constraints including mill capacity and hypothesis of rolling models.The solutions are quite different for different performance indicators.In the article,the performance indicators and sequential quadratic programming(SQP for short below)methods employed in 5000 mm heavy plate mill of BaoSteel are penetratingly analyzed.Generally,the SQP method is an effective and fast way to solve the nonlinear programming problems with small or medium scale constraints.Early in 1976,Han put forward the SQP method for the first time and Powell made it perfect and accomplished the algorithm in 1977.In fact,SQP method was to turn a nonlinear programming problem to a series of sub set of quadratic programming problems.In the algorithm,each iteration step is to solve one quadratic programming problem.The optimal solutions will be gradually approached after quadratic programming problems were totally solved.When solving the quadratic programming problem,the active set strategy were employed which turned the constrained quadratic programming problem to unconstrained quadratic programming problem.The active set strategy made the whole quadratic programming problem be solved by a least square problem.And finally,the matrix of the least square problem would be decomposed by Q matrix and R matrix.After Q matrix and R matrix were obtained,the optimal solutions would be finally found.For loading distribution,the performance indicators were composed by plate shape and draft of each pass.Plate shape is represented by rolling force gradually reduced pass by pass with a tunable factor.The mill capacity is another performance indicator represented by draft of each pass.For heavy plate mill,the mill capacity here is the motor moment.For heavy draft,the motor would be overloaded especially for the first several passes;for small draft,the motor would be loaded slightly.All these would not be permitted to happen when calculating the loading distribution.The mill capacity indicator made the loading of mill just be in the middle,not too much and not too low.In the article,these two performance indicators were analyzed in detail.Examples of loading distribution results with different performance indicators were given by the SQP method.When making changes to the performance indicators,there would be different solutions to the loading distribution.For the optimal solutions to the mill,there was supposed to make changes to the factors of the performance indicators or upgrade the accuracy of the mathematical models of the rolling process.展开更多
Nonlinear mixed-eirects (NLME) modek have become popular in various disciplines over the past several decades.However,the existing methods for parameter estimation imple-mented in standard statistical packages such as...Nonlinear mixed-eirects (NLME) modek have become popular in various disciplines over the past several decades.However,the existing methods for parameter estimation imple-mented in standard statistical packages such as SAS and R/S-Plus are generally limited k) single-or multi-level NLME models that only allow nested random effects and are unable to cope with crossed random effects within the framework of NLME modeling.In t his study,wc propose a general formulation of NLME models that can accommodate both nested and crassed random effects,and then develop a computational algorit hm for parameter estimation based on normal assumptions.The maximum likelihood estimation is carried out using the first-order conditional expansion (FOCE) for NLME model linearization and sequential quadratic programming (SCJP) for computational optimization while ensuring positive-definiteness of the estimated variance-covariance matrices of both random effects and error terms.The FOCE-SQP algorithm is evaluated using the height and diameter data measured on trees from Korean larch (L.olgeiisis var,Chang-paienA.b) experimental plots aa well as simulation studies.We show that the FOCE-SQP method converges fast with high accuracy.Applications of the general formulation of NLME models are illustrated with an analysis of the Korean larch data.展开更多
In this study,the design of a computational heuristic based on the nonlinear Liénard model is presented using the efficiency of artificial neural networks(ANNs)along with the hybridization procedures of global an...In this study,the design of a computational heuristic based on the nonlinear Liénard model is presented using the efficiency of artificial neural networks(ANNs)along with the hybridization procedures of global and local search approaches.The global search genetic algorithm(GA)and local search sequential quadratic programming scheme(SQPS)are implemented to solve the nonlinear Liénard model.An objective function using the differential model and boundary conditions is designed and optimized by the hybrid computing strength of the GA-SQPS.The motivation of the ANN procedures along with GA-SQPS comes to present reliable,feasible and precise frameworks to tackle stiff and highly nonlinear differentialmodels.The designed procedures of ANNs along with GA-SQPS are applied for three highly nonlinear differential models.The achieved numerical outcomes on multiple trials using the designed procedures are compared to authenticate the correctness,viability and efficacy.Moreover,statistical performances based on different measures are also provided to check the reliability of the ANN along with GASQPS.展开更多
This study presents a hybrid algorithm obtained by combining a genetic algorithm (GA) with successive quadratic sequential programming (SQP), namely GA-SQP. GA is the main optimizer, whereas SQP is used to refine the ...This study presents a hybrid algorithm obtained by combining a genetic algorithm (GA) with successive quadratic sequential programming (SQP), namely GA-SQP. GA is the main optimizer, whereas SQP is used to refine the results of GA, further improving the solution quality. The problem formulation is done in the framework named RUNE (fRamework for aUtomated aNalog dEsign), which targets solving nonlinear mono-objective and multi-objective optimization problems for analog circuits design. Two circuits are presented: a transimpedance amplifier (TIA) and an optical driver (Driver), which are both part of an Optical Network-on-Chip (ONoC). Furthermore, convergence characteristics and robustness of the proposed method have been explored through comparison with results obtained with SQP algorithm. The outcome is very encouraging and suggests that the hybrid proposed method is very efficient in solving analog design problems.展开更多
For current sequential quadratic programming (SQP) type algorithms, there exist two problems; (i) in order to obtain a search direction, one must solve one or more quadratic programming subproblems per iteration, and ...For current sequential quadratic programming (SQP) type algorithms, there exist two problems; (i) in order to obtain a search direction, one must solve one or more quadratic programming subproblems per iteration, and the computation amount of this algorithm is very large. So they are not suitable for the large-scale problems; (ii) the SQP algorithms require that the related quadratic programming subproblems be solvable per iteration, but it is difficult to be satisfied. By using e-active set procedure with a special penalty function as the merit function, a new algorithm of sequential systems of linear equations for general nonlinear optimization problems with arbitrary initial point is presented This new algorithm only needs to solve three systems of linear equations having the same coefficient matrix per iteration, and has global convergence and local superlinear convergence. To some extent, the new algorithm can overcome the shortcomings of the SQP algorithms mentioned above.展开更多
文摘In order to slove the large-scale nonlinear programming （NLP） problems efficiently, an efficient optimization algorithm based on reduced sequential quadratic programming （rSQP） and automatic differentiation （AD） is presented in this paper. With the characteristics of sparseness, relatively low degrees of freedom and equality constraints utilized, the nonlinear programming problem is solved by improved rSQP solver. In the solving process, AD technology is used to obtain accurate gradient information. The numerical results show that the combined algorithm, which is suitable for large-scale process optimization problems, can calculate more efficiently than rSQP itself.
文摘A new hybrid optimization algorithm was presented by integrating the gravitational search algorithm （GSA） with the sequential quadratic programming （SQP）, namely GSA-SQP, for solving global optimization problems and minimization of factor of safety in slope stability analysis. The new algorithm combines the global exploration ability of the GSA to converge rapidly to a near optimum solution. In addition, it uses the accurate local exploitation ability of the SQP to accelerate the search process and find an accurate solution. A set of five well-known benchmark optimization problems was used to validate the performance of the GSA-SQP as a global optimization algorithm and facilitate comparison with the classical GSA. In addition, the effectiveness of the proposed method for slope stability analysis was investigated using three ease studies of slope stability problems from the literature. The factor of safety of earth slopes was evaluated using the Morgenstern-Price method. The numerical experiments demonstrate that the hybrid algorithm converges faster to a significantly more accurate final solution for a variety of benchmark test functions and slope stability problems.
文摘A heuristic technique is developed for a nonlinear magnetohydrodynamics （MHD） Jeffery-Hamel problem with the help of the feed-forward artificial neural net- work （ANN） optimized with the genetic algorithm （GA） and the sequential quadratic programming （SQP） method. The twodimensional （2D） MHD Jeffery-Hamel problem is transformed into a higher order boundary value problem （BVP） of ordinary differential equations （ODEs）. The mathematical model of the transformed BVP is formulated with the ANN in an unsupervised manner. The training of the weights of the ANN is carried out with the evolutionary calculation based on the GA hybridized with the SQP method for the rapid local convergence. The proposed scheme is evaluated on the variants of the Jeffery-Hamel flow by varying the Reynold number, the Hartmann number, and the an- gles of the walls. A large number of simulations are performed with an extensive analysis to validate the accuracy, convergence, and effectiveness of the scheme. The comparison of the standard numerical solution and the analytic solution establishes the correctness of the proposed designed methodologies.
基金Acknowledgements This work was supported by the NSFC-Guangdong Joint Fund （U1201258）, the National Natural Science Foundation of China （Grant No. 61573219）, the Shandong Natural Science Funds for Distinguished Young Scholars （JQ201316）, the Fundamental Research Funds of Shandong University （2014JC028）, and the Natural Science Foundation of Fujian Province of China （2016J01280）.
文摘In this paper, we propose a new hybrid method called SQPBSA which combines backtracking search optimization algorithm （BSA） and sequential quadratic programming （SQP）. BSA, as an exploration search engine, gives a good direction to the global optimal region, while SQP is used as a local search technique to exploit the optimal solution. The experiments are carried on two suits of 28 functions proposed in the CEC-2013 competitions to verify the performance of SQPBSA. The results indicate the proposed method is effective and competitive.
文摘Loading distribution for heavy plate mill is to find optimal control solutions under the granted performance indicators and constraints including mill capacity and hypothesis of rolling models.The solutions are quite different for different performance indicators.In the article,the performance indicators and sequential quadratic programming(SQP for short below)methods employed in 5000 mm heavy plate mill of BaoSteel are penetratingly analyzed.Generally,the SQP method is an effective and fast way to solve the nonlinear programming problems with small or medium scale constraints.Early in 1976,Han put forward the SQP method for the first time and Powell made it perfect and accomplished the algorithm in 1977.In fact,SQP method was to turn a nonlinear programming problem to a series of sub set of quadratic programming problems.In the algorithm,each iteration step is to solve one quadratic programming problem.The optimal solutions will be gradually approached after quadratic programming problems were totally solved.When solving the quadratic programming problem,the active set strategy were employed which turned the constrained quadratic programming problem to unconstrained quadratic programming problem.The active set strategy made the whole quadratic programming problem be solved by a least square problem.And finally,the matrix of the least square problem would be decomposed by Q matrix and R matrix.After Q matrix and R matrix were obtained,the optimal solutions would be finally found.For loading distribution,the performance indicators were composed by plate shape and draft of each pass.Plate shape is represented by rolling force gradually reduced pass by pass with a tunable factor.The mill capacity is another performance indicator represented by draft of each pass.For heavy plate mill,the mill capacity here is the motor moment.For heavy draft,the motor would be overloaded especially for the first several passes;for small draft,the motor would be loaded slightly.All these would not be permitted to happen when calculating the loading distribution.The mill capacity indicator made the loading of mill just be in the middle,not too much and not too low.In the article,these two performance indicators were analyzed in detail.Examples of loading distribution results with different performance indicators were given by the SQP method.When making changes to the performance indicators,there would be different solutions to the loading distribution.For the optimal solutions to the mill,there was supposed to make changes to the factors of the performance indicators or upgrade the accuracy of the mathematical models of the rolling process.
基金The authors would like to thank the Thirteenth Five-year Plan Pioneering project of High Technology Plan of the National Department of Technology (No. 2017YFC0504101)the National Natural Science Foundations of China (Nos. 31470641, 31300534 and 31570628) for the financial support of this study.
文摘Nonlinear mixed-eirects (NLME) modek have become popular in various disciplines over the past several decades.However,the existing methods for parameter estimation imple-mented in standard statistical packages such as SAS and R/S-Plus are generally limited k) single-or multi-level NLME models that only allow nested random effects and are unable to cope with crossed random effects within the framework of NLME modeling.In t his study,wc propose a general formulation of NLME models that can accommodate both nested and crassed random effects,and then develop a computational algorit hm for parameter estimation based on normal assumptions.The maximum likelihood estimation is carried out using the first-order conditional expansion (FOCE) for NLME model linearization and sequential quadratic programming (SCJP) for computational optimization while ensuring positive-definiteness of the estimated variance-covariance matrices of both random effects and error terms.The FOCE-SQP algorithm is evaluated using the height and diameter data measured on trees from Korean larch (L.olgeiisis var,Chang-paienA.b) experimental plots aa well as simulation studies.We show that the FOCE-SQP method converges fast with high accuracy.Applications of the general formulation of NLME models are illustrated with an analysis of the Korean larch data.
文摘In this study,the design of a computational heuristic based on the nonlinear Liénard model is presented using the efficiency of artificial neural networks(ANNs)along with the hybridization procedures of global and local search approaches.The global search genetic algorithm(GA)and local search sequential quadratic programming scheme(SQPS)are implemented to solve the nonlinear Liénard model.An objective function using the differential model and boundary conditions is designed and optimized by the hybrid computing strength of the GA-SQPS.The motivation of the ANN procedures along with GA-SQPS comes to present reliable,feasible and precise frameworks to tackle stiff and highly nonlinear differentialmodels.The designed procedures of ANNs along with GA-SQPS are applied for three highly nonlinear differential models.The achieved numerical outcomes on multiple trials using the designed procedures are compared to authenticate the correctness,viability and efficacy.Moreover,statistical performances based on different measures are also provided to check the reliability of the ANN along with GASQPS.
文摘This study presents a hybrid algorithm obtained by combining a genetic algorithm (GA) with successive quadratic sequential programming (SQP), namely GA-SQP. GA is the main optimizer, whereas SQP is used to refine the results of GA, further improving the solution quality. The problem formulation is done in the framework named RUNE (fRamework for aUtomated aNalog dEsign), which targets solving nonlinear mono-objective and multi-objective optimization problems for analog circuits design. Two circuits are presented: a transimpedance amplifier (TIA) and an optical driver (Driver), which are both part of an Optical Network-on-Chip (ONoC). Furthermore, convergence characteristics and robustness of the proposed method have been explored through comparison with results obtained with SQP algorithm. The outcome is very encouraging and suggests that the hybrid proposed method is very efficient in solving analog design problems.
基金Project partly supported by the National Natural Science Foundation of China and Tianyuan Foundation of China.
文摘For current sequential quadratic programming (SQP) type algorithms, there exist two problems; (i) in order to obtain a search direction, one must solve one or more quadratic programming subproblems per iteration, and the computation amount of this algorithm is very large. So they are not suitable for the large-scale problems; (ii) the SQP algorithms require that the related quadratic programming subproblems be solvable per iteration, but it is difficult to be satisfied. By using e-active set procedure with a special penalty function as the merit function, a new algorithm of sequential systems of linear equations for general nonlinear optimization problems with arbitrary initial point is presented This new algorithm only needs to solve three systems of linear equations having the same coefficient matrix per iteration, and has global convergence and local superlinear convergence. To some extent, the new algorithm can overcome the shortcomings of the SQP algorithms mentioned above.
