期刊文献+

一类非单调保守BFGS算法研究 被引量:3

INVESTIGATION ON A CLASS OF NONMONOTONE CAUTIOUS BFGS ALGORITHMS
原文传递
导出
摘要 基于非单调线搜索在寻求优化问题最优解中的优越性,提出了一类新的非单调保守BFGS算法.同已有方法不同,该算法中用来控制非单调性程度的算法参数不是取固定值,而是利用已有目标函数和梯度函数的信息自动调整其取值,以改善算法的数值表现.在合适的假设条件下,建立了新的非单调保守BFGS算法的全局收敛性.用基准测试优化问题测试了算法,其数值结果表明该算法比以往同类算法具有更高的计算效率. With the superiority of nonmonotone line search in finding a solution of optimization problem, a class of nonmonotone cautious BFGS algorithms are developed. Different from the existing techniques of nonmonotone line search, the parameter, which is employed to control the magnitude of nonmonotonicity, is modified (not a fixed value) by the known information of the objective function and the gradient function such that the numerical perfbrmance of the developed algorithm is improved. Under some suitable assumptions, the global convergence is proved for this algorithm. Implementing the algorithm to solve some benchmark test problems, the results demonstrate that it is more effective than the similar algorithms.
作者 万中 冯冬冬
出处 《计算数学》 CSCD 北大核心 2011年第4期387-396,共10页 Mathematica Numerica Sinica
基金 国家自然科学基金(71071162 70921001)
关键词 无约束最优化 保守BFGS方法 非单调线搜索 全局收敛性 unconstrained optimization cautious BFGS method nonmonotone line search global convergence
  • 相关文献

参考文献1

二级参考文献22

  • 1Burmenei, A., Bratkovic, F., Puhan, J., Fajfar, I., Tuma, T.: Extended global convergence framework for unconstrained optimization. Acta Mathematica Sinca, English Series, 20(3), 433-440 (2004)
  • 2Han, J. Y., Liu, G. H.: Global convergence analysis of a new nonmonotone BFGS algorithm on convex objective Functions. Computational Optimization and Applications, 7, 277-289 (1997).
  • 3Griewank, A., Toint, Ph. L.: Local convergence analysis for partitioned quasi-Newton updates. Numer. Math., 39, 429-448 (1982)
  • 4Broyden, C. G., Dennis, J. E., More, J. J.: On the local and supelinear convergence of quasi-Newton methods. J. Inst. Math. Appl., 12, 223-246 (1973)
  • 5Byrd, R., Nocedal, J., Yuan, Y.: Global convergence of a class of quasi-Newton methods on convex problems. SIAM Journal on Numerical Analysis, 24, 1171-1189 (1987)
  • 6Powell, M. J. D.: Some properties of the variable metric algorithm, In F. A. Lootsma, (ed.), Numerical Methods for Nonlinear Optimization, Academia Press, London, 1972
  • 7Powell, M. J. D.: Some global convergence properties of a variable Metric algorithm for minimization without exact linesearches, In Nonlinear Programming, SIAM-AMS Proceedings, R. W. Cottle and C. E. Lemke(eds.), Vol. Ⅸ., American Mathematrical Society, Providence, RI, 1976
  • 8Byrd, R., Nocedal, J.: A tool for the analysis of quasi-Newton methods with application to unconstrained minimization. SIAM Journal on Numerical Analysis, 26, 727-739 (1989)
  • 9Powell, M. J. D.: On the Convergence of the variable metric agorithm. J. of the Institute of Mathematics and its Applications, 7, 21-36 (1971)
  • 10Werner, J.: Uber die Globale Konvergenze von variable-metric verfahen mit nichtexakter schrittweitenbestimmung. Numer. Math., 31, 321-334 (1978)

共引文献14

同被引文献17

  • 1Andrei N. Open problems in nonlinear conjugate gradient algorithms for unconstrained optimization. Bulletin of the Malaysian Mathematical Sciences Society, 2011, 34(2): 319-330.
  • 2Brigin E C, Martinez J M. A spectral conjugate gradient method for unconstrained optimization. Appl Math Optim, 2001, 43:117-128.
  • 3Andrei N. Scaled conjugate graiient algorithms for unconstrained optimization. Comput Optim Appl, 2007, 38(3): 401-416.
  • 4Andrei N. A Dai-Yuan conjugate gradient algorithm with sufficient descent and conjugacy conditions for unconstrained optimization. Applied Mathematics Letters, 2008, 21(2): 165 -171.
  • 5Yua G H, Huang J H, Zhou Y. A descent spectral conjugate gradient method for impulse noise removal. Applied Mathematics Letters, 2010, 23(5): 555 -560.
  • 6Wan Z, Yang Z L, Wang Y L. New spectral PRP conjugate gradient method for unconstrained optimization. Appl Math Letter, 2011, 24(1): 16-22.
  • 7Lu A G, Liu H W, Zheng X Y, Cong W J. A variant spectral-type FR conjugate gradient method and its global convergence. Applied Mathematics and Computation, 2011, (217): 5547-5552.
  • 8Wan Z, Hu C M, Yang Z L. A spectral PRP conjugate gradient methods for nonconvex optimization problem based on modified line search. Discrete and Continuous Dynamical Systems (Series B), 2011, 16(4): 1157-1169.
  • 9Andrei N. Accelerated scaled memoryless BFGS preconditioned conjugate gradient algorithm for uncon- strained optimization. European Journal of Operational Research, 2010, 204(3): 410-420.
  • 10Shi Z J, Shen J. Convergence of PRP method with new nonmonotone line search. Applied Mathematics and Computation, 2006, 181:423-431.

引证文献3

二级引证文献5

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部