Factorized variable metric methods for unconstrained optimization

Several effilcient methods are given for updating the Cholesky factors of a symmetric positive definite matrix when it is modified by a rank-two correction which maintains symmetry and positive definiteness. These ideas are applied to variable metric (quasi-Newton) methods to produce numerically stable algorithms.

[1]  Roger Fletcher,et al.  A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[2]  C. G. Broyden.  A Class of Methods for Solving Nonlinear Simultaneous Equations , 1965 .

[3]  J. M. Bennett.  Triangular factors of modified matrices , 1965 .

[4]  C. G. Broyden.  Quasi-Newton methods and their application to function minimisation , 1967 .

[5]  Y. Bard.  On a numerical instability of Davidon-like methods , 1968 .

[6]  William C. Davidon,et al.  Variance Algorithm for Minimization , 1968, Comput. J..

[7]  C. G. Broyden.  The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations , 1970 .

[8]  R. Fletcher,et al.  A New Approach to Variable Metric Algorithms , 1970, Comput. J..

[9]  C. G. Broyden.  The Convergence of a Class of Double-rank Minimization Algorithms 2. The New Algorithm , 1970 .

[10]  D. Shanno.  Conditioning of Quasi-Newton Methods for Function Minimization , 1970 .

[11]  D. Goldfarb.  A family of variable-metric methods derived by variational means , 1970 .

[12]  M. Powell.  On the Convergence of the Variable Metric Algorithm , 1971 .

[13]  L. C W. Dixon,et al.  Quasi-newton algorithms generate identical points , 1972, Math. Program..

[14]  Roger Fletcher,et al.  FORTRAN subroutines for minimization by quasi-Newton methods , 1972 .

[15]  D. Goldfarb.  Variable metric and conjugate direction methods in unconstrained optimization: recent developments , 1972, ACM Annual Conference.

[16]  P. Gill,et al.  Quasi-Newton Methods for Unconstrained Optimization , 1972 .

[17]  W. E. Gentleman.  Least Squares Computations by Givens Transformations Without Square Roots , 1973 .

[18]  M. Powell,et al.  On the Modification of LDL T Factorizations , 1974 .

[19]  Donald Goldfarb,et al.  Matrix factorizations in optimization of nonlinear functions subject to linear constraints , 1976, Math. Program..