R. Pytlak and T. Tarnawski
Key words:
preconditioned conjugate gradient, large scale problems, unconstrained optimization
Mathematices Subject Classification: 90C06, 90C26, 65K05
ONLINE SUBSCRIPTION (Institutional Subscription Only)
Copyright© 2006 Yokohama Publishers
Back

Abstract:
The paper describes a new conjugate gradient algorithms for large scale nonconvex problems. In order to speed up the convergence the algorithms employ a scaling matrix which transforms the space of original variables into the space in which Hessian matrices of functionals describing the problems have more clustered eigenvalues. This is done efficiently by applying limited memory BFGS updating matrices. Once the scaling matrix is calculated, the next few iterations of the conjugate gradient algorithms are performed in the transformed space. We believe that the preconditioned conjugate gradient algorithms give more flexibility in achieving balance between the computing time and the number of function evaluations in comparison to a limited memory BFGS algorithm. We give some numerical results which support our claim.
Preconditioned conjugate gradient algorithms for nonconvex problems

Special Issue on Conjugate Gradient and Quasi-Newton Methods for Nonlinear Optimization
Volume 2, Number 1, January 2006, pp. 81-104