Accessibility navigation


Approximating large-scale Hessian matrices using secant equations

Fowkes, J. M., Gould, N. I. M. and Scott, J. A. ORCID: https://orcid.org/0000-0003-2130-1091 (2025) Approximating large-scale Hessian matrices using secant equations. ACM Transactions on Mathematical Software (TOMS). ISSN 1557-7295 (In Press)

[thumbnail of FowkesGouldScott_Hessians_TOMS2025.pdf] Text - Accepted Version
· Restricted to Repository staff only
· The Copyright of this document has not been checked yet. This may affect its availability.

1MB

It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing.

To link to this item DOI: 10.1145/3728460

Abstract/Summary

Large-scale optimization algorithms frequently require sparse Hessian matrices that are not readily available. Existing methods for approximating large sparse Hessian matrices either do not impose sparsity or are computationally prohibitive. To try and overcome these limitations, we propose a novel approach that seeks to satisfy as many componentwise secant equations as necessary to define each row of the Hessian matrix. A naive application of this approach is too expensive for Hessian matrices that have some relatively dense rows but, by carefully taking into account the symmetry and connectivity of the Hessian matrix, we are able devise an approximation algorithm that is fast and efficient with scope for parallelism. Example sparse Hessian matrices from the CUTEst test collection for optimization illustrate the effectiveness and robustness of our proposed method.

Item Type:Article
Refereed:Yes
Divisions:Science > School of Mathematical, Physical and Computational Sciences > Department of Mathematics and Statistics
ID Code:122164
Publisher:Association for Computing Machinery (ACM)

University Staff: Request a correction | Centaur Editors: Update this record

Page navigation