SciELO - Scientific Electronic Library Online

 
vol.55 número1Modeling the dengue fever transmission in a periodic environment índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

  • Em processo de indexaçãoCitado por Google
  • Não possue artigos similaresSimilares em SciELO
  • Em processo de indexaçãoSimilares em Google

Compartilhar


Revista Colombiana de Matemáticas

versão impressa ISSN 0034-7426

Rev.colomb.mat. vol.55 no.1 Bogotá jan./jun. 2021  Epub 17-Nov-2021

https://doi.org/10.15446/recolma.v55n1.99100 

ORIGINAL ARTICLES

A Spectral Gradient Projection Method for the Positive Semi-definite Procrustes Problem

Un Método de Gradiente Proyectado Espectral para el Problema de Mínimos Cuadrados Matricial Semi-definido Positivo

Harry Oviedo1  * 

1 Fundação Getulio Vargas - Escola de Matemática Aplicada, FGV\EMAp, Brazil, Rio de Janeiro, Brasil


Abstract

This paper addresses the positive semi-definite procrustes problem (PSDP). The PSDP corresponds to a least squares problem over the set of symmetric and semi-definite positive matrices. These kinds of problems appear in many applications such as structure analysis, signal processing, among others. A non-monotone spectral projected gradient algorithm is proposed to obtain a numerical solution for the PSDP. The proposed algorithm employs the Zhang and Hager's non-monotone technique in combination with the Barzilai and Borwein's step size to accelerate convergence. Some theoretical results are presented. Finally, numerical experiments are performed to demonstrate the effectiveness and eficiency of the proposed method, and comparisons are made with other state-of-the-art algorithms.

Keywords: Non-monotone algorithm; Constrained optimization; Symmetric positive semi-definite constraints; Least-Square problems

Resumen

En este artículo abordamos el problema de mínimos cuadrados lineales sobre el conjunto de matrices simétricas y definidas positivas (PSDP). Esta clase de problemas surge en un gran número de aplicaciones tales como análisis de estructuras, procesamiento de señales, análisis de componentes principales, entre otras. Para resolver este tipo de problemas, proponemos un método de gradiente proyectado espectral no-monótono. El algoritmo propuesto usa la técnica de globalización no-monótona de Zhang y Hager, en combinación con los tamaños de paso de Barzilai y Borwein para acelerar la convergencia del método. Además, presentamos y comentamos algunos resultados teóricos concernientes al algoritmo desarrollado. Finalmente, llevamos a cabo varios experimentos numéricos con el fin de demostrar la efectividad y la eficiencia del nuevo enfoque, y realizamos comparaciones con algunos métodos existentes en la literatura.

Palabras clave: Algoritmo no-monótono; optimización con restricciones; restricciones simétricas y semi definidas positivas; problema de mínimos cuadrados

Texto PDF

References

1. Lars-Erik Andersson and Tommy Elfving, A constrained procrustes problem, SIAM Journal on Matrix Analysis and Applications 18 (1997), no. 1, 124-139. [ Links ]

2. Negin Bagherpour and Nezam Mahdavi-Amiri, Efficient algorithms for positive semi-definite total least squares problems, minimum rank problem and correlation matrix computation, arXiv preprint arXiv:1407.3894 (2014). [ Links ]

3. Jonathan Barzilai and Jonathan M Borwein, Two-point step size gradient methods, IMA journal of numerical analysis 8 (1988), no. 1, 141-148. [ Links ]

4. Dimitri P Bertsekas, Nonlinear programming, Journal of the Operational Research Society 48 (1997), no. 3, 334-334. [ Links ]

5. John E Brock, Optimal matrices describing linear systems., AIAA Journal 6 (1968), no. 7, 1292-1296. [ Links ]

6. Yu-Hong Dai and Roger Fletcher, Projected barzilai-borwein methods for large-scale box-constrained quadratic programming, Numerische Mathematik 100 (2005), no. 1, 21-47. [ Links ]

7. JB Francisco, FS Viloche Bazan, and M Weber Mendonça, Non-monotone algorithm for minimization on arbitrary domains with applications to large-scale orthogonal procrustes problem, Applied Numerical Mathematics 112 (2017), 51-64. [ Links ]

8. Nicolas Gillis and Punit Sharma, A semi-analytical approach for the positive semidefinite procrustes problem, Linear Algebra and its Applications 540 (2018), 112-137. [ Links ]

9. Nicholas J Higham, Computing a nearest symmetric positive semidefinite matrix, Linear Algebra and its Applications 103 (1988), 103-118. [ Links ]

10. Anping Liao and Zhongzhi Bai, Least-squares solution of ax b= d over symmetric positive semidefinite matrices x, Journal of Computational Mathematics (2003), 175-182. [ Links ]

11. Yurii Nesterov, Introductory lectures on convex programming volume i: Basic course, Lecture notes 3 (1998), no. 4, 5. [ Links ]

12. Jorge Nocedal and Stephen Wright, Numerical optimization, Springer Science & Business Media, 2006. [ Links ]

13. Marcos Raydan, The barzilai and borwein gradient method for the large scale unconstrained minimization problem, SIAM Journal on Optimization 7 (1997), no. 1, 26-33. [ Links ]

14. TJ Suffridge and TL Hayden, Approximation by a hermitian positive semidefinite toeplitz matrix, SIAM Journal on Matrix Analysis and Applications 14 (1993), no. 3, 721-734. [ Links ]

15. Kim-Chuan Toh, An inexact primal-dual path following algorithm for convex quadratic sdp, Mathematical programming 112 (2008), no. 1, 221-254. [ Links ]

16. Kim-Chuan Toh, Michael J Todd, and Reha H Tütüncü, Sdpt3a matlab software package for semidefinite programming, version 1.3, Optimization methods and software 11 (1999), no. 1-4, 545-581. [ Links ]

17. Keith G Woodgate, Least-squares solution of f= pg over positive semidefinite symmetric p, Linear Algebra and its Applications 245 (1996), 171-190. [ Links ]

18. Hongchao Zhang and William W Hager, A nonmonotone line search technique and its application to unconstrained optimization, SIAM Journal on Optimization 14 (2004), no. 4, 1043-1056. [ Links ]

Received: June 12, 2020; Accepted: March 06, 2021

* Correspondencia: Harry Oviedo, Matemática Aplicada, Fundação Getulio Vargas, Escola de Matemática Aplicada, FGV\EMAp, Brazil. Correo electrónico: harry.leon@fgv.br. DOI: https://doi.org/10.15446/recolma.v55n1.99100

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License