Pré-Publication, Document De Travail (Preprint/Prepublication) Année : 2025

Study of the behaviour of Nesterov Accelerated Gradient in a non convex setting: the strongly quasar convex case

Résumé

We study the convergence of Nesterov Accelerated Gradient (NAG) minimization algorithmapplied to a class of non convex functions called strongly quasar convex functions. We show thatNAG can achieve an accelerated convergence speed at the cost of a lower curvature assumption.We provide a continuous analysis through high resolution ODEs, where we show that despite thatnegative friction may appear, the solution of the system achieves accelerated rate of convergenceto the minimum. Finally, we identify the key geometrical property that, if dropped, theoreticallycancels the acceleration phenomenon.
Fichier principal
Vignette du fichier
_arXiv_version__Study_of_the_behaviour_of_Nesterov_Accelerated_Gradient_in_a_non_convex_setting__the_strongly_quasar_convex_case__Copy_.pdf (806.53 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04589853 , version 1 (29-05-2024)
hal-04589853 , version 2 (21-01-2025)

Identifiants

  • HAL Id : hal-04589853 , version 2

Citer

Julien Hermant, Jean-François Aujol, Charles Dossal, Aude Rondepierre. Study of the behaviour of Nesterov Accelerated Gradient in a non convex setting: the strongly quasar convex case. 2025. ⟨hal-04589853v2⟩
144 Consultations
96 Téléchargements

Partager

More