Stratified Principal Component Analysis - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Stratified Principal Component Analysis

Résumé

This paper investigates a general family of models that stratifies the space of covariance matrices by eigenvalue multiplicity. This family, coined Stratified Principal Component Analysis (SPCA), includes in particular Probabilistic PCA (PPCA) models, where the noise component is assumed to be isotropic. We provide an explicit maximum likelihood and a geometric characterization relying on flag manifolds. A key outcome of this analysis is that PPCA's parsimony (with respect to the full covariance model) is due to the eigenvalue-equality constraint in the noise space and the subsequent inference of a multidimensional eigenspace. The sequential nature of flag manifolds enables to extend this constraint to the signal space and bring more parsimonious models. Moreover, the stratification and the induced partial order on SPCA yield efficient model selection heuristics. Experiments on simulated and real datasets substantiate the interest of equalising adjacent sample eigenvalues when the gaps are small and the number of samples is limited. They notably demonstrate that SPCA models achieve a better complexity/goodness-of-fit tradeoff than PPCA.
Fichier principal
Vignette du fichier
Stratified-PCA.pdf (578.36 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : Copyright (Tous droits réservés)

Dates et versions

hal-04171853 , version 1 (26-07-2023)
hal-04171853 , version 2 (02-11-2023)

Licence

Copyright (Tous droits réservés)

Identifiants

Citer

Tom Szwagier, Xavier Pennec. Stratified Principal Component Analysis. 2023. ⟨hal-04171853v1⟩
82 Consultations
109 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More