Dimension-Grouped Mixed Membership Models for Multivariate Categorical Data - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Journal of Machine Learning Research Year : 2023

Dimension-Grouped Mixed Membership Models for Multivariate Categorical Data


Mixed Membership Models (MMMs) are a popular family of latent structure models for complex multivariate data. Instead of forcing each subject to belong to a single cluster, MMMs incorporate a vector of subject-specific weights characterizing partial membership across clusters. With this flexibility come challenges in uniquely identifying, estimating, and interpreting the parameters. In this article, we propose a new class of Dimension-Grouped MMMs (Gro-M3s) for multivariate categorical data, which improve parsimony and interpretability. In Gro-M3s, observed variables are partitioned into groups such that the latent membership is constant for variables within a group but can differ across groups. Traditional latent class models are obtained when all variables are in one group, while traditional MMMs are obtained when each variable is in its own group. The new model corresponds to a novel decomposition of probability tensors. Theoretically, we derive transparent identifiability conditions for both the unknown grouping structure and model parameters in general settings. Methodologically, we propose a Bayesian approach for Dirichlet Gro-M3s to inferring the variable grouping structure and estimating model parameters. Simulation results demonstrate good computational performance and empirically confirm the identifiability results. We illustrate the new methodology through applications to a functional disability survey dataset and a personality test dataset.
Fichier principal
Vignette du fichier
GuErosXuDun-Gro_MMM.pdf (1.59 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03522275 , version 1 (12-01-2022)




Yuqi Gu, Elena Erosheva, Gongjun Xu, David Dunson. Dimension-Grouped Mixed Membership Models for Multivariate Categorical Data. Journal of Machine Learning Research, 2023, 24 (88), pp.49. ⟨hal-03522275⟩
53 View
73 Download



Gmail Mastodon Facebook X LinkedIn More