New quality indexes for optimal clustering model identification with high dimensional data - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2015

New quality indexes for optimal clustering model identification with high dimensional data

Abstract

Feature maximization is an alternative measure to usual distributional measures relying on entropy or on Chi-square metric or vector-based measures such as Euclidean distance or correlation distance. One of the key advantages of this measure is that it is operational in an incremental mode both on clustering and on traditional classification. In the classification framework, it does not present the limitations of the aforementioned measures in the case of the processing of highly unbalanced, heterogeneous and highly multidimensional data. We shall present a new application of this measure in the clustering context for the creation of new cluster quality indexes which can be efficiently applied for a low-to-high dimensional range of data and which are tolerant to noise. We shall compare the behavior of these new indexes with usual cluster quality indexes based on Euclidean distance on different kinds of test datasets for which ground truth is available. This comparison clearly highlights the superior accuracy and stability of the new method.
No file

Dates and versions

hal-01263880 , version 1 (28-01-2016)

Licence

Identifiers

Cite

Jean-Charles Lamirel, Pascal Cuxac. New quality indexes for optimal clustering model identification with high dimensional data. ICDM-HDM’15 - International Workshop on High Dimensional Data Mining, Nov 2015, Atlantic City, United States. ⟨10.1109/ICDMW.2015.220⟩. ⟨hal-01263880⟩
81 View
0 Download

Altmetric

Share

More