An information theoretic approach to finding word groups for text classification - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Mémoires D'étudiants -- Hal-Inria+ Année : 2000

An information theoretic approach to finding word groups for text classification

Jakob Verbeek

Résumé

This thesis concerns finding the 'optimal' number of (non-overlapping) word groups for text classification. We present a method to select which words to cluster in word groups and how many such word groups to use on the basis of a set of pre-classified texts. The method involves a greedy search through the space of possible word groups. The criterion on which is navigated through this space is based on 'mutual information' and is known as 'Jensen Shannon divergence'. The criterion to decide which number of word groups to use is based on Rissanen's MDL Principle. We present empirical results that indicate that the proposed method performs well at its task. The prediction model used is based on the Naive Bayes model and the data set used for the experiments is a subset of the 20 Newsgroup data set.
Fichier principal
Vignette du fichier
verbeek00msc.pdf (572.75 Ko) Télécharger le fichier
Vignette du fichier
Ver00.png (28.77 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image

Dates et versions

inria-00321519 , version 1 (16-02-2011)

Identifiants

  • HAL Id : inria-00321519 , version 1

Citer

Jakob Verbeek. An information theoretic approach to finding word groups for text classification. Machine Learning [cs.LG]. 2000. ⟨inria-00321519⟩
105 Consultations
403 Téléchargements

Partager

Gmail Facebook X LinkedIn More