logo Idiap Research Institute        
 [BibTeX] [Marc21]
Kernelized Infomax Clustering
Type of publication: Idiap-RR
Citation: barber:rr05-73
Number: Idiap-RR-73-2005
Year: 2005
Institution: IDIAP
Abstract: We propose a simple information-theoretic clustering approach based on maximizing the mutual information $I(\sfx,y)$ between the unknown cluster labels $y$ and the training patterns $\sfx$ with respect to parameters of specifically constrained encoding distributions. The constraints are chosen such that patterns are likely to be clustered similarly if they lie close to specific (unknown) vectors in the feature space. The method may be conveniently applied to learning the optimal affinity matrix, which corresponds to learning parameters of the kernelized encoder. The procedure does not require computations of eigenvalues or inverses of the Gram matrices, which makes it potentially attractive for clustering large data sets.
Userfields: ipdmembership={learning},
Projects Idiap
Authors Agakov, Felix
Barber, David
Added by: [UNK]
Total mark: 0
  • barber-idiap-rr-05-73.pdf
  • barber-idiap-rr-05-73.ps.gz