Joint Image Clustering and Labeling by Matrix Factorization

Seunghoon Hong, Jonghyun Choi, Jan Feyereisl, Bohyung Han, Larry S. Davis

Research output: Contribution to journalArticlepeer-review

33 Citations (Scopus)


We propose a novel algorithm to cluster and annotate a set of input images jointly, where the images are clustered into several discriminative groups and each group is identified with representative labels automatically. For these purposes, each input image is first represented by a distribution of candidate labels based on its similarity to images in a labeled reference image database. A set of these label-based representations are then refined collectively through a non-negative matrix factorization with sparsity and orthogonality constraints; the refined representations are employed to cluster and annotate the input images jointly. The proposed approach demonstrates performance improvements in image clustering over existing techniques, and illustrates competitive image labeling accuracy in both quantitative and qualitative evaluation. In addition, we extend our joint clustering and labeling framework to solving the weakly-supervised image classification problem and obtain promising results.

Original languageEnglish
Article number7293679
Pages (from-to)1411-1424
Number of pages14
JournalIEEE transactions on pattern analysis and machine intelligence
Issue number7
Publication statusPublished - 2016 Jul 1

Bibliographical note

Publisher Copyright:
© 2015 IEEE.

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics


Dive into the research topics of 'Joint Image Clustering and Labeling by Matrix Factorization'. Together they form a unique fingerprint.

Cite this