AUTOMATIC IMAGE REPRESENTATION AND CLUSTERING ON MOBILE DEVICES
Keywords:
CBIR - Content Based Image Retrieval, automatic image annotation, mobile devicesAbstract
In this paper a novel approach for the automatic representation of pictures on mobile devices is proposed. With the wide diffusion of mobile digital image acquisition devices, the need for managing a large number of digital images is quickly increasing. In fact, the storage capacity of such devices allow users to store hundreds or even thousands, of pictures that, without a proper organization, become useless. Users may be interested in using (i.e., browsing, saving, printing and so on) a subset of stored data according to some particular picture properties. A content-based description of each picture is needed to perform on-board image indexing. In our work, the images are analyzed and described in three representation spaces, namely, faces, background and time of capture. Faces are automatically detected, and a face representation is produced by projecting the face itself in a common low dimensional eigenspace. Backgrounds are represented with low-level visual features based on RGB histogram and Gabor filter bank. Temporal data is obtained through the extraction of EXIF (Exchangeable Image File Format) data. Faces, background and time information of each image in the collection is automatically organized using a mean-shift clustering technique. Significance of clustering has been evaluated on a realistic set of about 1000 images and results are promising.
Downloads
References
A. Graham, H. Garcia-Molina, A. Paepcke, and T. Winograd. Time as essence for photo browsing
through personal digital libraries. In Proceedings of ACM/IEEE Joint Conference on Digital
Libraries (JCDL), 2002.
Edoardo Ardizzone, Marco La Cascia, and Filippo Vella. Mean shift clustering for personal photo
album organization. In IEEE International Conference on Image Processing (ICIP), pages 85–88.
IEEE, 2008.
H. Kang and B. Shneiderman. Visualization methods for personal photo collections: Browsing
and searching in the photofinder. In Proceedings of IEEE International Conference on Multimedia
and Expo (ICME), 2000.
L. Zhang, L. Chen, M. Li, and H. Zhang. Automated annotation of human faces in family albums.
In Proceedings of ACM International Conference on Multimedia, 2003.
M. Naaman, R. B. Yeh, H. Garcia-Molina, and A. Paepcke. Leveraging context to resolve identity
in photo albums. In Proceedings of ACM/IEEE Joint Conference on Digital Libraries (JCDL),
B. N. Lee, W.-Y. Chen, and E. Y. Chang. A scalable service for photo annotation, sharing and
search. In Proceedings of ACM International Conference on Multimedia, 2006.
J. Cui, F. Wen, R. Xiao, Y. Tian, and X. Tang. Easyalbum: An interactive photo annotation
system based on face clustering and re-ranking. In Proceedings of ACM Special Interest Group on
Computer-Human Interaction, 2007.
A. Girgensohn, J. Adcock, and L. Wilcox. Leveraging face recognition technology to find and
organize photos. In Proceedings of ACM International Conference on Multimedia Information
Retrieval (MIR), 2004.
L. Zhang, Y. Hu, M. Li, W. Ma, and H. Zhang. Efficient propagation for face annotation in family
albums. In Proceedings of ACM International Conference on Multimedia, 2004.
Apple Inc., Iphoto’09. Avalaible at: http://www.apple.com/ilife/iphoto/.
M. Abdel-Mottaleb and L. Chen. Content-based photo album management using faces’ arrange-
ment. In Proceedings IEEE International Conference on Multimedia and Expo (ICME), 2004.
C.-H. Li, C.-Y. Chiu, C.-R. Huang, C.-S. Chen, and Lee-Feng Chien. Image content clustering
and summarization for photo collections. In Proceedings of ICME, pages 1033–1036, 2006.
S. Krishnamachari and M. Abdel-Mottaleb. Hierarchical clustering algorithm for fast image re-
trieval. In IS&T SPIE Conference on Storage and Retrieval for Image and Video databases VII.,
D. Deng. Content based comparison of image collection via distance measuring of self organized
maps. In Proceedings of 10th International Multimedia Modelling Conference, 2004.
J. Goldberg, S. Gordon, and H. Greenspan. Unsupervised image-set clustering using an informa-
tion theoretic framework. IEEE Transaction on Image Processing, 15(2):449–458, 2006.
T. L. Berg, A. C. Berg, J. Edwards, M. Maire, R. White, Yee-Whye Teh, E. Learned-Miller, and
D. A. Forsyth. Names and faces in the news. In Computer Vision and Pattern Recognition, 2004.
CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, volume 2, pages
II–848–II–854 Vol.2, 2004.
Deok-Hwan Kim, Chan Young Kim, and Yoon Ho Cho. Automatic generation of the initial query
set for cbir on the mobile web. In PCM (1), pages 957–968, 2005.
Karthik Kumar, Yamini Nimmagadda, Yu-Ju Hong, and Yung-Hsiang Lu. Energy conservation
by adaptive feature loading for mobile content-based image retrieval. In ISLPED ’08: Proceeding
of the thirteenth international symposium on Low power electronics and design, pages 153–158,
New York, NY, USA, 2008. ACM.
I. Ahmad, S. Abdullah, S. Kiranyaz, and M. Gabbouj. Content-based image retrieval on mobile
devices. In Proceedings of SPIE (Multimedia on Mobile Devices), 2005.
J. S. Hare and P.H. Lewis. Content-based image retrieval using a mobile device as a novel interface.
In Storage and Retrieval Methods and Applications for Multimedia, 2005.
M. Gabbouj, I. Ahmad, Malik Y. Amin, and S. Kiranyaz. Content-based image retrieval for
connected mobile devices. In Proceedings of Second International Symposium on Communications,
Control and Signal Processing (ISCCSP), 2006.
E. Ardizzone,M. La Cascia, and F. Vella. A novel approach to personal photo album representation
and management. In Proceedings of Multimedia Content Access: Algorithms and systems II. IS&T
SPIE Symposium on Electronic Imaging, volume 6820, 2008.
P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Pro-
ceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR),
M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3(1):71–
, 1991.
A.K. Jain and F. Farrokhnia. Unsupervised texture segmentation using gabor filters. In Systems,
Man and Cybernetics, 1990. Conference Proceedings., IEEE International Conference on, 1990.
X.Z. Liu, L. Zhang, M.J. Li, H.J. Zhang, and D.X. Wang. Boosting image classification with lda-
based feature combination for digital photograph management. Pattern Recognition, 38(6):887–
, June 2005.
D. Comaniciu and P. Meer. Mean shift: A robust approach toward feature space analysis. IEEE
Transaction on Pattern Analysis and Machine Intelligence, 24:603–619, May 2002.
J.C. Bezdek. Pattern Recognition with Fuzzy Object Function. Plenum, 1981.
K.L. Wu and M.S. Yang. A cluster validity index for fuzzy clustering. Pattern Recognition Letters,
:1275–1291, 2005.
