• MARCO LA CASCIA Dipartimento di Ingegneria Informatica, Universit`a degli Studi di Palermo viale delle Scienze ed. 6, Palermo, Italy
  • MARCO MORANA Dipartimento di Ingegneria Informatica, Universit`a degli Studi di Palermo viale delle Scienze ed. 6, Palermo, Italy
  • FILIPPO VELLA Istituto di Calcolo e Reti ad Alte Prestazioni, Consiglio Nazionale delle Ricerche viale delle Scienze ed. 11, Palermo, Italy


CBIR - Content Based Image Retrieval, automatic image annotation, mobile devices


In this paper a novel approach for the automatic representation of pictures on mobile devices is proposed. With the wide diffusion of mobile digital image acquisition devices, the need for managing a large number of digital images is quickly increasing. In fact, the storage capacity of such devices allow users to store hundreds or even thousands, of pictures that, without a proper organization, become useless. Users may be interested in using (i.e., browsing, saving, printing and so on) a subset of stored data according to some particular picture properties. A content-based description of each picture is needed to perform on-board image indexing. In our work, the images are analyzed and described in three representation spaces, namely, faces, background and time of capture. Faces are automatically detected, and a face representation is produced by projecting the face itself in a common low dimensional eigenspace. Backgrounds are represented with low-level visual features based on RGB histogram and Gabor filter bank. Temporal data is obtained through the extraction of EXIF (Exchangeable Image File Format) data. Faces, background and time information of each image in the collection is automatically organized using a mean-shift clustering technique. Significance of clustering has been evaluated on a realistic set of about 1000 images and results are promising.



Download data is not yet available.


A. Graham, H. Garcia-Molina, A. Paepcke, and T. Winograd. Time as essence for photo browsing

through personal digital libraries. In Proceedings of ACM/IEEE Joint Conference on Digital

Libraries (JCDL), 2002.

Edoardo Ardizzone, Marco La Cascia, and Filippo Vella. Mean shift clustering for personal photo

album organization. In IEEE International Conference on Image Processing (ICIP), pages 85–88.

IEEE, 2008.

H. Kang and B. Shneiderman. Visualization methods for personal photo collections: Browsing

and searching in the photofinder. In Proceedings of IEEE International Conference on Multimedia

and Expo (ICME), 2000.

L. Zhang, L. Chen, M. Li, and H. Zhang. Automated annotation of human faces in family albums.

In Proceedings of ACM International Conference on Multimedia, 2003.

M. Naaman, R. B. Yeh, H. Garcia-Molina, and A. Paepcke. Leveraging context to resolve identity

in photo albums. In Proceedings of ACM/IEEE Joint Conference on Digital Libraries (JCDL),

B. N. Lee, W.-Y. Chen, and E. Y. Chang. A scalable service for photo annotation, sharing and

search. In Proceedings of ACM International Conference on Multimedia, 2006.

J. Cui, F. Wen, R. Xiao, Y. Tian, and X. Tang. Easyalbum: An interactive photo annotation

system based on face clustering and re-ranking. In Proceedings of ACM Special Interest Group on

Computer-Human Interaction, 2007.

A. Girgensohn, J. Adcock, and L. Wilcox. Leveraging face recognition technology to find and

organize photos. In Proceedings of ACM International Conference on Multimedia Information

Retrieval (MIR), 2004.

L. Zhang, Y. Hu, M. Li, W. Ma, and H. Zhang. Efficient propagation for face annotation in family

albums. In Proceedings of ACM International Conference on Multimedia, 2004.

Apple Inc., Iphoto’09. Avalaible at:

M. Abdel-Mottaleb and L. Chen. Content-based photo album management using faces’ arrange-

ment. In Proceedings IEEE International Conference on Multimedia and Expo (ICME), 2004.

C.-H. Li, C.-Y. Chiu, C.-R. Huang, C.-S. Chen, and Lee-Feng Chien. Image content clustering

and summarization for photo collections. In Proceedings of ICME, pages 1033–1036, 2006.

S. Krishnamachari and M. Abdel-Mottaleb. Hierarchical clustering algorithm for fast image re-

trieval. In IS&T SPIE Conference on Storage and Retrieval for Image and Video databases VII.,

D. Deng. Content based comparison of image collection via distance measuring of self organized

maps. In Proceedings of 10th International Multimedia Modelling Conference, 2004.

J. Goldberg, S. Gordon, and H. Greenspan. Unsupervised image-set clustering using an informa-

tion theoretic framework. IEEE Transaction on Image Processing, 15(2):449–458, 2006.

T. L. Berg, A. C. Berg, J. Edwards, M. Maire, R. White, Yee-Whye Teh, E. Learned-Miller, and

D. A. Forsyth. Names and faces in the news. In Computer Vision and Pattern Recognition, 2004.

CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, volume 2, pages

II–848–II–854 Vol.2, 2004.

Deok-Hwan Kim, Chan Young Kim, and Yoon Ho Cho. Automatic generation of the initial query

set for cbir on the mobile web. In PCM (1), pages 957–968, 2005.

Karthik Kumar, Yamini Nimmagadda, Yu-Ju Hong, and Yung-Hsiang Lu. Energy conservation

by adaptive feature loading for mobile content-based image retrieval. In ISLPED ’08: Proceeding

of the thirteenth international symposium on Low power electronics and design, pages 153–158,

New York, NY, USA, 2008. ACM.

I. Ahmad, S. Abdullah, S. Kiranyaz, and M. Gabbouj. Content-based image retrieval on mobile

devices. In Proceedings of SPIE (Multimedia on Mobile Devices), 2005.

J. S. Hare and P.H. Lewis. Content-based image retrieval using a mobile device as a novel interface.

In Storage and Retrieval Methods and Applications for Multimedia, 2005.

M. Gabbouj, I. Ahmad, Malik Y. Amin, and S. Kiranyaz. Content-based image retrieval for

connected mobile devices. In Proceedings of Second International Symposium on Communications,

Control and Signal Processing (ISCCSP), 2006.

E. Ardizzone,M. La Cascia, and F. Vella. A novel approach to personal photo album representation

and management. In Proceedings of Multimedia Content Access: Algorithms and systems II. IS&T

SPIE Symposium on Electronic Imaging, volume 6820, 2008.

P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Pro-

ceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR),

M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3(1):71–

, 1991.

A.K. Jain and F. Farrokhnia. Unsupervised texture segmentation using gabor filters. In Systems,

Man and Cybernetics, 1990. Conference Proceedings., IEEE International Conference on, 1990.

X.Z. Liu, L. Zhang, M.J. Li, H.J. Zhang, and D.X. Wang. Boosting image classification with lda-

based feature combination for digital photograph management. Pattern Recognition, 38(6):887–

, June 2005.

D. Comaniciu and P. Meer. Mean shift: A robust approach toward feature space analysis. IEEE

Transaction on Pattern Analysis and Machine Intelligence, 24:603–619, May 2002.

J.C. Bezdek. Pattern Recognition with Fuzzy Object Function. Plenum, 1981.

K.L. Wu and M.S. Yang. A cluster validity index for fuzzy clustering. Pattern Recognition Letters,

:1275–1291, 2005.