Review: Automatic Semantic Image Annotation

  • Shereen A. Hussein Computer Science Department, Helwan University, Cairo
  • Howida Youssry Abd El Naby Computer Science Department, Misr University for Science & Technology, Cairo
  • Aliaa A. A. Youssif Computer Science Department, Helwan University, Cairo
Keywords: Image indexing, Visual Features, Content-Based Image Retrieval, Image annotation, Semantic Image annotation, Semantic Gap


There are many approaches for automatic annotation in digital images. Nowadays digital photography is a common technology for capturing and archiving images because of the digital cameras and storage devices reasonable price. As amount of the digital images increase, the problem of annotating a specific image becomes a critical issue. Automated image annotation is creating a model capable of assigning terms to an image in order to describe its content. There are many image annotation techniques that seek to find the correlation between words and image features such as color, shape, and texture to provide an automatically correct annotation words to images which provides an alternative to the time consuming work of manual image annotation. This paper aims to cover a review on different Models (MT, CRM, CSD-Prop, SVD-COS and CSD-SVD) for automating the process of image annotation as an intermediate step in image retrieval process using Corel 5k images.


[1] Gong, Tianxia, Shimiao Li, and Chew Lim Tan. "A Semantic Similarity Language Model to Improve Automatic Image
Annotation." Proceedings of the 2010 22nd IEEE International Conference on Tools with Artificial Intelligence, Vol 01. IEEE Computer
Society, 2010.
[2] Albatal, Rami, Philippe Mulhem, and Yves Chiaramella. "A new ROI grouping schema for automatic image annotation." Multimedia
and Expo (ICME), 2011, IEEE International Conference on. IEEE, 2011.
[3] JingLiua,,Mingjing Lib, Qingshan Liua, Hanqing Lua, Songde Ma, Image Annotation via graph learning, Pattern Recognition 42,
2009, pp. 218-228.
[4] Shin, Yunhee, Youngrae Kim, and Eun Yi Kim. "Automatic textile image annotation by predicting emotional concepts from visual
features" Image and Vision Computing, vol.3, pp.526-537,2010.
[5] Syaifulnizam Abd Manal and Md Jan Nordin “Review on statistical approaches for automatic image annotation, 2009 international
conference on electrical engineering and informatics, IEEE, 2009.
[6] Ye, Lei, Philip Ogunbona, and Jianqiang Wang. "Image content annotation based on visual features" Multimedia, 2006. ISM'06.
Eighth IEEE International Symposium on. IEEE, 2006.
[7] He, Dongjian, et al. "Ensemble of multiple descriptors for automatic image annotation." Image and Signal Processing (CISP), 2010
3rd International Congress on. Vol. 4. IEEE, 2010.
[8] Hamid ansari, Mansour Jamzad “Large-Scale Image Annotation using Prototype-based Models”, 7th International Symposium on
Image and Signal Processing and Analysis (ISPA), 2011.
[9] Abdollahian, Golnaz, et al. "A region-dependent image matching method for image and video annotation." Content-Based
Multimedia Indexing (CBMI), 2011 9th International Workshop on. IEEE, 2011.
[10] Lei, Yinjie, et al. "Integrating visual classifier ensemble with term extraction for Automatic Image Annotation." Industrial Electronics
and Applications (ICIEA), 6th IEEE Conference on. IEEE, 2011.
[11] Hua Wang, Heng Huang and Chris Ding, “Image Annotation Using Bi-Relational Graph of Images and Semantic Labels”, pp. 126–
139, 2011.
[12] Ran Li, YaFei Zhang, Zining Lu, Jianjiang Lu, Yulong Tian “Techniqu of Image Retrieval Based on Multi-label Image Annotation",
2nd International Conference on MultiMedia and Information Technology, 2010.
[13] Hichem Bannour, "Building and Using Knowledge Models for Semantic Image Annotation", Ph.D. dissertation, Ecole Centrale
Paris, MAS Laboratry, March, 2013.
[14] L. Wenyin, S. Dumais, Y. Sun, H. J. Zhang, M. Czerwinski and B.Field, “Semi-Automatic Image Annotation”, 8th IFIP T.C 13
Conference on Human-Computer Interaction, pp. 326-333, 2002.
[15] C. F. Tsai and C. Hung, “Automatically Annotating Images with Keywords: A Review of Image Annotation Systems” Recent
Patents on Computer Science, Vol. 1, pp. 55-68, Jan., 2008.
[16] A. Han bury, “A Survey of Methods for Image Annotation,” J. Vis.Lang. Computer, vol. 19, pp. 617-627, Oct. 2008.
[17] J. Jeon, V. Lavrenko and R. Manmatha, “Automatic Image Annotation and Retrieval Using Cross-Media Relevance Model,” in
Proc. 26th annual international ACM SIGIR, 2003.
[18] Ning Yu, Kien A. Hua, Hao Cheng,” A Multi-Directional Search technique for image annotation propagation”, J. Vis. Commun.
ImagaR.23, pp. 237–244, 2012.
[19] T. Jiayu, “Automatic Image Annotation and Object Detection,” Ph.D. dissertation, Southampton Univ., United Kingdom, May 2008.
[20] Andreas Walter, and Gabor Nagypal, “ The combination techniques for automatic semantic image annotation generation in the
imagination application”, in Proc. 4th Internet imaging , Vol. SPIE 5304. 2008.
[21] Feichao Wang, “A Survey on automatic image annotation and trends of the new age”, Elsevier, 2011.
[22] Datta, Ritendra, et al. "Image retrieval: Ideas, influences, and trends of the new age." ACM Computing Surveys (CSUR), Vol. 40,
No.2, 2008.
[23] Fei Shi, Fangfang Yang, Jiajun Wang,” Supervised Semantic Image Annotation Using Region Relevance", International
Conference On Medical Physics and Biomedical Engineering, 2012.
[24] Shalini K.Kharkate, Nitin J.Janwe, “Automatic Image Annotation: A Review”, the International Journal of Computer Science &
Applications (TIJCSA), Vol. 1, No. 12, 2013.
[25] T. Sumathi, C.Lakshmi Devasena, and M.Hemalatha, “An Overview of Automated Image Annotation Approaches”, International
Journal of Research and Reviews in Information Sciences, vol. 1, No. 1, 2011.
[26] P. Duygulu, K. Barnard, J. de Freitas, and D. Forsyth., “Object recognition as machine translation: Learning a lexicon for a fixed
image vocabulary,” 7th European Conference on Computer Vision, Copenhagen, Denmark, 2002.
[27] Jiayu Tang, Paul H. Lewis, “A Study of Quality Issues for Image Auto-Annotation with the Corel Data-Set”, IEEE transactions on circuits and systems for video technology, Vol. 7, No.3, 2007.
[28] Jeon, Jiwoon, Victor Lavrenko, and Raghavan Manmatha. "Automatic image annotation and retrieval using cross-media relevance models." Proc. 26th annual international ACM SIGIR conference on Research and development in informaion retrieval. ACM, 2003.
[29] S. L. Feng, R. Manmatha, and V. Lavrenko., “Multiple Bernoulli relevance models for image and video annotation,” Proc. International Conference on Pattern Recognition (CVPR 2004), vol. 2, 2004.
[30] Rouw R., Kosslyn SM., Hamel R., “Detecting high-level and low-level properties in visual images and visual percepts”, Cognition, Vol. 63, No. 2, 1997.
How to Cite
Hussein, S. A., Naby, H. Y. A. E., & Youssif, A. A. A. (2016). Review: Automatic Semantic Image Annotation. INTERNATIONAL JOURNAL OF COMPUTERS & TECHNOLOGY, 15(12), 7290-7297.