Personal photograph collections ontology development through thematic tags
Abstract
Purpose- The number and the variety of photos have grown to a great extent as they can be created anytime, everywhere and spontaneously. Searching for a particular photo file has become a boring, repetitive and tedious activity. The application of an ontology to express the user profile characteristics relation with the narrative, spatial, time and other types of information of the collected photos becomes imperative.
Design/methodology/approach -The work presented in our article includes the development of a personal photograph collections ontology (MyOntoPhotos) specialising in documenting the metadata of the topics that end-users prefer mostly to capture with their devices. An extensive survey, among 650 participants, was conducted with the use of an online questionnaire comprised of semi-closed questions, following the Likert scale and the scale category grading.
Findings -The ontology created was based on the results of an extensive survey aiming to identify thematic areas of interest, apart from spatial and temporal information, as other similar efforts did in the past. It is mentionable that the survey results proved the majority of the responders selected 22 thematic tags.
Originality/value - Based on the research findings an innovative concept for a mobile application is presented, focusing on enhancing end-users photo collections organizing and retrieval functions.
Keywords
References
Viana, W., Bringel Filho, J., Gensel, J., Oliver, M. V., & Martin, H. (2007). PhotoMap–Automatic Spatiotemporal Annotation for Mobile Photos. In: International Symposium on Web and Wireless Geographical Information Systems (pp. 187-201). Springer Berlin Heidelberg.
Viana, W., Miron, A. D., Moisuc, B., Gensel, J., Villanova-Oliver, M., & Martin, H. (2011). Towards the semantic and context-aware management of mobile multimedia. Multimedia Tools and Applications, 53(2), 391-429.
Van House, N. A. (2009). Collocated photo sharing, story-telling, and the performance of self. International Journal of Human-Computer Studies, 67(12), 1073-1086.
Latif, K., Mustofa, K., & Tjoa, A. M. (2006). An approach for a personal information management system for photos of a lifetime by exploiting semantics. In: International Conference on Database and Expert Systems Applications (pp. 467-477). Springer Berlin Heidelberg.
Datia, N., Pires, J. M., & Correia, N. (2016). Time and space for segmenting personal photo sets. Multimedia Tools and Applications, 1-33.
Frohlich, D., & Fennell, J. (2007). Sound, paper and memorabilia: resources for a simpler digital photography. Personal and Ubiquitous Computing, 11(2), 107-116.
Monaghan, F., & O'Sullivan, D. (2006). Automating photo annotation using services and ontologies. In: 7th International Conference on Mobile Data Management (MDM'06) (pp. 79-79). IEEE.
Do, T. M. T., Blom, J., & Gatica-Perez, D. (2011). Smartphone usage in the wild: a large-scale analysis of applications and context. In Proceedings of the 13th international conference on multimodal interfaces (pp. 353-360). ACM.
Gruber, T. R. (1993). A translation approach to portable ontology specifications. Knowledge acquisition, 5(2), 199-220.
Paralic, J., & Kostial, I. (2003). Ontology-based information retrieval. Information and Intelligent Systems, Croatia, 23-28.
Kotis, K., Vouros, G. A., & Stergiou, K. (2006). Towards automatic merging of domain ontologies: The HCONE-merge approach. Web semantics: Science, services and agents on the world wide web, 4(1), 60-79.
Horrocks, I. (2008). Ontologies and the semantic web. Communications of the ACM, 51(12), 58-67.
Lanzenberger, M., Sampson, J. J., Rester, M., Naudet, Y., & Latour, T. (2008). Visual ontology alignment for knowledge sharing and reuse. Journal of Knowledge Management, 12(6), 102-120.
Jörgensen, C. (2003). Image Retrieval: Theory and Research, Scarecrow Press, Lanham, MD.
Enser, P. G., Sandom, C. J., Hare, J. S., & Lewis, P. H. (2007). Facing the reality of semantic image retrieval. Journal of Documentation, 63(4), 465-481.
Radley, A. (2010). What people do with pictures. Visual Studies, 25(3), 268-279.
Hare, J. S., Lewis, P. H., Enser, P. G., & Sandom, C. J. (2006). Mind the gap: another look at the problem of the semantic gap in image retrieval. In Multimedia Content Analysis, Management, and Retrieval 2006 (Vol. 6073, p. 607309). International Society for Optics and Photonics.
Liu, Y., Xu, D., Tsang, I. W., & Luo, J. (2011). Textual query of personal photos facilitated by large-scale web data. IEEE transactions on pattern analysis and machine intelligence, 33(5), 1022-1036.
Tao, D., Tang, X., Li, X., & Wu, X. (2006). Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE transactions on pattern analysis and machine intelligence, 28(7), 1088-1099.
Ames, M., & Naaman, M. (2007). Why we tag: motivations for annotation in mobile and online media. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 971-980). ACM.
Marlow, C., Naaman, M., Boyd, D., & Davis, M. (2006). HT06, tagging paper, taxonomy, Flickr, academic article, to read. In: Proceedings of the 17th conference on Hypertext and hypermedia (pp. 31-40). ACM.
Highfield, T., & Leaver, T. (2015). A methodology for mapping Instagram hashtags. First Monday, 20(1), 1-11.
Ferré, S. (2007). Camelis: Organizing and browsing a personal photo collection with a logical information system. In: International Conference on Concept Lattices and Their Applications (Vol. 331, pp. 112-123).
De Figueirêdo, H. F., Lacerda, Y. A., de Paiva, A. C., Casanova, M. A., & de Souza Baptista, C. (2012). PhotoGeo: a photo digital library with spatial-temporal support and self-annotation. Multimedia Tools and Applications, 59(1), 279-305.
Graham, A., Garcia-Molina, H., Paepcke, A., & Winograd, T. (2002). Time as essence for photo browsing through personal digital libraries. In: Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries (pp. 326-335). ACM.
Toyama, K., Logan, R., & Roseway, A. (2003). Geographic location tags on digital images. In: Proceedings of the eleventh ACM international conference on Multimedia (pp. 156-166). ACM.
Bederson, B. B. (2001). PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps. In Proceedings of the 14th annual ACM symposium on User interface software and technology (pp. 71-80). ACM.
Li, J., Lim, J. H., & Tian, Q. (2003). Automatic summarization for personal digital photos. In: Proceedings of the 2003 Joint Conference of the Fourth International Conference on Information, Communications and Signal Processing, 2003 and Fourth Pacific Rim Conference on Multimedia. (Vol. 3, pp. 1536-1540). IEEE.
Kindberg, T., Spasojevic, M., Fleck, R., & Sellen, A. (2005). The ubiquitous camera: An in-depth study of camera phone use. IEEE Pervasive Computing, 4(2), 42-50.
Van House, N. A., Davis, M., Takhteyev, Y., Ames, M., & Finn, M. (2004). The social uses of personal photography: methods for projecting future imaging applications. University of California, Berkeley, Working Papers, 3, 2005.
Bruneau, P., Pigeau, A., Gelgon, M., & Picarougne, F. (2008). Geo-temporal structuring of a personal image database with two-level variational-Bayes mixture estimation. In International Workshop on Adaptive Multimedia Retrieval (pp. 127-139). Springer Berlin Heidelberg.
Cao, L., Luo, J., Kautz, H., & Huang, T. S. (2008). Annotating collections of photos using hierarchical event and scene models. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008. (pp. 1-8). IEEE.
Cooper, M. L. (2011). Clustering geo-tagged photo collections using dynamic programming. In Proceedings of the 19th ACM international conference on Multimedia (pp. 1025-1028). ACM.
Naaman, M., Paepcke, A., & Garcia-Molina, H. (2003). From where to what: Metadata sharing for digital photographs with geographic coordinates. In: OTM Confederated International Conferences" On the Move to Meaningful Internet Systems" (pp. 196-217). Springer Berlin Heidelberg.
Naaman, M., Harada, S., Wang, Q., Garcia-Molina, H., & Paepcke, A. (2004). Context data in geo-referenced digital photo collections. In: Proceedings of the 12th annual ACM international conference on Multimedia (pp. 196-203). ACM.
Ryu, D. S., Chung, W. K., & Cho, H. G. (2012). A hierarchical photo visualization system emphasizing temporal and color-based coherences. Multimedia Tools and Applications, 61(3), 523-550.
Van House, N., Davis, M., Takhteyev, Y., Good, N., Wilhelm, A., & Finn, M. (2004). From “what?” to “why?”: the social uses of personal photos. In: Proceedings of CSCW 2004
Cao, L., Luo, J., Kautz, H., & Huang, T. S. (2009). Image annotation within the context of personal photo collections using hierarchical event and scene models. IEEE Transactions on Multimedia, 11(2), 208-219.
Rodden, K., & Wood, K. R. (2003). How do people manage their digital photographs? In: Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 409-416). ACM.
Boutell, M., & Luo, J. (2005). Beyond pixels: Exploiting camera metadata for photo classification. Pattern recognition, 38(6), 935-946.
Ransom, N., & Rafferty, P. (2011). Facets of user-assigned tags and their effectiveness in image retrieval. Journal of Documentation, 67(6), 1038-1066.
Creswell, J. W. (2011). Controversies in mixed methods research. The Sage handbook of qualitative research, 4, 269-284.
Schreiber, A. T., Dubbeldam, B., Wielemaker, J., & Wielinga, B. (2001). Ontology-based photo annotation. IEEE Intelligent systems, 16(3), 66-74.
Cristani, M., & Cuel, R. (2005). A survey on ontology creation methodologies. International Journal on Semantic Web and Information Systems (IJSWIS), 1(2), 49-69.
DOI: 10.18780/jiim.v3i1.4275
Refbacks
- There are currently no refbacks.
