A NOVEL MULTI-ASPECT CONSISTENCY MEASUREMENT FOR ONTOLOGIES
Keywords:
Ontology, Semantic Relatedness, Ontology Consistency, WordNetAbstract
Web developers have started to integrate semantic information to their systems increasingly often. The semantic metadata embedded with the resources is typically linked to ontologies or taxonomies. Meta information can bring a number of advantages for users. However, the ontologies might contain some errors or could be partially inconsistent. Therefore it is important to evaluate the quality of ontologies at various levels. Existing evaluation methods either investigate whether the ontologies are "fit for purpose", or focus on evaluating ontology consistencies from a single aspect. In this study, we focus on ontology consistency evaluation methods, which consider lexical, taxonomic and syntactic aspects at the same time. We propose new measures, which capture several essential aspects simultaneously. We demonstrate the effectiveness of the new measure through a case study and an extensive set of experiments.
Downloads
References
Alvarez, M.A. and Lim, S.J., A Graph Modeling of Semantic Similarity between Words. in:
ICSC2007: First IEEE International Conference on Semantic Computing, (Irvine, California,
, 355-362.
Avesani, P., Giunchiglia, F. and Yatskevich, M., A Large Scale Taxonomy Mapping Evaluation.
in ISWC2005: International Semantic Web Conference, Gil, Y. e. a., editor, LNCS 3729, 67-81.
Berlin: Springer-Verlag, 2005.
Brank, J., Grobelnik, M. and Mladenić, D., A survey of ontology evaluation techniques. in SIKDD
, (Ljubljana, Slovenia, 2005), 166-169.
Brewester, C., et al., Data driven ontology evaluation. in LREC2004: Proceedings of Int. Conf. on
Language Resources and Evaluation, (Lisbon, Portugal, 2004), 26-28.
Budanitsky, A. and Hirst, G., Semantic distance in Wordnet: An experimental, applicationoriented
evaluation of five measures. in Proceedings of the North American chapter of the
association for computational linguistics, (Pittsburgh, 2001).
Ding, L., et al., Swoogle: A search and metadata engine for the semantic web. in Proc.
CIKM2004: ACM Thirteenth Conference on Information and Knowledge Management,
(Washington, USA, 2004), 652-659.
Dellschaft, K. and Staab, S., On how to perform a gold standard based evaluation of ontology
learning. in ISWC2006: Proceedings of the 5th International Semantic Web Conference, (Athens,
USA, 2006), 228-241
Gangemi, A., Catenacci, C., Ciaramita, M. and Lehmann, J., Modelling Ontology Evaluation and
Validation. in ESWC2006: The 3rd Annual European Semantic Web Conference, (Budva,
Montenegro, 2006), 140-154.
Gómez-Pérez, A. Evaluation of ontologies. International Journal of Intelligent Systems, 2001,
(3). 391-409.
Gómez-Pérez, A., Fernández-López, M. and Corcho, O. Ontological Engineering. Springer, 2004.
Gómez-Pérez, A., Some Ideas and Examples to Evaluate Ontologies. in AAAI1995: Proceeding of
the 11th Conference on Artificial Intelligence, (Los Angeles, CA, 1995), 299-305.
Gruber, T. Ontology. The Encyclopedia of Database Systems, Ling Liu and M. Tamer Özsu
(Eds.), Springer-Verlag, 2008.
Guarino, N. and Welty, C.A. An overview of OntoClean. In S. Staab and R. Studer, editors,
Handbook on Ontologies. Springer Verlag, 2003.
Guarino, N. Towards a Formal Evaluation of Ontology Quality. IEEE Intelligent Systems, 2004,
(4). 78-79.
Haase, P. and Stojanovic, L., Consistent evolution of OWL ontologies. in Proceedings of the
Second European Semantic Web Conference, (Heraklion, Greece, 2005), vol. 3532 of Lecture
Notes in Computer Science, 182-197.
Hirst, G. and St-Onge, D. Lexical chains as representations of context for the detection and
correction of malapropisms. In Fellbaum 1998, 305-332.
Hong-Minh, T. and Smith, D., Word similarity In WordNet. in Third International Conference on
High Performance Scientific Computing, (Hanoi, Vietnam), Bock, H.G., et al., editors. 293-302.
Berlin: Springer-Verlag, 2008.
http://proton.semanticweb.org/, 2009.
http://wordnet.princeton.edu/, 2009.
Jiang, J.J. and Conrath, D.W., Semantic similarity based on corpus statistics and lexical taxonomy.
in Proc. on International Conference on Research in Computational Linguistics, 1997, 19-33.
Qin, P., Lu, Z., Yan, Y. and Wu, F., A New Measure of Word Semantic Similarity based on
WordNet Hierarchy and DAG Theory. in WISM2009: 2009 International Conference on Web
Information Systems and Mining, (Shanghai, China, 2009), 181-185.
Mazuel, L. and Sabouret, N., Semantic relatedness measure using object properties in an ontology.
in ISWC2008: 7th International Semantic Web Conference, (Karlsruhe, Germany, 2008),
Springer-Verlag, 681-694.
Leacock, C. and Chodorow, M. Combining local context and WordNet similarity for word sense
identification. MIT Press, London, 1998, 265-283.
Lewen, H., Supekar, K., Noy, N.F. and Musen, M.A., Topic-Specific Trust and Open Rating
Systems: An Approach for Ontology Evaluation. in EON2006: Proc. of the 4th International
Workshop on Evaluation of Ontologies for the Web (EON2006) at the 15th International World
Wide Web Conference, (Edinburgh, UK, 2006).
Lin, D., An information-theoretic definition of similarity. in Proceedings of the 15th International
conference on Machine Learning, (Wisconsin, USA, 1998), 296-304.
Lozano-Tello, A. and Gómez-Pérez, A. Ontometric: A method to choose the appropriate ontology.
Journal of Database Management, 2004, 15(2). 1-18.
Lu, Z.‚ Miklos, Z. Cai, S. and Gu, J., Measuring Taxonomic Consistency of Ontologies Using
Lexical Semantic. in ICDIM2001: The Fifth International Conference on Digital Information
Management, (Thunder Bay‚ Canada‚ 2010), 242-247.
Lu, Z., ontoMATCH: A Probabilistic Architecture for Ontology Matching. in ICIS2010: The 3rd
International Conference on Information Sciences and Interaction Sciences, (Chengdu, China,
, 174-180.
Maedche, A. and Staab, S. Measuring similarity between ontologies. in Proceedings of
CIKM2002, LNAI vol.2473, 251-263.
Miller, G.A. and Charles, W.G. Contextual correlates of semantic similarity. Language and
Cognitive Processes, 1991, 6(1).1-28.
Pedersen, T. and Michelizzi, J. http://marimba.d.umn.edu/cgi-bin/similarity/similarity.cgi, 2009.
Resnik, P., Using information content to evaluate semantic similarity in a taxonomy. in
IJCAI2005: 14th International Joint Conference on Artificial Intelligence, (Edinburgh, Scotland,
UK, 2005), 448-453.
Reul, Q., Sleeman, D. and Fowler, D. CleOn: Resolution of lexically incoherent concepts in an
engineering ontology. Technical report, University of Aberdeen, 2008.
Sure, Y., et al. Why Evaluate Ontology Technologies? Because It Works! IEEE Intelligent
Systems, 2004, 19(4). 74-81.
Velardi, P., Navigli, R., Cucchiarelli, A. and Neri, F. Evaluation of OntoLearn: a methodology for
automatic learning of domain ontologies. Ontology Learning from Text: Methods, Evaluation and
Applications, Buitelaar, P., editors. IOS Press, 2005.
Wu, Z. and Palmer, M., Verb Semantics and Lexical Selection. in 32nd Annual Meeting of the
Association for Computational Linguistics, (Las Cruses, New Mexico, 1994), 133-138.
Yang, D. and Powers, D.M.W., Measuring Semantic Similarity in the Taxonomy of WordNet. in
ACSC2005: The Twenty-Eighth Australasian Computer Science Conference, (Newcastle,
Australia, 2005), 315-322.
