This is a one-hour video recording of the presentation of Aldo Gangemi at the KnowledgeWeb summer school 2005. It comprises either the video synchronized with the slides (but requires Quicktime, hence Windows or MacOS, otherwise the slides have to be switched manually).

Table of Contents: Ontology Validation and Evaluation Recap on ontology engineering techniques Main needs Outline of the tutorial Quality - 1 The nature of ontologies What is an ontology - socio-cognitive cut Ontologies? Resources to be reengineered? An early model of ontology dimensions In the real world A different perspective: the communication roles of ontologies Ontologies as semiotic objects The three realms of evaluation Quality assessment A formal characterization of quality assessment Quality - 2 Structural evaluation - Dimensions, elements, measurement methods A formal characterization of quality assessment Ontology (structural) measure definition Types of structural measures (graph-based) Types of structural measures (formal semantics) Types of structural measures (reification) Quality - 3 Functional evaluation - Coverage, Precision and Accuracy Guarino’s model Precision and coverage Ontologies by precision Accuracy and precision Applicability of functional measures Intended conceptualization as expertise An example: the BWO A state of affairs that maps to M Another state of affairs that maps to M Quality checking of BWO Another state of affairs that maps to M Quality checking of BWO - (cont’d) Qualified expressions of intended conceptualization: some measurement methods for P/R Agreement assessment Competency assessment The Oracle HR schema in OWL A remodelling that tries to catch the intended conceptualization Competency assessment Topic assessment Modularity assessment Foundational visions vs. topic-based modules A toy example of stratification Foundational visions vs. topic-based modules A more complex library Practical stratification: Fishery Ontology Service Minimal case of alignment Current modules in the fishery ontology Quality - 4 Usability evaluation - Recognition, Efficiency and Interfacing Recognition Economic efficiency Interfacing Quality - 5 Principles, parameters, and preferential ordering Some principles Parameters and principles (examples) Preferential ordering An example: patterns vs. cycles An example of the pattern/cycle trade-off Back to the quality model Some references