Logo des Repositoriums

Auflistung nach Autor:in "Schober, Daniel"

1 - 2 von 2
  • Konferenzbeitrag
    Measuring the effect of a guideline-based training on ontology design with a competency questions based evaluation approach
    (INFORMATIK 2013 – Informatik angepasst an Mensch, Organisation und Umwelt, 2013) Boeker, Martin; Grewe, Niels; Röhl, Johannes; Schober, Daniel; Schulz, Stefan; Seddig-Raufie, Djamila; Jansen, Ludger
    OBJECTIVE: (a) To measure the effect of a guideline-based training on the performance of ontology developers compared with the performance after unspecific training by a competency question based evaluation; and (b) to provide empirical evidence for the applicability of competency questions in formal ontology evaluation in general. BACKGROUND: A close connection between ontology development and ontology evaluation as quality management procedure can been attained with the use of competency questions. Competency questions are often used as a semi-formal specification of requirements for an ontology under development. Hence they can also be used as evaluation instruments, in order to check how far an ontology fulfills these requirements. METHODS: A randomized controlled trial was conducted with two groups of 12 students each. The intervention consisted in a differential guideline-based training on ontology development vs. unspecific training. After a group-specific training focusing on three topics per group, performance of students was assessed with 12 exercises (2 exercises per topic), in which the students had to apply their skills. Different types of competency questions were elaborated for the analysis of the students' ontologies. We used the proportion of correct answers as a measure of ontology quality. RESULTS: On single topic level, the performance of ontology developers increased after guideline-based training for two out of the six topics: it increased from a proportion of 0.46 to 0.63 for the topic Process \& Participation and from 0.44 to 0.53 for the topic Collective Material Entity. In regression analysis, a positive correlation was shown between the performance of students on untrained topics and the performance after specific guideline-based training. Moreover, in multiple regression analysis an overall effect of specific training of 0.09 was calculated (p < 0.1). CONCLUSION: The results show an effect of a specific guideline-based training on the performance of ontology developers compared to the performance after unspecific training by an increase of about 10 % on the rate of correct competency questions. In addition, this study has shown the general applicability of competency questions in a formal ontology evaluation scenario. However, the study also shows that the training of ontology developers and their performance evaluation is a tedious task. The resulting performance of ontology developers is more dependent on the a priori individual competencies than on the specific acquired skills after training.
  • Konferenzbeitrag
    Ontological analysis of controlled vocabularies used in PSI/MSI supported XML standards
    (INFORMATIK 2013 – Informatik angepasst an Mensch, Organisation und Umwelt, 2013) Schober, Daniel; Mayer, Gerhard; Moing, Annick; Eisenacher, Martin; Neumann, Steffen
    Besides a plethora of formal ontologies, the requirement for simple data annotation has led to an increased use of so called controlled vocabularies (CV) in multiple omics communities. We analyze two of those CVs from an ontological viewpoint, highlight typical modelling errors and propose more adequate solutions. Discovered errors are discussed in the light of the OOPS ontology pitfall framework and the OBO Foundry naming conventions. As a result the CVs could be improved and the OOPS catalogue could be amended and expanded with new, previously missing error categories. In an outlook we discuss potential reasons for the error prevalence and analyse what criticism is justified for CV semantics and what `errors' are more valid for formal ontologies rather than CVs. We conclude that although many design principles valid for description logics ontologies are not relevant for semantically flat CVs and in turn there is a need for CV-best-practices that are not appropriate for description logics ontologies, there is room for improvement in the analysed CVs. The scope difference between CVs and formal semantics however should affect policy providers, which should narrow down the scope of their policies, i.e. by stating for each policy the expressivity regime for which it is valid.