Logo des Repositoriums

P295 - INFORMATIK 2019 - 50 Jahre Gesellschaft für Informatik – Informatik für Gesellschaft (Workshop-Beiträge)

https://dl.gi.de/handle/20.500.12116/25040
Auflistung nach:

Auflistung P295 - INFORMATIK 2019 - 50 Jahre Gesellschaft für Informatik – Informatik für Gesellschaft (Workshop-Beiträge) nach Schlagwort "Annotation"

1 - 3 von 3
  • Konferenzbeitrag
    Annotator-Centered Design: Towards a Tool for Sentiment and Emotion Annotation
    (INFORMATIK 2019: 50 Jahre Gesellschaft für Informatik – Informatik für Gesellschaft (Workshop-Beiträge), 2019) Schmidt, Thomas; Jakob, Marco; Wolff, Christian
    We present a first prototype of the tool SentiAnno, which is an annotation tool specifically designed for sentiment and emotion annotation in structured written texts. To design this tool, we employ the user-centered design (UCD) framework and adapt it by focusing on the annotator, thus phrasing our development approach annotator-centered design. In iterative steps, we gather requirements and feedback from annotators as soon as possible in the development process via various usability engineering methods. We propose that this design process is especially beneficial for challenging and subjective annotation tasks like sentiment and emotion annotation of literary texts. We describe our first iterations and present results of the current prototype. We show how we were able to create functionalities facilitating the annotation process by applying this annotator-centered design approach.
  • Konferenzbeitrag
    Corpus2Wiki: A MediaWiki-based Tool for Automatically Generating Wikiditions in Digital Humanities
    (INFORMATIK 2019: 50 Jahre Gesellschaft für Informatik – Informatik für Gesellschaft (Workshop-Beiträge), 2019) Hunziker, Alex; Mammadov, Hasanagha; Hemati, Wahed; Mehler, Alexander
    We describe current developments of Corpus2Wiki. Corpus2Wiki is a tool for generating so-calledWikiditions out of text corpora. It provides text analyses, annotations and their visualizations without requiring programming or advanced computer skills. By using TextImager as a back-end, Corpus2Wiki can automatically analyze input documents at different linguistic levels. Currently, it automatically annotates information regarding lemmatization, parts of speech, morphological information, named entities, geolocations and topic labels based on the Dewey Decimal Classification (DDC). Any results are stored and displayed by means of a modified and extended MediaWiki which makes it easy to further process texts and their annotations. The aim of this paper is to present the capabilities of Corpus2wiki, to point out the improvements made and to make suggestions for further development.
  • Konferenzbeitrag
    Inter-Rater Agreement and Usability: A Comparative Evaluation of Annotation Tools for Sentiment Annotation
    (INFORMATIK 2019: 50 Jahre Gesellschaft für Informatik – Informatik für Gesellschaft (Workshop-Beiträge), 2019) Schmidt, Thomas; Winterl, Brigitte; Maul, Milena; Schark, Alina; Vlad, Andrea; Wolff, Christian
    We present the results of a comparative evaluation study of five annotation tools with 50 participants in the context of sentiment and emotion annotation of literary texts. Ten participants per tool annotated 50 speeches of the play Emilia Galotti by G. E. Lessing. We evaluate the tools via standard usability and user experience questionnaires, by measuring the time needed for the annotation, and via semi-structured interviews. Based on the results we formulate a recommendation. In addition, we discuss and compare the usability metrics and methods to develop best practices for tool selection in similar contexts. Furthermore, we also highlight the relationship between inter-rater agreement and usability metrics as well as the effect of the chosen tool on annotation behavior.